At the end of the day, it's about how much you are willing to spend! The good news is that HK is a very very safe city, even the sketchier parts is actually safe to live in. And that the city itself is geographically small. You can be like the other expats and live in the mid levels/sheung wan where there's easy access to bars to drown your bitterness of being alone (and random hookups!).
Or you can try the more "Chinese" Kowloon side and save a little bit more in rent. Since I have no idea what your budget is, I will just throw out a whole bunch of suggestions to confuse you more! Actually, just stay in West Kowloon. It's on a metro stop, near central, near Harbour City and is also a airport express station so you can get out of the city in no time! If I recall, besides the public transportation there's actually a free shuttle bus between the elements mall in westkowloon to Harbour city, or just walk there in 20 minutes.
I'm not a real estate agent or anything, but you can PM/post in here for more questions. Like all cities in the world, people will endlessly debate about their district etc. As long as you got the cash to spend money in this shoebox city, you should be fine.