OP: I think you mentioned that you are from the UK. So, imagine living atop the Hilton Hotel in Canary Wharf, with a toddler, when you have options all over London. Why would you do that - there isn't much for children in the immediate area, while surrounding residential communities in all directions offer so much more. Living in Admiralty (where the Pacific Place apartments are located) would be much the same, you will be living in a very busy commercial district, with good transportation to other parts of HK, but the area itself is not residential. The "shops" in the mall below are along the lines of Louis Vuitton and Prada, and the grocery market in the mall is one of the most expensive in HK. There are a few restaurants, but most cater towards the business lunch/ dinner crowd and are child unfriendly (in terms of menu, seating arrangements, etc.).
You can walk to Central or Wan Chai from Admiralty, but in the summer heat (and often heavy rain), not to mention the very heavy roadside pollution in this area, I can't imagine wanting to do this walk with a little one in tow. And, I wouldn't want to have to travel by public transport or taxi every single time I went to a playgroup (I cannot stress enough how hot it is and that indoor play activities are a must for kids during the summers, which last sometimes until October, in HK.)
I think "The Brit" mentioned taxis for transport with your toddler. While it is legal to have kids in cars without car seats in Hong Kong, I personally think it is nuts and exceptionally unsafe. Cab drivers in Hong Kong bad, like really terrible. I have had cab drivers fall asleep at the wheel, drive onto the sidewalk, drive on the wrong side of the road into oncoming traffic to pass, been in two small accidents involving taxis and had one cab have a break failure. All of these things happened within 10 minutes of my home. Just something to think about - the MTR, and busses to some extent, are much safer options for travelling with an unrestrained child.
Am not trying to talk you out of your choice, but rather just let you know that for the short term Pacific Place apartments are probably great, I can't imagine wanting to live there with a child long term. The list Mat gave you is excellent and should help you find a real home here for your family.