In terms of journey time, you would do better looking at Cheung Chau or Lamma islands. As well as the places that show up in the Trip Advisor reviews, there are plenty of self-catering flats available on both islands. Maybe someone else on this site has details for some of them?
Always lots of booths and spruikers for them in the roads just by the ferry piers when you arrive, but I've never bothered noticing the contact details.
If you're investigating Pok Fu Lam, the closest districts to be looking for hotels on HK island itself are Kennedy Town and Aberdeen.