Have you lived overseas?
The facilities here are pathetic compared to countries with good sporting records. Just having a tiny number of 50m pools scattered throughout the urban jungle doesn't somehow 'fix' everything.
There are not enough facilities for swimming- in Australia people have pools in their back yards. And every suburb will have multiple public pools with year round, cheap swimming classes aimed at young children. Swim instruction for kids is a miserable search in HK- you either try to find instructors to come if you have an estate pool (most people don't) or you fight your way to one of the small number of public pools where it is so noisy that they kids can't hear anything.
More broadly speaking the entire bureaucracy surrounding government facilities here also discourages usage. The ridiculous and sometimes months-long focus on 'certs' for facilities access are a huge barrier to building any sort of broad base for future sporting prowess. Which thb is fine for most people, as sporting ability is simply not valued here by most families.