I would say it is getting more and more difficult to find jobs in HK if you don't know how to read or write Chinese.
Like some people say, you can work in your own country first and get the skills and have that target to eventually move to HK in all your decisions i.e. a company which has offices in HK, an industry that is in HK etc. Bear in mind, HK in 3 or 5 years time may be very different...
If you decide to come straight away, just keep an open mind that you may not get exactly the job you want. Are you coming for your career, or for a lifestyle? And think about what compromises you are willing to make.