Checked out the store, it's called Prelude. Pretty decent collection of classical, jazz and rock reissues (they have most of the major labels). However I found them a bit pricey at HKD 275 each album.
For anyone who's interested, the HMV at iSquare mall in TST now has a shelf of vinyl too. Not much of a choice, but most of teh latest releases are available.