Although they did let me thru, the one time that I forgot my ID card at home and only had my passport, I got a small bit of a lecture from the border guys going out and then back into Hong Kong.
"You must carry your ID card all the time, why dont you have it etc etc etc". After the short speech and my humble mumbled apology, they chopped my passport and let me thru.
HC