Technically he cannot forcefully remove you, shit you can even keep living there without paying rent if you want to play games, it would take the LL minimum 3 months to get a court order and have bailiffs to forcefully remove you. that is if you want to take it that far.
When negotating of getting your deposit back, if the LL plays silly buggers and doesnt want to, DO NOT HAND OVER KEYS until you have your deposit back, NO CHEQUES, CASH IS KING. \
Threaten the LL with the knowledge above
Next time dont make silly mistakes.