If your boyfriend (and you can show that as well) is a visitor of the flat, and you have no idea (basically if you have prosecuted or not) that he possess any drugs, Housing Department will hesitate to act on the issue.
However, if he lives there, be prepared to lose the rental place.