The side of the door on the warm room would expand, whereas the other side on the cool room would contract. The combined effect of contraction and expanding makes the door to warp, thus having difficulty to open it.
Since the warpping would make the door to curve towards the cool room, it might be easier to have it opened onto the cool romm.