最近成田機場的溫泉一問

I think the best choice is 台場大江戶溫泉物語. This 溫泉 is opened from 11 am to 9 am the next day, so you can still go to the 溫泉 whenever you arrive at Tokyo.
For the details of this 溫泉 please refer to the following web site :
http://www.ooedoonsen.jp/chinese/index.html
For other 溫泉 in Tokyo (actually they are all within an hour's travel from成田機場), please check out from this web site :
http://forum.timway.com/f/thread-211684-1-1.html
Enjoy your trip!