\”that\”既問題

Basically, they mean the same.

I know that he is on his way here. = more written and formal speaking.
I know he is on his way here = use in speaking

I think that I have met him once
I think I have met him once.

您好，我推薦您一個非常不錯的英語學習網站，里面有很多非常不錯的學習資源，您能從中得到不少幫助：

http://www.hkenglishstudy.info

祝您好運!

正式是有 that，但可以略去。