不是上市公司也可以派股息給股東嗎

Yes.
Whenever a dividend is to be paid out, it has to be approved by the Board of Directors in a meeting 董事會 and the Shareholders normally in the Annual General Meeting.股東週年大會. This is normally stated out in the Memorandum and Article 公司組織章程 of the limited company.