You will still have to apply for the Certificate (Certificate of Absence of Marriage Record or "CAMR"/無結婚記錄證明書).
In this case, the Immigration Department will issue a letter of marriage record instead of CAMR. Use this with the addition of your divorce decree to prove that the marriage in question has been dissolved.
Please note - all document intended to be used in Taiwan must be authenticated by TECO:
http://www.tecos.org.hk/authentication