Technically speaking, your tax representative is acting as your agent in handling your tax affairs on your behalf. You have to absolute right to change andfto nominate another person in place of him. As he is an agent, you can ask him to surrender all the documents back to you by law.
For this year's submission, I just wonder whether IRD will give you an extension for submitting your tax return by giving them application now. But do try and talk to IRD for advice.