Why did I get yelled at for this at work? Was this justified?

next time if he yells at you grab a stapler and jam one into his face.

If he yelled at you he could have been more tactful -- moving close to you and letting you know that removing staples was no longer required.
Revenge? Well, you could continue removing the staples. Or you could just let it go.

I wouldn't worry about it - people are jerks for all kinds of reasons - just forget about it.

they were probably just having a bad day. it isn't your fault that he took it out on you so just let it go and be happy again.

Well, It's no reason to yell at someone for that, he could have just told you quietly that you don't need to do that. You could steal all the staples out of his stapler for revenge.

It was wrong of your boss to yell at you. He may have been stressed or under pressure. He can fire you. Just drop it. It's not a big deal. Brush off the ego. Pay more attention to signs. Don't let pride make you do something stupid. We all make mistakes. We will be embarrassed. It happens. Learn to handle it with grace. Make a joke even - if appropriate - better to just say - ok - Sorry. Move on.

I understand how you feel. I work in an office. He will have forgotten about it - if not already.