I made some salad dressing just using olive oil and lemon juice and a few dry ingredients. Should I refrigerate it?

Yes

Yep. Because of the lemon. Be warned, it will most likely solidify a bit. Just take it out of the fridge 15-20 minutes before you use. Or you can nuke it VERY briefly - you don't want hot dressing!

yes sounds refreshing