Meaning: something/someone that spoils a perfect or very satisfactory situation, plan or state of affairs
Usage:
Jack: "Apparently they don't like poor Lennie."
Jone: "Well, neither do I."
Jack: "He's the only fly in the ointment around here, as far as I'm concerned."