"face" means your position and how you are evaluated by your peers, by those around you. to lose face is to suffer a devaluation of that esteem. that is, others think less highly of you because of whatever it was. It is often embarassing to lose face, but that is not the act of losing face, it is the result. Embarassment is shame at yourself, you did something that you are ashamed of. Losing face generally involves having done something that should be shameful, for which you should be embarassed.
Only a person that doesn't care what others think of them would be free of shame. Such a person would have no real "face" to lose.