1.Let me first make an example, a group of students, even in kindergarten, all wearing uniforms, most of the students are talking loudly or playing wildly, only one student keeps silence; in this case, he or she might be told that he is too “斯文”. – not good appraisal
2.”斯文” is usually referred to man. For woman, at least in traditional Chinese culture, “斯文” is a required character for woman.
3.“斯文” sometimes is a direct feeling from someone face without any connection with the clothes he or she wears; of course, dressed
in rags will reduce ”斯文”, but elegant clothes is definitely not required.
And to wear elegant cloth will actually reduce “斯文”.
Because I almost know nothing about the face of famous American. But at least, Sylevester Stallone is not the man who looks “斯文”. And I know nothing about House Speaker: Paul Ryan, but I feel he looks 斯文。
4. 斯文, sometimes is a compliment to someone, but sometime it’s a negative attitude toward someone. For example, after the typhoon, soldiers are normally asked to clean the roads, if most of the soldier take 20 kg stuff to the garbage tanks, only you takes 10 kg stuff to the garbage tank; then the sergeant might say(blame) you and say, you’re too 斯文. (In this case, it means you'r are too weak and faminine)
5. On the contrary, if you go to a glasses store to buy a new one. In China or Taiwan, the seller might tell you “you look 斯文, so this one will fit you”. In this case 斯文 has a positive meaning, which hints you like a scholar.
6. I agree most of the words used by Wiki to descript 斯文,but to use elegance, refined and refinement, I think, is overkill.
Oh, the most closely English equivalent of 斯文 is gentle. But as you could see : Different languages sometimes can never be translated correctly.