why was it so important that the nobles were the only people who wore fine clothing?

It set the social hierarchy and made them easily identifiable. However before too long wealthy merchants also were wearing expensive clothing, some of the time these merchants were put to death, other times they bribed their way into being able to wear the clothing.

no call for them knee deep in bull**it or mud have a nice day