Do your Ears evolve, via evolution with hearing. People used to tell me that you can't hear the sounds in music (as a kid) cuz my ears?

"Evolve" would not be an appropriate word to use to describe this situation. Evolving is not something that an organ in an individual can do. It is perfectly reasonable to understand that your brain becomes more attuned to certain parts in music as you are exposed to it and learn to key in on particular sounds. But that is your brain learning to pay attention to certain things, not really your ears physiologically changing.

First, evolution is the incorrect word. Evolution happens to populations and not to individual organisms or to an organism's organs.

The more appropriate word would be development. I have been a biologist for a long time and I have never heard of this. However, like all biologists I am not an expert in all aspects of biology but it does not ring true. If anything as you age you tend to lose some hearing. Children generally have excellent hearing.

That's why 'people used to tell me' isn't as factual as scientific reasoning.

Adults lose high end hearing when their ears have been damaged by high pitched or loud sounds. Many people who work on flight decks near planes, or use jack hammers have major hearing loss. Most adults lose less hearing than those people but it still happens to some degree.