You might like to consider this point. There is a current campaign to increase the penalty for using a mobile phone while driving to a 12 month ban like drink driving. The logic is that any distraction from driving is a BAD THING.
If you critically listen in the car, are you being distracted? Are you driving or listening?
I don't need a high end car audio system as I only listen to, for example, Radio 4 in the background. This is not a distraction. It's the difference between having the radio on at home while you do the ironing and sitting down to listen in front of your main system. You need to decide which is your primary activity.
On a secondary point, listening in the car at high volume which drowns all noises from the outside and mechanical sound from the car is the equivalent of a cyclist with an iPod - a danger to others.