What are the speakers "highpassed" at?

If the same amount of distortion is coming from both sides, I doubt both speakers are equally damaged.

However if it is more prevelant on one side, you could have a warped voice coil.

Also make sure the speakers aren't coming in contact with your doorpanels when they start moving, this will deflect the cone and cause the voice coil to hit the magnet.