Headphone/speaker jack versus a USB connection?

I unplug and plug mine in a lot.  When I use my car cassette adaptor for my morning and afternoon commute (just about everyday), when I  charge it at home on the griffin dock (have to remove it), or load it at work (again have to remove it for the usb cable).  So far no problems.