SanDisk Clip+ acting crazy

Try it. It can’t hurt.

Formatting gets rid of anything you (or screwy Windows Media Player)  might have added to make it freak out.  That’s in a separate partition from the firmware. Updating the firmware fixes the other (hidden) partition. So basically you will have completely taken it back to zero if you both format and update the firmware.