How to replace broken clip on Clip+?

Has anyone tried magnets with Clip? This is what I am thinking. assuming no interference with the player!

Two flat magnets smaller than a quarter. Glue one to the back of the player. Then hold the player against gym shorts or t-shirt sleeve, then attach the second magnet from the other side of the fabric. In theory, it should work. 

What I am not sure is whether or not the magnet will distort the sound, or damage the player!

Any thoughts?