Yes, format the Sansaclipz. That's the player. The other drive is the memory card slot. This appears whether there's a card inserted or not.
Note formatting will erase all content you have put on the player, so you will have to transfer everything (music files, etc.) back to it afterwards.