Tapeworm, agreed about bad tags being the usual cause…
But the OP formatted the microSD already–destroying any bad tags–and the unit gets stuck with it in, boots up easily without it.
I had this problem with a Fuze of my own–stuck on Refreshing with an empty card in the slot, fine without it. The Format trick worked.