Why is this so badly designed for audiobooks?

Pretty much this. I just bought a Clip, and I have the same concerns. The clip + was so much better. I am not opposed to the Jam but they really need to fix the glaring software issues with firmware updates.