How to play ALL songs on Playlist not just one album there?

I use an SD card with the Sandisk clip jam and I’ve created a playlist on the card and when I select the playlist with the clip jam it only will play an album on the playlist instead of playing songs from ALL of the albums on the playlist.  How do you make it play all the songs on the playlist and not just one little album there?