If you turn off the player while it is playing the FM radio, it will ‘resume’ on the radio when you power it on.
If you go to Music and select an .mp3 song to play then turn it off, it will start up on that the next time it is powered on.
At least that is the way it is supposed to work. 
