The post-“goodbye” state is as off as the player goes. The slow drain is probably caused by things like the internal clock still being powered.
I would not store it with the charger always plugged in. While batteries have improved a lot over time, recharging all the time will probably lessen the battery life in the long run.
