Problems with Sansa Shaker Cap

I was having problems with the cap falling off also. So I pushed down on it as suggested and now it stays on but I have a hard time gettting it off. Is there a trick to that also?