It’s pretty much impossible to delete the firmware files as you suggest, especially since Rockbox is a dual-boot system. That is, it sits alongside of the original firmwware so you can boot into either at will. It does not replace it.
That said, you can manually install the firmware by going here and following the directions.
