Are you using a Mac or PC? If using a Mac, you must empty your Trash before disconnecting the drive or the files won’t be deleted, only the reference to them making it appear they have gone but aren’t.
If using a PC, I don’t know why the space is still showing used, but you can format the drive which will delete everything.
