It sounds like you are not safely removing your USB drive.
For U3 you should use the Safely eject U3 smart drive option, for regular USB drives the Windows Safely Remove Hardware option, to ensure the Windows write cache is totally written to the USB drive BEFORE removing the drive from the machine.