$RECYCLE.BIN Folder Created On Flash Drive

I am wondering if this is a sign of a virus.

No!  Most likely the USB drive was seen as a Fixed drive rather than Removable drive by Windows and that’s what Windows does with Fixed drives.