I have recently bought X100F and use card reader only the first time. Now i tried the usb cable that was shipped with the camera. It charged the camera but it didn't connect.
Because i have had this issues before with other things, i can give my solution.
1. It is rarely a driver issue, don't go there first!
2. Use a good thick cable with a RF-filter on. It wasn't on the cable i got but it is a cable with a visible outgrowth, usually on one side only.
3. Don't use a USB3. Use USB2.0 (the one without the blue inside)
4. Don't connect to monitor or a hub. Connect directly to MAC/PC/Laptop
5. Connect to camera first, then to PC and last turn on the camera. And reverse this order when the camera is going to be de-attached.
I hope it helps!