Hello everyone,
Sorry for not updating sooner, there was initially no response for a long time so never checked back. I returned the X-Pro3 to the shop and they said it was indeed defective. They sent it back to Fujifilm who quickly sent me a replacement (and an upgrade from black to Duratect black!). It didn't go through a warranty claim or anything, the shop just sent it back and Fujifilm gave me a replacement, so that was nice. So, if you're having this issue then I'd return it to the shop you bought it at and have them give you a replacement.