Update as of this morning: After a solid ten days of leaving the camera ON without the battery, I put the battery back again in the X100V, and unfortunately, it went back to the pairing with smartphone mode again.
This workaround doesn't help me with the problem. At this moment, I am getting frustrated and desperate as well. If someone has other ideas/suggestions, please share them with me.