Thank you for this!
The X100V is my first Fuji camera and I was very perplexed by this behaviour. At first I thought it was a lack of understanding from my part. I read the manual and I've searched around but couldn't find anything regarding this until now.
Like others, the only way I've found around this is to keep Custom setting #1 to default settings. So when I want to "reset" everything, I just select this custom setting.
Maybe they'll change the way this works in a firmware update... or maybe we're just missing something.