I‘m using a lot of manul lenses with different cameras, including Fuji, and I still don’t understand your issue. Stopping down ‚a bit‘ means f5.6 or 8 for me at normal daylight conditions. But even when using f18 and above under rare circumstances, after adjusting the exposure time there is no problem seeing the subject and adjusting the focus.