Good to know you found a workaround to that noise, because it is absolutely normal for Fuji X-T4.
Camera has powerful electromagnets to put sensor "flying in the air" after you turned it on. When Image Stabilizer is disabled, sensor just remains "flying" in static position. When Image Stabilizer is enabled - electromagnets are reacting and shifting sensor to compensate movements and keep image stable.
There is no way to turn that electromagnets off when X-T4 camera is operating. So you will always have that noise. In some cases magnets are producing additional sounds when stabilizing sensor position - that sounds are also normal, indicating that camera is operating properly.
Personally, I prefer completely silent cameras, and it was the main reason for me to sell X-T4. But if you need Image Stabilizer - Fuji X-T4 is excellent tool.