aaaaah,
the fix was simple. it was connected to the flash settings (a user in a german speaking fuji forum pointed it out).
i have to turn off the flash compeltely in the menu. it was set to "M", and since the camera is not able to use the electronic shutter with a flash it never went over 1/4000s. turning the flash off completely makes the M+E setting behave as expected.