Re-reading your comment and the last one, it sounds like that glitch with 4K was something different.
I wasn't using the EVF but the brightness jumps on screen and is as recorded. I tried using a manual lens to rule out problems with auto aperture and got the same issue. I'll hopefully be able to post a link to an example which was trimmed off the end of about 1minute of recording. Up until 40seconds in, it was rock steady, then this:
http://jumpingspider.co.uk/fuji-pentax-lens.mov
Wow that was a long wedding speech!