I just double checked, changed 23mm for 56mm and vise versa and it didn't change magnification automatically.
Edit: Okay, it changes only if camera remains turned on, when the change occurs. Which is odd, I usually change lenses when the camera is off.
Edit 2: Now, when it changed couple of times being turned on, it started to change every time regardless of being turned on or off. This is really odd, it wasn't changing at all before that, I'm not insane. And it appears I'm not the only one who had this problem. Maybe there is another reason why it didn't change before, I'm not sure anymore.