If I’m looking down while using iron sight aiming, the gun will automatically point upwards in the opposite direction. Same thing happens if I’m looking up when I start to aim; the gun will be moved downwards towards the ground.
I use inverted Y on my controls, no idea if this has anything to do with it.