Theoretically you are right, and this was actually tried already a long time ago to get decoupled look/aim, but in 99.9% of cases you would look into a black void when doing this. Games clip unwanted objects/geometry away long before vorpX comes into play.
You can observe the same effect when you overdo it with the “3D FOV Enhancement” in the vorpX menu, which causes objects in the peripheral part of the view to pop in and out in most games at high values.