vorpX has gamepad to kb/mouse mapping functionality built-in. When that is active per default, there normally is a reason for that. Usually disabling it would break head tracking because the game in question does not allow mouse (emulated by vorpX for head tracking) and gamepad to be used together.
You can try to disable the ‘X-Box Gamepad Override’ in the vorpX menu, but be warned: if it’s on per default for a game, it’s almost certainly on for good reason.