Hmmm. First please try to reset the profile to default in the vorpX menu. All you should have to do for KCD is running the DirectVR scanner for FOV and 1:1 low latency head tracking, plus potentially adjusting the resolution in the vorpX menu.
If the issue still occurs after resetting the profile and running the DirectVR scanner, make sure that vorpX is set to native Oculus mode or OpenXR, not SteamVR. Shouldn’t really matter, but worth a shot. If that still doesn’t help, try to disconnect the PlayStation gamepad.