This depends on the game framerate. Anything less than rock solid 75fps causes judder. The judder is probably just more apparent in these modes as they are a bit more demanding than the normal mode.
If you are sensitive to low framerate issues and a game supports both 3D methods, you may want to consider switching to Z-Buffer 3D in such cases, which trades 3D-fidelity for speed.
Loosely related: If you have an nVidia card, I would recommend to set the Vsync mode in the nVidia control panel to Adaptive Vsync. Doesn’t solve low framerate issues, but helps mitigate them.