Unless you are using a adaptive sync monitor, I'd say that vsync is likely desirable anyways. A little bit of input lag as a cost in return of getting rid of all the tearing and jitter is not a bad deal, but the choice should probably be exposed for the players in settings.
To answer your question, it's likely up to frame time consistency. V-Sync likely helps achieve a more consistent frame timing and thus a smoother experience.
It's hard to say for sure tho, with vsync off are you just rendering so many more frames(but still in a consistent timing) that you see a lot of consistent tearing or is the frame timing actually an unpredictable mess on your hw config when vsync is off? That is something you'll have to debug yourself.