Smooth movement of mouse in robot movements

[anandasaia]

I have a docker container setup with x11vnc, xvfb and novnc. There is an API running inside of it which accepts mouse coordinates as POST requests and make use of pyautogui to move the mouse to that location and click on it.
Regardless of what I set the duration as in the pyautogui call, it moves very abruptly in the vnc display.
Is there a way to fix this?