Hi,
for me the keyboard worked but the mouse didnt.
Here is how i start x11vnc:
x11vnc -noipv6 -rawfb /dev/fb0 -geometry 1920x1080 -pipeinput UINPUT:direct_abs=/dev/uinput -dk -dpI found something here: https://embeddeduse.com/2016/04/01/remote-support-vnc-harvester-terminal/
Maybe that is the only way?