Okay, so using my Mac mini from another room via VNC on my Windows 11 laptop is never going to be a smooth experience, let’s get that set from the start. On some occasions, needs must and you do what you have to do.
Ten days ago, my Mac mini was on a “go-slow”. It became almost unresponsive when using it direct. VNC was an utter impossibility.
Today, however, it’s happy to let me work from another room via the VNC.

You have to accept the slight response delay as the screen is updated, but it’s generally a workable short-term solution.
How things can differ from one week to the next.