How can I disable VNC on a server?

On the server configuration page, you can disable VNC access by leaving the VNC password field blank.