If your VPS is wired with another one using VPC or any other internal network it'll just work. Just point Caddy to specified internal IPs of your other servers.

It's not designed to work on local envs. When I wanted to debug infra I used to run it on Vagrant though