Nginx is a web server, which can also be used as a reverse proxy, load balancer and HTTP cache.

Varnish is an HTTP cache.

Squid is a caching and forwarding HTTP web proxy. It has a wide variety of uses, from speeding up a web server by caching repeated requests.