Agreed. Rack density is the biggest thing once you get away from "a handful of servers", be it CPU, memory, or storage density.

Side note: I'm curious where this 1:8 ratio of cores:memory came from. Everyone seems to be standardising on it, even at VM levels