I've always theorized that, in prehistory, the only source of cold water would be recent snowmelt; streams that came fairly directly from a probably-clean source. Warm water could have all sorts of things growing in it. So our ancestors who found cool water to be particularly refreshing and sought it out might have suffered less from waterborne illness.