It's been tried a few times. The bottleneck still exists in the last mile of the network. Users simply don't have good enough equipment to reliably handle this amount of streaming data.
Yep, real-world HLS/DASH solutions rely heavily on edge caches; you don't care as much about having your infra in the right region, but POPs are everything.
One of the problems is that even "symmetric" connections are usually not symmetric at all (obviously talking about residential connections here, not DIA).