per Zuckerberg[0], ~half of their H100s were for Reels content recommendation:
> I think it was because we were working on Reels. We always want to have enough capacity to build something that we can't quite see on the horizon yet. ... So let's order enough GPUs to do what we need to do on Reels and ranking content and feed. But let's also double that.
So there's an immense capacity inside Meta, but the _whole_ fleet isn't available for LLM training.
> I think it was because we were working on Reels. We always want to have enough capacity to build something that we can't quite see on the horizon yet. ... So let's order enough GPUs to do what we need to do on Reels and ranking content and feed. But let's also double that.
So there's an immense capacity inside Meta, but the _whole_ fleet isn't available for LLM training.
[0]: https://www.dwarkeshpatel.com/p/mark-zuckerberg?open=false#§...