What is the cost of an equivalent setup using A100s?
I have no idea what I am doing but here goes!
By [1] we have 156 FP16 TFLOPS, taking their non "*" (* = with sparsity) value. So you need 5 So $40,000? pls the other stuff, and someone to make a profit putting it together say $50,000?
So this setup is 3 times cheaper for the same.
If I am allowed to use the sparsity value it is 1.5 times cheaper.
I have no idea what I am doing but here goes!
By [1] we have 156 FP16 TFLOPS, taking their non "*" (* = with sparsity) value. So you need 5 So $40,000? pls the other stuff, and someone to make a profit putting it together say $50,000?
So this setup is 3 times cheaper for the same.
If I am allowed to use the sparsity value it is 1.5 times cheaper.
[1] https://www.nvidia.com/content/dam/en-zz/Solutions/Data-Cent...