Each Nvidia H100 AI GPU can deliver around 1,000 TFLOPS in FP16 or BF16, common formats for AI training - and reaching 50 ExaFLOPS using that baseline would theoretically require 50 million H100s.