GPU reference
Hardware catalog used by the calculation engine. Costs are 2024–2025 market rates and update periodically.
| Model | VRAM | Mem BW | FP16 TFLOPS | TDP | Form factor | Interconnect | Cost |
|---|---|---|---|---|---|---|---|
| NVIDIA H200 SXM | 141 GB | 4800 GB/s | 989 | 700 W | SXM5 | NVLink 900GB/s | $40K |
| NVIDIA H100 SXM | 80 GB | 3350 GB/s | 989 | 700 W | SXM5 | NVLink 900GB/s | $30K |
| NVIDIA H100 PCIe | 80 GB | 2039 GB/s | 756 | 350 W | PCIe | PCIe Gen5 | $25K |
| NVIDIA A100 80GB | 80 GB | 2039 GB/s | 312 | 300 W | SXM4 | NVLink 600GB/s | $15K |
| NVIDIA L40S | 48 GB | 864 GB/s | 362 | 350 W | PCIe | PCIe Gen4 | $7K |
| NVIDIA RTX 6000 Ada | 48 GB | 960 GB/s | 178 | 300 W | PCIe | PCIe Gen4 | $6.8K |
| Intel Gaudi 3 | 128 GB | 3700 GB/s | 900 | 900 W | OAM | RoCE v2 | $15K |