#H100

2 articles tagged

Close-up of a glowing GPU processor on a dark circuit board

AI & Cloud Infrastructure · Jul 19, 2026 · 10 min read

NVIDIA B200 vs H100 in 2026: why the pricier GPU is cheaper per token

A 2026 cost-per-token comparison of the NVIDIA B200 and H100 for LLM inference, with MLPerf v6.0 throughput, real cloud hourly rates, the arithmetic that makes the pricier chip cheaper per token, and the cases where

Manu Shukla

#nvidia-b200 #H100 #LLM inference

A glowing data-centre GPU accelerator card on a dark studio surface, lit in teal and amber

Cloud & FinOps · Jul 15, 2026 · 14 min read

FP8 vs BF16 on H100: what a million tokens costs on AWS, Azure and GCP in 2026

vLLM's April 2026 benchmark put FP8 KV-cache 14.9% above BF16 on one H100. Priced out, that is $4.24 down to $3.69 per million output tokens - and your AWS purchase model moves the number four times further.

Manu Shukla

#FinOps #GPU #H100