Tag
P-EAGLE, DFlash, and DSpark bring parallel drafting to vLLM in 2026, generating a whole block of draft tokens in one pass for up to 1.69x higher throughput than EAGLE-3. How they work and how to serve them.
Manu Shukla 
CPU-based autoscaling scales GPU inference too late. A 2026 config guide to HPA, KEDA, external metrics and Karpenter, with YAML for queue-depth and scale-to-zero scaling of LLM inference on Kubernetes.
Manu Shukla 
AMD's Instinct MI400 series splits in two: the MI455X for frontier AI and inference, the MI430X for sovereign AI and FP64 HPC. A decision guide to the specs, the cost claims and 2026-2027 availability.
Manu Shukla 
AWS reduced ECS Managed Instances management fees 60% for P-series and Trainium and 35% for G-series from July 1, 2026, the same day Capacity Block GPU rates rose. Here is how to capture the cut, with configuration
Manu Shukla 
AWS shipped two NVIDIA Blackwell inference families in 2026: G7 with up to 4.6x the inference of G6, and G7e that runs a 70B model on a single 96 GB GPU and is now live in Mumbai. Here is the spec, cost and decision
Manu Shukla 
Dynamic Resource Allocation is GA in Kubernetes v1.35, but NVIDIA's upstream driver still ships its GPU kubelet plugin disabled by default. Here is what actually works today, with manifests.
Manu Shukla 
Gartner expects power to constrain 40% of AI data centers by 2027, and GPU lead times run 36 to 52 weeks. This 2026 playbook covers capacity forecasting, spot vs reserved, neo-clouds and procurement governance.
Manu Shukla 
Kubernetes v1.35 introduced the Workload API and native gang scheduling. Four months later v1.36 replaced the API version entirely. Here is the current shape, the migration, and the GPU maths that justifies it.
Manu Shukla 
AWS lifted EC2 Capacity Block rates about 20% in July 2026 and 15% more on October 7. P6-B300 now bills at $16.146 per accelerator hour. What changed, why analysts disagree on the cause
Manu Shukla 
vLLM's April 2026 benchmark put FP8 KV-cache 14.9% above BF16 on one H100. Priced out, that is $4.24 down to $3.69 per million output tokens - and your AWS purchase model moves the number four times further.
Manu Shukla 
Kubernetes is the default home for AI, yet GPUs often run at 5% utilization, wasting over $100,000 a year. How a managed platform fixes GPU scheduling and cost for Indian enterprises running AI.
Manu Shukla 
NVIDIA's Vera Rubin NVL72 began production shipments in August 2026 and promises up to 10x lower cost per token than Blackwell. Why your GPU bill may still climb first, and what to do about it.
Manu Shukla 
NVIDIA's Vera Rubin began production shipments in August 2026 and is reaching cloud partners now, promising 5x inference over Blackwell and up to 10x lower cost per token. What to plan for.
Manu Shukla 