NVIDIA's Vera Rubin hits the cloud: what the new instances mean for AI workloads in 2026

NVIDIA Vera Rubin entered production June 1, 2026 and reaches 8 cloud partners this fall, with 5x inference over Blackwell. What to plan for.

Read time
7 min
Word count
812
Sections
9
FAQs
8
Share
Glowing AI supercomputer rack streaming data into cloud icons on a dark set
NVIDIA's Vera Rubin reaches eight cloud partners this fall in 2026.
On this page · 9 sections
  1. What NVIDIA shipped
  2. Where and when you can get it
  3. Why it matters for your workloads
  4. Planning the move
  5. India-specific considerations
  6. What to do this quarter
  7. FAQ
  8. How eCorpIT can help
  9. References

Summary. NVIDIA's Vera Rubin platform entered full production on June 1, 2026 at the GTC Taipei keynote, and production shipments reach eight cloud partners this fall: AWS, Google Cloud, Microsoft Azure, Oracle Cloud, CoreWeave, Lambda, Nebius and Nscale. The jump is large. A Rubin GPU delivers 50 petaflops of FP4 inference, 5 times Blackwell, and 35 petaflops for training, 3.5 times Blackwell, with HBM4 memory bandwidth of 22 terabytes per second, 2.8 times higher. NVIDIA says the platform cuts cost per token up to 10x versus Blackwell for large mixture-of-experts inference, the economics that sit under model prices like $1 to $6 per million tokens. For infrastructure and ML platform teams, the question is not whether Rubin is faster but which workloads justify moving and when capacity will actually be reachable.

What NVIDIA shipped

Vera Rubin is a platform of six chips, not a single GPU: the Vera CPU, the Rubin GPU, the NVLink 6 Switch, the ConnectX-9 SuperNIC, the BlueField-4 DPU and the Spectrum-6 switch. It reached full production on June 1, 2026, and CoreWeave completed the first Vera Rubin NVL72 system bring-up the same day. The rack-scale unit, the NVL72, combines 72 Rubin GPUs and 36 Vera CPUs into one system, delivering 3.6 exaflops of inference compute and 2.5 exaflops for training.

Where and when you can get it

The eight confirmed cloud partners cover the hyperscalers most teams already use, AWS, Google Cloud, Azure and Oracle Cloud, plus the specialist NVIDIA Cloud Partners CoreWeave, Lambda, Nebius and Nscale. Shipments begin this fall, in the second half of 2026. As with every NVIDIA generation, the constraint will be capacity, not catalogue availability, so early reservation matters more than which provider lists it first.

Metric Rubin Improvement vs Blackwell
FP4 inference per GPU 50 petaflops 5x
FP4 training per GPU 35 petaflops 3.5x
Memory bandwidth (HBM4) 22 TB/s 2.8x
NVLink per GPU 3.6 TB/s 2x
NVL72 rack inference 3.6 exaflops About 5x at rack scale
Cost per token (MoE inference) Up to 10x lower 10x

Why it matters for your workloads

The gains are not uniform, so the migration decision should not be either. Rubin's advantage is largest where memory bandwidth and interconnect dominate: large mixture-of-experts inference, advanced reasoning, and agentic workloads that fan out many model calls. The 22 TB/s of HBM4 bandwidth and doubled NVLink are what deliver the up-to-10x cost-per-token improvement, and that is the number that changes a FinOps case. For steady, small-batch inference that already runs cheaply, the benefit is marginal, and the sensible move is to wait. Our guide to GPU spend as a FinOps concern frames the tradeoff.

Workload Rubin advantage What to do
Large MoE and reasoning inference Up to 10x lower cost per token Prioritise for migration
Frontier model training 3.5x training throughput Reserve capacity early
Memory-bound models 22 TB/s HBM4 bandwidth Strong fit, plan a move
Standard small-batch inference Marginal at current cost Stay put for now
Small or steady workloads Limited benefit No urgency to migrate

Planning the move

Treat Rubin as a capacity-reservation exercise, not an upgrade you click. Identify the workloads whose cost per token or training time actually gates the business, model the saving against reserved-instance pricing when providers publish it, and get in the reservation queue early because demand will outrun supply. For everything else, Blackwell and cost-optimised options remain the right call, a point we make in our FinOps guide for cloud teams.

India-specific considerations

For Indian teams, Rubin capacity will arrive first through the global hyperscalers and specialist clouds rather than local infrastructure, so latency and data-residency questions matter for any workload touching personal data under the Digital Personal Data Protection Act, 2023. Weigh the cost-per-token saving against egress and residency, and reserve early, because Indian demand competes in the same global capacity pool. The broader planning frame is in our enterprise AI strategy guide.

What to do this quarter

Shortlist the two or three workloads where cost per token or training time is a real constraint, and size the Rubin saving against your current Blackwell spend. Open reservation conversations with your cloud provider now rather than after the fall launch, since capacity, not availability, is the bottleneck. Leave everything that runs cheaply today where it is, and revisit once reserved pricing is public.

FAQ

How eCorpIT can help

eCorpIT is a Gurugram-based, CMMI Level 5 consultancy and an AWS, Microsoft and Google partner. Our senior infrastructure engineers help teams decide which workloads justify Rubin, model the cost-per-token saving against current spend, and plan capacity reservations and migration without over-committing. To plan your AI infrastructure for 2026, talk to our team.

References

  1. NVIDIA kicks off the next generation of AI with Rubin: six new chips, one AI supercomputer - NVIDIA Newsroom.
  1. Inside the NVIDIA Rubin platform: six new chips, one AI supercomputer - NVIDIA Technical Blog.
  1. NVIDIA kicks off the next generation of AI with Rubin - NVIDIA Investor Relations.
  1. NVIDIA Vera Rubin ships this fall: 8 cloud partners, 10x lower token cost, HBM4 triples bandwidth - Tech Times.
  1. NVIDIA Vera Rubin NVL72 GPU cloud: availability, cost per token, and planning your Rubin rental in H2 2026 - Spheron.
  1. NVIDIA says Rubin will deliver 5x AI inference boost over Blackwell - HPCwire.
  1. NVIDIA Rubin vs Blackwell vs Hopper: generation-to-generation comparison - Spheron.
  1. NVIDIA Vera Rubin NVL72 detailed: 72 GPUs, 36 CPUs, 260 TB/s scale-up bandwidth - VideoCardz.
  1. NVIDIA Rubin is the most advanced AI platform: up to 50 PFLOPs with HBM4 - Wccftech.
  1. NVIDIA launches next-generation Rubin AI compute platform - ServeTheHome.

_Last updated: July 10, 2026._

Frequently asked

Quick answers.

01 When will Vera Rubin be available in the cloud?
NVIDIA's Vera Rubin platform entered full production on June 1, 2026, and production shipments to cloud partners begin this fall, in the second half of 2026. CoreWeave completed the first NVL72 system bring-up on June 1. Actual access will depend on reserved capacity rather than general listing, so early reservation is advisable.
02 Which cloud providers will offer Vera Rubin?
Eight confirmed partners: the hyperscalers AWS, Google Cloud, Microsoft Azure and Oracle Cloud, plus the specialist NVIDIA Cloud Partners CoreWeave, Lambda, Nebius and Nscale. That spread covers the providers most teams already use, so the practical question is which one can reserve you capacity in your region, not which one lists Rubin first.
03 How much faster is Rubin than Blackwell?
A Rubin GPU delivers 50 petaflops of FP4 inference, 5 times Blackwell, and 35 petaflops of training, 3.5 times Blackwell. Memory bandwidth rises to 22 terabytes per second with HBM4, 2.8 times higher, and NVLink doubles to 3.6 terabytes per second per GPU. At rack scale the NVL72 reaches 3.6 exaflops of inference.
04 What is the NVIDIA Vera Rubin NVL72?
It is the rack-scale system that combines 72 Rubin GPUs and 36 Vera CPUs with NVLink 6, ConnectX-9 SuperNICs and BlueField-4 DPUs into one unit. It delivers 3.6 exaflops of inference compute and 2.5 exaflops for training, and it is the building block cloud partners deploy for large-scale AI workloads.
05 Is Rubin cheaper to run than Blackwell?
For the right workloads, yes. NVIDIA says Rubin cuts cost per token up to 10x versus Blackwell for large mixture-of-experts inference, driven by HBM4 bandwidth and doubled NVLink. For steady, small-batch inference that already runs cheaply, the saving is marginal, so the economics favour migrating heavy inference and reasoning workloads rather than everything.
06 Should we migrate our AI workloads to Rubin?
Only the workloads where cost per token or training time gates the business. Large mixture-of-experts inference, reasoning and frontier training see the biggest gains and are worth prioritising and reserving early. Standard small-batch inference that runs cheaply today sees marginal benefit, so the sensible default there is to wait.
07 What is HBM4 and why does it matter?
HBM4 is the memory generation Rubin uses, giving up to 288 GB per GPU and 22 terabytes per second of bandwidth, 2.8 times Blackwell. Memory bandwidth is the bottleneck for large-model inference, so this is what delivers much of Rubin's throughput and cost-per-token gain, especially for memory-bound mixture-of-experts models.
08 How should Indian teams access Rubin capacity?
Through the global hyperscalers and specialist clouds first, since Rubin will not arrive in local infrastructure immediately. Reserve early because Indian demand competes in the same global capacity pool, and weigh the cost-per-token saving against egress and data-residency needs under the DPDP Act for any workload handling personal data.

About the author

Manu Shukla

Founder & Director

Founder of eCorpIT. Hands-on engineer leading senior-only delivery for AI apps, custom software, and cloud systems for global clients.

Subscribe

One engineering note a week. No fluff, no spam.

Senior-architect playbooks on AI agents, mobile apps, cloud, security, data, and marketing — delivered every Wednesday.

Past the reading

Read enough. Let's build something.

A senior architect responds in 24 working hours with scope, indicative cost, and a timeline. NDA before any technical conversation.