NVIDIA's Vera Rubin hits the cloud: what the new instances mean for AI workloads in 2026

NVIDIA Vera Rubin began production shipments in August 2026 and is reaching cloud partners, with 5x inference over Blackwell. What to plan for.

Read time
7 min
Word count
1.2K
Sections
9
FAQs
8
Share
Glowing AI supercomputer rack streaming data into cloud icons on a dark set
NVIDIA now names ten cloud partners for Vera Rubin, and cloud access has started.
On this page · 9 sections
  1. What NVIDIA shipped
  2. Where and when you can get it
  3. Why it matters for your workloads
  4. Planning the move
  5. India-specific considerations
  6. What to do this quarter
  7. FAQ
  8. How eCorpIT can help
  9. References

Summary. NVIDIA said in January 2026 that Rubin was in full production, said at GTC Taipei on 31 May that the platform was ramping into full production, and told investors on 26 August that production shipments had begun earlier that month. CoreWeave announced availability on 30 September, Oracle Cloud announced general availability on 27 October, and Google Cloud's A5X instances are due in November. NVIDIA's March release also names AWS, Microsoft Azure, Crusoe, Lambda, Nebius, Nscale and Together AI. The jump is large. A Rubin GPU delivers 50 petaflops of FP4 inference, 5 times Blackwell, and 35 petaflops for training, 3.5 times Blackwell, with HBM4 memory bandwidth of 22 terabytes per second at launch, 2.8 times higher, though NVIDIA's current product page lists 19.2. NVIDIA says the platform cuts cost per token up to 10x versus Blackwell for large mixture-of-experts inference, the economics that sit under model prices like $1 to $6 per million tokens. For infrastructure and ML platform teams, the question is not whether Rubin is faster but which workloads justify moving and when capacity will actually be reachable.

Update, 2 November 2026. This article originally said Vera Rubin entered full production on 1 June and would ship this fall. NVIDIA's own sequence is different: it said Rubin was in full production in January, said on 31 May that the platform was ramping into full production, and told investors that production shipments began in August. Cloud access has started, NVIDIA now counts seven chips and names ten cloud partners, and its current product page lists lower per-GPU memory and NVLink bandwidth than its launch figures. See our GTC 2027 buyer briefing for rack power and the roadmap.

What NVIDIA shipped

Vera Rubin is a platform of seven chips, not a single GPU: the Vera CPU, the Rubin GPU, the NVLink 6 Switch, the ConnectX-9 SuperNIC, the BlueField-4 DPU and the Spectrum-6 switch, plus the Groq 3 LPU added in March 2026. NVIDIA called Rubin in full production in January and the platform ramping into full production on 31 May, and CoreWeave said on 1 June that it was the first AI cloud provider to bring up and validate an NVL72. The rack-scale unit, the NVL72, combines 72 Rubin GPUs and 36 Vera CPUs into one system, delivering 3.6 exaflops of inference compute and 2.5 exaflops for training.

Where and when you can get it

NVIDIA's March release names ten cloud partners: the hyperscalers most teams already use, AWS, Google Cloud, Azure and Oracle Cloud, plus the specialist NVIDIA Cloud Partners CoreWeave, Crusoe, Lambda, Nebius, Nscale and Together AI. Production shipments began in August 2026. CoreWeave announced availability on 30 September, with Cognition as its first production customer, and Oracle announced general availability on 27 October. NVIDIA's 21 October post carries a general availability headline for Google Cloud's A5X instances, but its text says that is due in November. We found no general availability announcement from the others on 2 November, so confirm directly. As with every NVIDIA generation, the constraint will be capacity, not catalogue availability, so early reservation matters more than which provider lists it first.

Metric Rubin Improvement vs Blackwell
FP4 inference per GPU 50 petaflops 5x
FP4 training per GPU 35 petaflops 3.5x
Memory bandwidth (HBM4) 19.2 TB/s on current product page; 22 TB/s at launch 2.8x on launch figure
NVLink per GPU 3 TB/s on current product page; 3.6 TB/s at launch 2x
NVL72 rack inference 3.6 exaflops About 5x at rack scale
Cost per token (MoE inference) Up to 10x lower 10x

Why it matters for your workloads

The gains are not uniform, so the migration decision should not be either. Rubin's advantage is largest where memory bandwidth and interconnect dominate: large mixture-of-experts inference, advanced reasoning, and agentic workloads that fan out many model calls. Higher HBM4 bandwidth and doubled NVLink are what deliver the up-to-10x cost-per-token improvement, and that is the number that changes a FinOps case. For steady, small-batch inference that already runs cheaply, the benefit is marginal, and the sensible move is to wait. Our guide to GPU spend as a FinOps concern frames the tradeoff.

Workload Rubin advantage What to do
Large MoE and reasoning inference Up to 10x lower cost per token Prioritise for migration
Frontier model training 3.5x training throughput Reserve capacity early
Memory-bound models 19.2 TB/s HBM4 bandwidth per GPU Strong fit, plan a move
Standard small-batch inference Marginal at current cost Stay put for now
Small or steady workloads Limited benefit No urgency to migrate

Planning the move

Treat Rubin as a capacity-reservation exercise, not an upgrade you click. Identify the workloads whose cost per token or training time actually gates the business, model the saving against reserved-instance pricing when providers publish it, and get in the reservation queue early because demand will outrun supply. For everything else, Blackwell and cost-optimised options remain the right call, a point we make in our FinOps guide for cloud teams.

India-specific considerations

For Indian teams, Rubin capacity will arrive first through the global hyperscalers and specialist clouds rather than local infrastructure, so latency and data-residency questions matter for any workload touching personal data under the Digital Personal Data Protection Act, 2023. Weigh the cost-per-token saving against egress and residency, and reserve early, because Indian demand competes in the same global capacity pool. The broader planning frame is in our enterprise AI strategy guide.

What to do this quarter

Shortlist the two or three workloads where cost per token or training time is a real constraint, and size the Rubin saving against your current Blackwell spend. Open reservation conversations with your cloud provider now, since capacity, not availability, is the bottleneck. Leave everything that runs cheaply today where it is, and revisit once reserved pricing is public.

FAQ

How eCorpIT can help

eCorpIT is a Gurugram-based, CMMI Level 5 consultancy and an AWS, Microsoft and Google partner. Our senior infrastructure engineers help teams decide which workloads justify Rubin, model the cost-per-token saving against current spend, and plan capacity reservations and migration without over-committing. To plan your AI infrastructure for 2026, talk to our team.

References

  1. NVIDIA kicks off the next generation of AI with Rubin: six new chips, one AI supercomputer - NVIDIA Newsroom.
  1. Inside the NVIDIA Rubin platform: six new chips, one AI supercomputer - NVIDIA Technical Blog.
  1. NVIDIA kicks off the next generation of AI with Rubin - NVIDIA Investor Relations.
  1. NVIDIA Vera Rubin ships this fall: 8 cloud partners, 10x lower token cost, HBM4 triples bandwidth - Tech Times.
  1. NVIDIA Vera Rubin NVL72 GPU cloud: availability, cost per token, and planning your Rubin rental in H2 2026 - Spheron.
  1. NVIDIA says Rubin will deliver 5x AI inference boost over Blackwell - HPCwire.
  1. NVIDIA Rubin vs Blackwell vs Hopper: generation-to-generation comparison - Spheron.
  1. NVIDIA Vera Rubin NVL72 detailed: 72 GPUs, 36 CPUs, 260 TB/s scale-up bandwidth - VideoCardz.
  1. NVIDIA Rubin is the most advanced AI platform: up to 50 PFLOPs with HBM4 - Wccftech.
  1. NVIDIA launches next-generation Rubin AI compute platform - ServeTheHome.
  1. NVIDIA Vera Rubin opens agentic AI frontier, 16 March 2026 - NVIDIA Newsroom.
  1. NVIDIA Vera Rubin ramps into full production, 31 May 2026 - NVIDIA Newsroom.
  1. NVIDIA Q2 fiscal 2027 earnings call transcript, 26 August 2026 - NVIDIA Investor Relations.
  1. CoreWeave completes industry-first bring-up and validation of NVIDIA Vera Rubin NVL72, 1 June 2026 - CoreWeave.
  1. CoreWeave delivers NVIDIA Vera Rubin NVL72 performance at production scale, 30 September 2026 - CoreWeave.
  1. Google Cloud and NVIDIA announce general availability of NVIDIA Vera Rubin infrastructure, 21 October 2026 - NVIDIA Blog.
  1. NVIDIA and Oracle expand NVIDIA Vera Rubin to multi-gigawatt scale, 27 October 2026 - NVIDIA Newsroom.
  1. NVIDIA Vera Rubin NVL72 product page - NVIDIA.
  1. NVIDIA Vera Rubin datasheet, October 2026 - NVIDIA.

Last updated: November 2, 2026.

Frequently asked

Quick answers.

01 When will Vera Rubin be available in the cloud?
It has started. NVIDIA began production shipments in August 2026, CoreWeave announced availability on 30 September, Oracle Cloud announced general availability on 27 October, and Google Cloud's A5X instances are due in November. Actual access will depend on reserved capacity rather than general listing, so early reservation is advisable.
02 Which cloud providers will offer Vera Rubin?
NVIDIA's March release names ten: the hyperscalers AWS, Google Cloud, Microsoft Azure and Oracle Cloud, plus the specialist NVIDIA Cloud Partners CoreWeave, Crusoe, Lambda, Nebius, Nscale and Together AI. That spread covers the providers most teams already use, so the practical question is which one can reserve you capacity in your region, not which one lists Rubin first.
03 How much faster is Rubin than Blackwell?
A Rubin GPU delivers 50 petaflops of FP4 inference, 5 times Blackwell, and 35 petaflops of training, 3.5 times Blackwell. NVIDIA quoted 22 terabytes per second of HBM4 bandwidth and 3.6 of NVLink per GPU at launch, and its current product page lists 19.2 and 3. At rack scale the NVL72 reaches 3.6 exaflops of inference.
04 What is the NVIDIA Vera Rubin NVL72?
It is the rack-scale system that combines 72 Rubin GPUs and 36 Vera CPUs with NVLink 6, ConnectX-9 SuperNICs and BlueField-4 DPUs into one unit. It delivers 3.6 exaflops of inference compute and 2.5 exaflops for training, and it is the building block cloud partners deploy for large-scale AI workloads.
05 Is Rubin cheaper to run than Blackwell?
For the right workloads, yes. NVIDIA says Rubin cuts cost per token up to 10x versus Blackwell for large mixture-of-experts inference, driven by HBM4 bandwidth and doubled NVLink. For steady, small-batch inference that already runs cheaply, the saving is marginal, so the economics favour migrating heavy inference and reasoning workloads rather than everything.
06 Should we migrate our AI workloads to Rubin?
Only the workloads where cost per token or training time gates the business. Large mixture-of-experts inference, reasoning and frontier training see the biggest gains and are worth prioritising and reserving early. Standard small-batch inference that runs cheaply today sees marginal benefit, so the sensible default there is to wait.
07 What is HBM4 and why does it matter?
HBM4 is the memory generation Rubin uses, giving up to 288 GB per GPU and 19.2 terabytes per second of bandwidth on NVIDIA's current product page, against 22 at launch. Memory bandwidth is the bottleneck for large-model inference, so this is what delivers much of Rubin's throughput and cost-per-token gain, especially for memory-bound mixture-of-experts models.
08 How should Indian teams access Rubin capacity?
Through the global hyperscalers and specialist clouds first, since Rubin will not arrive in local infrastructure immediately. Reserve early because Indian demand competes in the same global capacity pool, and weigh the cost-per-token saving against egress and data-residency needs under the DPDP Act for any workload handling personal data.

About the author

Manu Shukla

Founder & Director

Founder of eCorpIT. Hands-on engineer leading senior-only delivery for AI apps, custom software, and cloud systems for global clients.

Subscribe

One engineering note a week. No fluff, no spam.

Senior-architect playbooks on AI agents, mobile apps, cloud, security, data, and marketing — delivered every Wednesday.

Past the reading

Read enough. Let's build something.

A senior architect responds in 24 working hours with scope, indicative cost, and a timeline. NDA before any technical conversation.

Loading search…

Browse all guides