← Back to feed
7

AWS and NVIDIA Expand AI Collaboration at GTC 2026

InfraTop News1 source·Mar 16

Summary

  • • AWS will deploy over 1 million NVIDIA GPUs across global regions starting in 2026
  • • AWS is the first major cloud provider to announce NVIDIA RTX PRO 4500 Blackwell support
  • • NVIDIA NIXL on AWS EFA enables interconnect acceleration for disaggregated LLM inference
  • • NVIDIA Nemotron model support expanded on Amazon Bedrock
Adjust signal

Details

1.Infrastructure

AWS to deploy 1M+ NVIDIA GPUs globally starting 2026

The deployment covers both Blackwell and next-generation Rubin GPU architectures across AWS global cloud regions, reinforcing AWS's claim to the broadest NVIDIA GPU-based instance portfolio among major cloud providers.

2.Product Launch

AWS first major cloud to support NVIDIA RTX PRO 4500 Blackwell Server Edition

Instances built on the AWS Nitro System, suited for data analytics, conversational AI, content generation, recommender systems, video streaming, and graphics workloads. Availability described as 'coming soon.'

3.New Tech

NVIDIA NIXL on AWS EFA accelerates disaggregated LLM inference

NIXL provides interconnect acceleration specifically for disaggregated large language model inference workloads running on AWS Elastic Fabric Adapter, targeting latency and throughput bottlenecks in production AI serving.

4.Stat

3x faster Apache Spark performance with NVIDIA RTX PRO 6000 Blackwell GPUs

Achieved using Amazon EMR on Amazon EKS with EC2 G7e instances. The improvement targets data engineering and analytics pipelines, broadening GPU utility in enterprise workflows beyond pure model training or inference.

5.Product Launch

Expanded NVIDIA Nemotron model support added to Amazon Bedrock

Nemotron is NVIDIA's family of enterprise-focused LLMs. Expanding availability on Bedrock gives AWS customers access to these models through the managed model API service alongside existing foundation model offerings.

6.Partnership

AWS and NVIDIA extend collaboration to Spectrum networking

Added to over 15 years of joint innovation, the Spectrum networking collaboration extends the partnership beyond compute into high-speed interconnect infrastructure, relevant for large-scale distributed AI training and inference.

Infrastructure = compute/networking buildout, Product Launch = new service or instance availability, New Tech = novel technical capability, Stat = quantified performance claim, Partnership = joint business/technical agreement

What This Means

This expanded AWS-NVIDIA partnership represents a significant escalation in cloud GPU commitments, with over one million GPUs — spanning current Blackwell and upcoming Rubin architectures — set to land across AWS regions within the year. For enterprises moving AI from pilot to production, this signals more availability and variety of high-performance GPU instances, including first-mover access to RTX PRO 4500 Blackwell hardware. The additions to interconnect technology and Spark performance also indicate that the collaboration is maturing beyond model training into the full AI infrastructure stack, including inference serving and data pipelines.

Sources

Similar Events