Networks

What changed

Recent signals

• NVIDIA presents a six-chip AI infrastructure platform combining accelerators, CPUs and networking. Partner-system availability is planned for the second half of 2026; the announcement is not current capacity.retrospective mapping
  supported inference
• AWS announces GA of Trn3 UltraServers with Trainium3 chips and an expanded interconnect fabric. Advertised performance ratios are vendor claims and GA is not evidence of unconstrained global capacity.retrospective mapping
  supported inference
• Trainium2 GA incorporated networked UltraCluster deployment, separating available instance scale-out from preview larger systems.retrospective mapping
  supported inference
• AI Ethernet infrastructure acquired named vendor-reported adoption beyond design announcements; deployment magnitude and performance remained unverified.retrospective mapping
  supported inference
• AI compute access is beginning to acquire a market-and-orchestration layer that can allocate burst capacity dynamically across heterogeneous infrastructure, creating an optimization path based on scheduling and utilization in addition to building more accelerator capacity.
  supported inference
• Operational AI accelerator infrastructure diversified beyond NVIDIA-centered cloud offerings through AMD MI300X availability and Google's TPU v5p/AI Hypercomputer path.retrospective mapping
  supported inference
• H100-class AI acceleration became generally available through multiple major hyperscale cloud providers while remaining expensive, regional and concentrated.retrospective mapping
  supported inference
• High-end AI supercomputing became more explicitly packaged as a commercial cloud service integrating accelerators, networking and AI software.retrospective mapping
  supported inference
• The next generation of transformer-focused accelerator infrastructure moved from announced architecture toward production and orderable systems.retrospective mapping
  supported inference
• Frontier-scale accelerator infrastructure became more externally accessible through cloud preview, while scale, price-performance, interconnect and software utilization remained explicit constraints.retrospective mapping
  supported inference
• Frontier model scaling increasingly depended on distributed-systems software and high-bandwidth multi-pod networking, not only on adding accelerator chips.retrospective mapping
  supported inference
• By the end of Q1 2022, the clearest stack coupling ran through research, models, software, compute, chips, networks, manufacturing and governance; the selected evidence does not yet support persistent agents or agent permissioning as independent operational layers.retrospective mapping
  supported inference
• Transformer workloads were becoming an explicit target of accelerator, interconnect and system architecture design rather than merely software running on generic compute.retrospective mapping
  supported inference
• Dedicated AI supercomputing was becoming a distinct operational layer, with model progress increasingly dependent on large accelerator fleets, high-bandwidth networking and storage.retrospective mapping
  supported inference
• Large AI deployments are broadening beyond single-vendor accelerator stacks into integrated rack-scale systems where networking, cooling and open Ethernet architectures are strategic components.
  supported inference
• The AI stack is becoming more tightly coupled across models, agents, permissions, compute, chips, software, networks, energy and governance.
  supported inference
• Long-horizon AI and agent workloads are driving large multi-year commitments for cloud capacity, memory and supporting infrastructure.
  supported inference
• System-level scaling, interconnect design and software integration are being used to compensate for limits at the individual accelerator level.
  supported inference