Canonical event
Google introduces PaLM 540B trained across multiple TPU v4 Pods
Google introduced PaLM, a 540B dense language model trained with Pathways on 6,144 TPU v4 chips across multiple pods, reporting broad few-shot, reasoning and code capabilities.
Artifacts
Signals
- Q2 research increased uncertainty about capability forecasting by documenting benchmark behaviors that appeared only above model-scale thresholds.supported inference
- Frontier-scale accelerator infrastructure became more externally accessible through cloud preview, while scale, price-performance, interconnect and software utilization remained explicit constraints.supported inference
- Frontier model scaling increasingly depended on distributed-systems software and high-bandwidth multi-pod networking, not only on adding accelerator chips.supported inference