AI INFRASTRUCTURE

Google adds TPU systems for confidential inference and large context workloads

By IDAKIM Digital · Published

TPU 8tx and TPU 8i Max specialize existing eighth-generation silicon for two different deployment bottlenecks.

Google expanded its eighth-generation TPU portfolio on November 9 with two system configurations. TPU 8tx combines training-grade TPU 8t silicon, fifth-generation AMD EPYC hosts and the Boardfly network for confidential inference and smaller training jobs. Google says the design protects sensitive data and model weights while in use and reduces latency compared with TPU 8t. TPU 8i Max packages two TPU 8i chips together, doubling compute, SRAM and high-bandwidth memory bandwidth relative to TPU 8i to address large context workloads. Google distinguishes these new systems from designing entirely new chips: packaging, networking, memory and security can evolve faster than silicon. The announcement also describes its broader software stack, including a preview TPU agent suite and newly generally available Cloud Pathways and dynamic slicing on GKE. Performance statements are Google’s claims. The article does not provide a universal customer order date or public pricing for the new systems.

Why it matters

Select infrastructure against the actual constraint: confidentiality, memory bandwidth or latency. Confirm availability, supported model stacks and end-to-end costs before treating an announced system as immediately deployable capacity.

Source: Google · November 9, 2026

Product claims are attributed to the linked publisher. IDAKIM Digital has not independently tested these claims.

Read the full edition