Fab Whack-A-Mole: Chinese Companies are Evading U.S. Sanctions

Huawei Fab Network, WFE Vendors Cry Wolf, Framework for Future Controls

Oct 28 • 

Dylan Patel

, 

Jeff Koch

, and 

Sravan Kundojjala

7

Datacenter Anatomy Part 1: Electrical Systems

Meta Datacenter Scrapped, Vertiv, Schneider Electric, Eaton, Datacenter Bill Of Materials By Component, Transformers, Switchgear, Redundancy, UPS, ATS…

Oct 14 • 

Dylan Patel

, 

Jeremie Eliahou Ontiveros

, and 

Daniel Nishball

8

AI Neocloud Playbook and Anatomy

H100 Rental Price Cuts, AI Neocloud Giants and Emerging Neoclouds, H100 Cluster Bill of Materials and Cluster Deployment, Day to Day Operations, Cost…

Oct 3 • 

Dylan Patel

 and 

Daniel Nishball

10

Clash of the Foundries: Gate All Around + Backside Power at 2nm

Fab Cost, WFE Implications, Backside Power Details

Oct 1 • 

Dylan Patel

 and 

Jeff Koch

10

September 2024

Multi-Datacenter Training: OpenAI's Ambitious Plan To Beat Google's Infrastructure

Gigawatt Clusters, Telecom Networking, Long Haul Fiber, Hierarchical & Asynchronous SGD, Distributed Infrastructure WinnersGigawatt Clusters, Telecom…

Sep 4 • 

Dylan Patel

, 

Daniel Nishball

, and 

Jeremie Eliahou Ontiveros

17

The Memory Wall: Past, Present, and Future of DRAM

Winners & Losers in the 3D DRAM Revolution

Sep 3 • 

Dylan Patel

, 

Jeff Koch

, 

Tanj

, 

Wega Chu

, and 

Afzal Ahmad

6

August 2024

Nvidia's Blackwell Reworked - Shipment Delays & GB200A Reworked Platforms

MGX GB200A NVL36, B102, B20, CoWoS-L, CoWoS-S, GB200A NVL64, ConnectX-8, Liquid Cooling vs Air Cooling, NVLink Backplane, PCB, CCL, Substrate, BMC…

Aug 4 • 

Dylan Patel

, 

Wega Chu

, 

Daniel Nishball

, 

Myron Xie

, and 

Chaolien Tseng

13

July 2024

GB200 Hardware Architecture - Component Supply Chain & BOM

Hyperscale customization, NVLink Backplane, NVL36, NVL72, NVL576, PCIe Retimers, Switches, Optics, DSP, PCB, InfiniBand/Ethernet, Substrate, CCL, CDU…

Jul 17 • 

Dylan Patel

, 

Wega Chu

, 

Chaolien Tseng

, 

Myron Xie

, 

Jeremie Eliahou Ontiveros

, and 

Daniel Nishball

22

June 2024

100,000 H100 Clusters: Power, Network Topology, Ethernet vs InfiniBand, Reliability, Failures, Checkpointing

Frontier Model Scaling Challenges and Requirements, Fault Recovery through Memory Reconstruction, Rack Layouts

Jun 17 • 

Dylan Patel

 and 

Daniel Nishball

24

OpenAI Chip Team Is Now Serious

Poaching Aggressively

Jun 3 • 

Dylan Patel

12

May 2024

How Dell Is Beating Supermicro

Enterprises, Sovereign AI, CoreWeave, Tesla, AI Neocloud economics + orders

May 30 • 

Dylan Patel

, 

Daniel Nishball

, and 

Caleb Goh

22

Apple’s AI Strategy: Apple Datacenters, On-device, Cloud, And More

When to run on-device, in Apple datacenters, or in the cloud with OpenAI, Deal economics

May 27 • 

Dylan Patel

 and 

Myron Xie

16