This changed everything I thought about AI:

This changed everything I thought about AI: Marc Andreessen, billionaire tech investor imagine a form of alchemy that turns sand into thought pause on that for a moment this made me think: everyone talks about AI AI 101: CHIPS but nobody explains how the chips actually work how you turn sand into thought like Mark Andresen said I'm gonna explain it in under three minutes sand is made mostly of silicon silicon is an element some elements conduct electricity others block it Silicon is in between which is why it's called a semiconductor chip makers like TSMC in Taiwan who produce chips for Nvidia take a bunch of sand melt it purify it to like 99.999999% silicon grow it into a giant crystal and then slice it into these razor thin mirror polished discs that they put a light sensitive coating onto they then basically take a stencil with some holes in it shine a light through the stencil and a lens to shrink the pattern to a fraction of its size and effectively print tiny on/off switches onto that silicon wafer ON 1 OFF 0 on means one and off means zero those are the only two letters in a computer's alphabet these switches are so tiny that thousands of them fit across a single strand of human hair you're gonna print billions of these switches onto this one slice then connect them so switches flip other switches and electricity into it and voila a computer the thinking machine behind AI but not all chips are created equal AI requires one key thing parsing massive amounts of information into an answer people often explain it like a restaurant trying to feed brunch to 10,000 people all at once we need different chips to do this 3 kinds of chips... 1 CPU or CPU that's the chip inside every laptop in our restaurant it's the head chef he's brilliant he can cook anything from steak to souffle but he works sequentially one step then the next one plate at a time but AI isn't one complicated order it's a simple order repeated billions of times at once our chef can't do that all by himself cause he does things one at a time from start to finish two options to help him the first is a graphics processing unit or GPU that's the kind of chip that Nvidia is famous for think of an army of thousands of line cooks all chopping at the same time unlike our head chef working sequentially our line cooks work in parallel GPUs were originally built to color in every pixel of a video game screen at once until people like Jensen Huang realized that they could just run a bunch of AI math in parallel instead the third type is an application specific integrated circuit an ASIC or XPU a chip that does exactly one thing perfectly in our kitchen it's a gadget like a waffle iron big guys like Google each have their own each of them slightly different designed to avoid paying a fortune to Nvidia these chips do AI math and nothing else you can't buy one you can only rent time on it pair your CPU with an army of GPUs or ASICs and you get a trained AI model hyperscalers like Meta and Microsoft acquire millions of chips and wire them together in one giant AI kitchen a data center plug in an energy source and inside CPUs are directing teams of GPUs or ASICs add some memory and network and now your warehouse is working like a giant brain the byproduct of all that work is heat and the dish that lands on your plate it's the answer you get when you ask Claude or chat GPT a question follow for part two going inside these data centers to see why energy heat and supply chains are keeping Elon Musk up at night