How Much Does An AI Datacenter Cost

00:00 gigawatt datacenter 00:01 is about $50 billion 00:02 of investment 00:03 roughly between 00:04 the chips, the land, powershell 00:05 it's about $50 billion per gigawatt 00:06 roughly between 00:07 the chips, the land, powershell 00:08 it's about $50 billion per gigawatt 00:09 it's about $50 billion per gigawatt 00:10 per gigawatt. 00:11 And you have 00:12 you know, Open AI 00:13 and I think that's right 00:14 they're 00:15 talking about 00:16 scaling to 10 gigawatt 00:17 data centers. 00:18 That's a $500 billion investment 00:19 that's a $500 billion investment 00:20 I think that's right 00:21 per data center 00:22 if it gets that big. 00:23 To be clear, 00:24 they're still working on the 1 gigawatt data centers 00:25 from there 00:26 from there 00:27 2 or 3 gigawatts 00:28 next year 00:29 and then from there 00:30 probably to 5 00:31 over the next couple of years. 00:32 So you could get to a 10 gigawatt 00:33 in 00:34 I don't know, 00:35 probably 5 years, something like that. 00:36 When I think about Nvidia's market, 00:37 the big question to me 00:38 is I so 00:39 I would bet the over on demand 00:40 because 00:41 that 00:42 to underwrite demand 00:43 for applications 00:44 that don't exist yet. 00:45 But I'm confident 00:46 I think everyone understands that 00:47 Nvidia has by far 00:48 the best training chips 00:49 but 00:50 there's a lot of 00:51 including 00:52 your company Groq 00:53 and there's Cerebras 00:54 and 00:55 obviously AMD wants to compete 00:56 and then 00:57 obviously Huawei is 00:58 is kind of a wild card there. 00:59 We can talk about that. 01:00 And then 01:01 obviously AMD wants to compete 01:02 and then 01:03 obviously Huawei is 01:04 is kind of a wild card there. 01:05 We can talk about that. 01:06 I should mention 01:07 all the 01:08 A6 01:09 that the big AI companies are made up 01:10 Yeah 01:11 using Broadcom IP 01:12 you've got the 01:13 Google TPUs and 01:14 you mentioned training 01:15 which is Amazon's chip 01:16 and I think OpenAI 01:17 wants to develop their own 01:18 chip. 01:19 So I think the question is 01:20 given that 01:21 inference will be 99% of the market 01:22 and training is only 1% 01:23 could Nvidia be in a situation 01:24 where they've got 01:25 training locked up 01:26 but when it comes to inference 01:27 there's just a lot of other alternatives 01:28 because people will develop 01:29 I'm not saying 01:30 that's gonna happen. 01:31 That would be the big question. 01:32 To me, that would be the big question.