Transcribing Audio

{
  "metadata": {
    "language": null,
    "content": null,
    "topics": null,
    "duration": 18375.22
  },
  "segments": [
    {
      "start_time": 0,
      "end_time": 20.83,
      "content": " The following is a conversation with Dylan Patel and Nathan Lampert. Dylan runs semi-analysis, a well-respected research and analysis company that specializes in semiconductors, GPUs, CPUs, and AI hardware in general. Nathan is a research scientist at the Allen Institute for AI,"
    },
    {
      "start_time": 20.83,
      "end_time": 47.04,
      "content": " and is the author of the amazing blog on AI called Interconnects. They are both highly respected, read, and listened to by the experts, researchers, and engineers in the field of AI. And personally, I'm just a fan of the two of them. So I use the deep seek moment that shook the AI world a bit as an opportunity to sit down with them and lay it all"
    },
    {
      "start_time": 47.04,
      "end_time": 70.17,
      "content": " out from DeepSeek, Open AI, Google XAI, Metanthropic to Nvidia and DSMC, and to US-Ch., China, Taiwan relations, and everything else that is happening at the cutting edge of AI. This conversation is a deep dive into many critical aspects of the AI industry. While it does get super technical,"
    },
    {
      "start_time": 70.75,
      "end_time": 91.67,
      "content": " we try to make sure that it's still accessible to folks outside of the AI field by defining terms, stating important concepts explicitly, spelling out acronyms, and in general, always moving across the several layers of abstraction and levels of detail. There is a lot of hype in the media about what AI is and isn't."
    },
    {
      "start_time": 92.53,
      "end_time": 113.23,
      "content": " The purpose of this podcast, in part, is to cut through the hype, through the bullshit, and the low-resolution analysis, and to discuss in detail how stuff works and what the implications are. Let me also, if I may, comment on the new OpenA.O3 mini reasoning model, the release of which we were"
    },
    {
      "start_time": 113.23,
      "end_time": 134.71,
      "content": " anticipating during the conversation, and it did indeed come out right after. Its capabilities and costs are on par with our expectations, as we stated. OpenAI 03 Mini is indeed a great model, but it should be stated that Deep Seekar 1 has similar performance on benchmarks. It's still cheaper and it"
    },
    {
      "start_time": 134.71,
      "end_time": 161.17,
      "content": " reveals its chain of thought reasoning, which O3Mini does not. It only shows a summary of the reasoning. Plus R1 is open weight. And O3 Mini is not. By the way, I got a chance to play with 03 Mini. And anecdotal vibe check-wise, I felt that 03 Mini, specifically O3 Mini High, is better than R1."
    },
    {
      "start_time": 161.96,
      "end_time": 182.44,
      "content": " Still, for me personally, I find that Claude Sonna 3-5 is the best model for programming, except for tricky cases where I will use O1 Pro to brainstorm. Either way, many more better AI models will come, including reasoning models, both from American and Chinese companies. They will continue to shift the cost curve."
    },
    {
      "start_time": 183.42,
      "end_time": 205.54,
      "content": " But the quote, deep seek moment is indeed real. I think it will still be remembered five years from now as a pivotal event in tech history, due in part to the geopolitical implications, but for other reasons too, as we discuss in detail from many perspectives in this conversation. This is the Lex Friedman podcast. To support it, please check out"
    },
    {
      "start_time": 205.54,
      "end_time": 227.12,
      "content": " our sponsors in the description. And now, dear friends, here's Dylan Patel and Nathan Lambert. A lot of people are curious to understand China's deep seek AI models. So let's lay it out. Nathan, can you describe what deep seek V3 and deep seek r1r how they work how they're trained let's look at the big picture"
    },
    {
      "start_time": 227.12,
      "end_time": 249.79,
      "content": " and then we'll zoom in on the details. Yeah, so DeepSeek v3 is a new mixture of experts transformer language model from Deepseek, who is based in China. They have some new specifics in the model that we'll get into. Largely, this is a open weight model, and it's a instruction model like what you would use in chat GPT."
    },
    {
      "start_time": 250.83,
      "end_time": 270.39,
      "content": " They also release what is called the base model, which is before these techniques of post-training. Most people use instruction models today, and those are what served in all sorts of applications. This was released on, I believe, December 26th or that week. And then weeks later on January 20th,"
    },
    {
      "start_time": 270.39,
      "end_time": 293.66,
      "content": " DeepSeek released DeepSeek R1, which is a reasoning model, which really accelerated a lot of this discussion. This reasoning model has a lot of overlapping training steps to deep seek v3. And it's confusing that you have a base model called V3, that you do something to get a chat model, and then you do some different things to get a reasoning model."
    },
    {
      "start_time": 293.66,
      "end_time": 314.76,
      "content": " I think a lot of the AI industry is going through this challenge of communications right now, where Open AI makes fun of their own naming schemes. They have GPT40. They have GPT4O. They have OpenAI01. And there's a lot of types of models. So we're going to break down what each of them are. There's a lot of technical specifics on training and go through them high level to specific and kind of go through each of them."
    },
    {
      "start_time": 314.76,
      "end_time": 346,
      "content": " There's so many places we can go here, but maybe let's go to open weights first. What does it mean for model to be open weights, and what are the different flavors of open source in general? Yeah, so this discussion has been going on for a long time in AI. It became more important since ChatG chat GPT or more focal since chat to BT at the end of 2022. Open weights is the accepted term for when model weights of a language model are available on the internet for people to download. Those weights can have different licenses, which is effectively the terms by which you can use the model."
    },
    {
      "start_time": 346,
      "end_time": 371.66,
      "content": " There are licenses that come from history and open source software. There are licenses that are designed by companies specifically. All of Lama, Deepseek, Kwan, Mistral, these popular names in open weight models have some of their own licenses. It's complicated because not all the same models have the same terms. The big debate is on what makes a model open weight."
    },
    {
      "start_time": 371.66,
      "end_time": 391.94,
      "content": " It's like, why are we saying this term? It's kind of a mouthful. It sounds close to open source, but it's not of a mouthful it sounds close to open source but it's not the same there's still a lot of debate on the definition and soul of open source AI. Open source software has a rich history on freedom to modify, freedom to take on your own, freedom for many restrictions on how you would use the software and what"
    },
    {
      "start_time": 391.94,
      "end_time": 416.79,
      "content": " that means for AI is still being defined. So for what I do, I work at the Allen Institute for AI. We're a nonprofit. We want to make AI open for everybody, and we try to lead on what we think is truly open source. There's not full agreement in the community, but for us, that means releasing the training data, releasing the training code, and then also having open weights like this. And we'll get into the details of the models"
    },
    {
      "start_time": 416.79,
      "end_time": 443.92,
      "content": " and again and again as we try to get deeper into how the models were trained, we will say things like the data processing, data filtering, data quality is the number one determinant of the model quality, and then a lot of the training code is the determinant on how long it takes to train and how faster experimentation is. So without fully open source models where you have access to this data, it is hard to know, or it's harder to replicate."
    },
    {
      "start_time": 443.92,
      "end_time": 466.18,
      "content": " So we'll get into cost numbers for deep seek v3 on mostly GPU hours and how much you could pay to rent those yourselves, but without the data, the replication cost is going to be far, far higher. And same goes for the code. We should also say that this is probably one of the more open models out of the frontier models. So like in this full spectrum"
    },
    {
      "start_time": 466.18,
      "end_time": 487.12,
      "content": " where probably the fullest open source, like you said, open source, like you said, open code, open data, open weights. This is not open code. This is probably not open data. And this is open weights and the licensing is MIT license or it's I mean there's"
    },
    {
      "start_time": 487.12,
      "end_time": 509.66,
      "content": " some nuance in the different models, but it's towards the free, in terms of the open source movement, these are the kind of the good guys. Yeah, Deepseek is doing fantastic work for disseminating understanding of AI. Their papers are extremely detailed in what they do. And for other teams around the world, they're very actionable in terms of improving your own training techniques."
    },
    {
      "start_time": 509.66,
      "end_time": 537.27,
      "content": " And we'll talk about licenses more. The DeepSeek R1 model has a very permissive license. It's called the MIT license. That effectively means there's no downstream restrictions on commercial use. There's no use case restrictions. You can use the outputs from the models to create synthetic data. And this is all fantastic. I think the closest peer is something like Lama, where you have the weights and you have a technical report and the technical report"
    },
    {
      "start_time": 537.27,
      "end_time": 557.45,
      "content": " is very good for Lama. One of the most read PDFs of the year last year is the Lama 3 paper, but in some ways it's slightly less actionable. It has less details on the training specifics, less plots, and so on. And the Lama 3 license is more restrictive than MIT. And then between the Deep Sea custom license and the llama license. We could get into this whole rabbit hole."
    },
    {
      "start_time": 557.45,
      "end_time": 582.5,
      "content": " I think we'll make sure we want to go down the license rabbit hole before we do specifics. Yeah, and I mean, so it should be stated that one of the implications that Deep Seek puts pressure on Lama and everybody else on Open AI to push towards open source. And that's the other side of open source that you mentioned is how much is published in detail about it. So how open are you with the sort of the insights behind the code."
    },
    {
      "start_time": 582.92,
      "end_time": 603.38,
      "content": " So, like, how good is the technical reports? Are they hand wavy, or is there actual details in there? And that's one of the things that DeepSeek did well is they published a lot of the details. Yeah, especially in the DeepSeek V3, which is their pre-training paper, they were very clear that they are doing interventions on the technical stack that go at many different levels."
    },
    {
      "start_time": 603.56,
      "end_time": 625,
      "content": " For example, to get highly efficient training, they're making modifications at or below the Kuda layer for Nvidia chips. I have never worked there myself and there are a few people in the world that do that very well and some of them are at deep seek and these types of people are at deep seek and leading American frontier labs, but there are not many places."
    },
    {
      "start_time": 625,
      "end_time": 647.42,
      "content": " To help people understand the other implication of open weights. Just, you know, there's a topic will return to often here. So there's a fear that China, the nation, might have interest in stealing American data, violating privacy of American citizens. What can we say about open weights"
    },
    {
      "start_time": 647.42,
      "end_time": 669.36,
      "content": " to help us understand what the weights are able to do in terms of stealing people's data. Yeah. So these weights that you can download from Hugging Face or other platforms are very big matrices of numbers. You can download them to a computer in your own house that has no internet, and you can run this model and you're totally control of your data."
    },
    {
      "start_time": 669.36,
      "end_time": 692.34,
      "content": " That is something that is different than how a lot of language model usage is actually done today, which is mostly through APIs, where you send your prompt to GPUs run by certain companies. And these companies will have different distributions and policies on how your data is stored, if it is used to train future models, where it is stored, if it is encrypted, and so on. So the open weights are you have your fate of data in your own hands and"
    },
    {
      "start_time": 692.34,
      "end_time": 712.76,
      "content": " that is something that is deeply connected to the soul of open source. So it's not the model that steals your data. It's Clover's hosting the model, which could be China, if you're using the deep seek app, or it could be perplexity. You're trusting them with your data or Open AI, you trust them with your data. And some of these are American companies,"
    },
    {
      "start_time": 712.76,
      "end_time": 738.37,
      "content": " some of these are Chinese companies, but the model itself is not doing the stealing. It's the host. All right. So back to the basics. What's the difference between DeepSeek V3 and DeepSeek R1? Can we try to like lay out the confusion potential? Yes. So for one, I have very understanding of many people being confused by these two model names. So I would say the best way to"
    },
    {
      "start_time": 738.37,
      "end_time": 759.55,
      "content": " think about this is that when training a language model, you have what is called pre-training, which is when you're predicting the large amounts of mostly internet text. You're trying to predict the next token. And what to know about these new deep seek models is that they do this internet large-scale pre-training wants to get what is called deep seek v3 base. This is a base model."
    },
    {
      "start_time": 760.15,
      "end_time": 780.21,
      "content": " It's just going to finish your sentences for you. It's going to be harder to work with than chatypT. And then what DeepSeek did is they've done two different post-training regimes to make the models have specific desirable behaviors. So what is the more normal model in terms of the last few years of AI, an instruct"
    },
    {
      "start_time": 780.21,
      "end_time": 803,
      "content": " model, a chat model, a quote-unquote aligned model, a help-pocket model, a chat model, a quote unquote aligned model, a helpful model. There are many ways to describe this is more standard post-training. So this is things like instruction tuning, reinforce learning from human feedback. We'll get into some of these words. And this is what they did to create the deep seek V3 model. This was the first model to be released and it is very high performance."
    },
    {
      "start_time": 803,
      "end_time": 824.99,
      "content": " It's competitive with GPD4, Lama 405B, so on. And then when this release was happening, we don't know their exact timeline or soon after. They were finishing the training of a different training process from the same next token prediction based model that I talked about, which is when this new reasoning training that people have heard about comes in"
    },
    {
      "start_time": 824.99,
      "end_time": 846.17,
      "content": " in order to create the model that is called DeepSeek R1. The R through this conversation is good for grounding for reasoning, and the name is also similar to Open AIs 01, which is the other reasoning model that people have heard about. And we'll have to break down the training for R1 in more detail because for one, we have a paper detailing it, but also it is a far newer set of"
    },
    {
      "start_time": 846.17,
      "end_time": 871.66,
      "content": " techniques for the AI community. So it's a much more rapidly evolving area of research. Maybe we should also say the big two categories of training of pre-training and post-training, these umbrella terms that people use. So what is pre-training and what is post-training? And what are the different flavors of things underneath post-training umbrella? Yeah, so pre-training, I'm using some of the same words that really get the message across"
    },
    {
      "start_time": 871.66,
      "end_time": 892.86,
      "content": " is you're doing what is called auto-regressive prediction to predict the next token in a series of documents. This is done over standard practice is trillions of tokens, So this is a ton of data that is mostly scraped from the web. And some of DeepSeaks earlier papers, they talk about their training data being distilled for math."
    },
    {
      "start_time": 892.86,
      "end_time": 917.57,
      "content": " I shouldn't use this word yet, but taken from Common Crawl, and that's a public access that anyone listening to this could go download data from the Common Crawl website. This is a crawler that is maintained publicly. Yes, other tech companies eventually shift to their own crawler, and DeepSeak likely has done this as well as most frontier labs do. But this sort of data is something that people can get started with and you're just predicting text in a series of documents."
    },
    {
      "start_time": 918.29,
      "end_time": 944.99,
      "content": " This can be scaled to be very efficient. And there's a lot of numbers that are thrown around in AI training, like how many floating point operations or flops are used and then you can also look at how many hours of these GPUs that are used. And it's largely one loss function taken to a very large amount of compute usage. You set up relay efficient systems."
    },
    {
      "start_time": 944.99,
      "end_time": 965.99,
      "content": " And then at the end of that, you have this base model, and pre-training is where there is a lot more of complexity in terms of how the process is emerging or evolving and the different types of training losses that you will use. I think this is a lot of techniques grounded in the natural language processing literature."
    },
    {
      "start_time": 965.99,
      "end_time": 987.43,
      "content": " The oldest technique, which is still used today, is something called instruction tuning or also known as supervised fine tuning. These acronyms will be IFT or SFFT that people really go back and forth throughout them and I will probably do the same, which is where you add this formatting to the model where it knows to take a question that is like, explain"
    },
    {
      "start_time": 987.43,
      "end_time": 1012.48,
      "content": " the history of the Roman Empire to me. And or something you'll sort of question you'll see on Reddit or Stack Overflow, and then the model will respond in a information dense but presentable manner. The core of that formatting is in this instruction tuning phase. And then there's two other categories of loss functions that are being used today. One I will classify as preference fine tuning. Preference fine tuning is a generalized term for"
    },
    {
      "start_time": 1012.48,
      "end_time": 1033.66,
      "content": " what came out of reinforcement learning from human feedback, which is RLHF. This reinforcement learning from human feedback is credited as the technique that helped chat GPT break through. It is a technique to make the responses that are nicely formatted like these Reddit answers more in tune with what a human would like to read."
    },
    {
      "start_time": 1033.66,
      "end_time": 1054.92,
      "content": " This is done by collecting Paralyzed preferences from actual humans out in the world to start, and now AIs are also labeling this data and we'll get into those tradeoffs. And you have this kind of contrastive loss function between a good answer and a bad answer. And the model learns to pick up these trends. There's different implementation ways. You have things called reward models."
    },
    {
      "start_time": 1055.07,
      "end_time": 1079.25,
      "content": " You could have direct alignment algorithms. There's a lot of really specific things you can do, but all of this is about fineuning to human preferences. And the final stage is much newer and we'll link to what is done in R1 and these reasoning models is, I think OpenAI's name for this. They had this new API in the fall, which they called the reinforcement fine-tuning API. This is the idea that you use the techniques"
    },
    {
      "start_time": 1079.25,
      "end_time": 1099.33,
      "content": " of reinforcement learning, which is a whole framework of AI. There's a deep literature here. To summarize, it's often known as trial and error learning, or the subfield of AI where you're trying to make sequential decisions in a certain potentially unpotentially noisy environment. There's a lot of ways we could go down that. But fine-tuning"
    },
    {
      "start_time": 1099.33,
      "end_time": 1122.21,
      "content": " language models where they can generate an answer and then you check to see if the answer matches the true solution. For math or code, you have an exactly correct answer for math. You can have unit tests for code. And what we're doing is we are checking the language models work, and we're giving it multiple opportunities on the same questions to see if it is right. And if you keep doing this, the models can learn to improve in verifiable domains"
    },
    {
      "start_time": 1122.21,
      "end_time": 1145.71,
      "content": " to a great extent. It works really well. It's a newer technique in the academic literature. It's been used at Frontier labs in the U.S. that don't share every detail for multiple years. So this is the idea of using reinforcement learning with language models, and it has been taking off, especially in this deep seek moment. And we should say that there's a lot of exciting stuff going on on the, again, across the stack,"
    },
    {
      "start_time": 1145.79,
      "end_time": 1165.81,
      "content": " but the post-training probably this year's going to be a lot of interesting developments in the post-training. We'll talk about it. I almost forgot to talk about the difference between DeepSeek V3 and r1 on the user experience side so forget the technical stuff forget all that just people that don't know anything about AI, they show up. Like, what's the actual experience?"
    },
    {
      "start_time": 1165.97,
      "end_time": 1186.67,
      "content": " What's the use case for each one when they actually like type and talk to it what is each good at and that kind of thing so let's start with deep seek v3 again it's what more people would have tried something like it. You ask it a question. It'll start generating tokens very fast, and those tokens will look like a very human legible answer. It'll be some sort of markdown list."
    },
    {
      "start_time": 1186.87,
      "end_time": 1206.99,
      "content": " It might have formatting to help you draw to the core details in the answer, and it'll generate tens to hundreds of tokens. A token is normally a It tends to hundreds of tokens. A token is normally a word for common words or a subword part in a longer word. And it'll look like a very high quality Reddit or Stack Overflow answer."
    },
    {
      "start_time": 1206.99,
      "end_time": 1227.47,
      "content": " These models are really getting good at doing these across a wide variety of domains. Even things that if you're an expert, things that are close to the fringe of knowledge, they will still be fairly good at. Cutting edge AI topics that I do research on, these models are capable for study aid and they're regularly updated."
    },
    {
      "start_time": 1228.66,
      "end_time": 1248.66,
      "content": " Where this changes is with the DeepSeek R1, what is called these reasoning models, is when you see tokens coming from these models to start, it will be a large chain of thought process. We'll get back to chain of thought in a second, which looks like a lot of tokens where the model is explaining the problem. The model will often break down the problem and be like,"
    },
    {
      "start_time": 1248.66,
      "end_time": 1271.28,
      "content": " okay, they ask me for this. Let's break down the problem. I'm going to need to do this. And you'll see all of this generating from the model. It'll come very fast in most user experiences. These APIs are very fast, so you'll see a lot of tokens. A lot of words show up really fast. It'll keep flowing on the screen, and this is all the reasoning process, and then eventually the model will change its tone in R1 and it'll write the answer, where it summarizes its"
    },
    {
      "start_time": 1271.28,
      "end_time": 1293.66,
      "content": " reasoning process and writes a similar answer to the first types of model. But in DeepSeek's case, which is part of why this was so popular, even outside the AI community is that you can see how the language model is breaking down problems. And then you get this answer on a technical side. They train the model to do this specifically, where they have a section, which is reasoning,"
    },
    {
      "start_time": 1293.66,
      "end_time": 1316.01,
      "content": " and then it generates a special token, which is probably hidden from the user most of the time, which says, okay, I'm starting to answer. So the model is trained to do this two-stage process on its own. If you use a similar model in, say, OpenAI's user interface is trying to summarize this process for you nicely by kind of showing the sections that the model is doing, and it'll kind of click through."
    },
    {
      "start_time": 1316.01,
      "end_time": 1340.52,
      "content": " It'll say breaking down the problem, making X calculation, cleaning the result, and then the answer will come for something like Open AI. Maybe it's useful here to go through like an example of a deep seek R1 reasoning. Yeah, so if you're looking at the screen here, what you'll see is a screenshot of the deep seek chat app and at the top is thought for 151 7 seconds with the drop down arrow"
    },
    {
      "start_time": 1340.52,
      "end_time": 1364.71,
      "content": " underneath that if we were in an app that we were running, the drop-down arrow would have the reasoning. So in this case, the specific question, which, you know, I'm philosophically slash pothead inclined. So this is asking deep, deep see car one for one truly novel insight about humans. And it reveals the reasoning and basically the truly novel aspect"
    },
    {
      "start_time": 1364.71,
      "end_time": 1386.13,
      "content": " is what's pushing the reasoning to constantly sort of the model asking itself is this truly novel. So it's actually challenging itself to be more novel, more counterintuitive, more less cringe, I suppose. So some of the reasoning says, this is just snapshots. Alternatively, humans have a unique meta-emotion where they feel emotions about their own emotions,"
    },
    {
      "start_time": 1386.13,
      "end_time": 1406.39,
      "content": " e.g. feeling guilty about being angry. This, of course, of emotional layering creates complex motivational drives that don't exist in other animals. The insight is that human emotions are nested. So it's like, it's reasoning through how humans feel emotions. It's reasoning about meta emotions. You're gonna have pages and pages of this. It's almost too much to actually read, but it's nice to skim as it's coming."
    },
    {
      "start_time": 1406.39,
      "end_time": 1428.09,
      "content": " It's a stream of con- it's a James Joyce like stream of consciousness. And then it goes, wait, the user wants something that's not seen anywhere else. Let me dig deeper. And consider the human ability to hold contradictory beliefs simultaneously. Cognitive dissonance is known, but perhaps the function is to allow flexible adaptation, so on and so forth. I mean, that"
    },
    {
      "start_time": 1428.09,
      "end_time": 1454.26,
      "content": " really captures the public imagination that holy shit, this isn't, I mean, intelligence slash almost like an inkling of sentience, because like you're thinking through yourself reflecting, you're deliberating. And the final result of that after 157 seconds is humans instinctively converts selfish desires into cooperative systems by collectively"
    },
    {
      "start_time": 1454.26,
      "end_time": 1484.97,
      "content": " pretending abstract rules, money, laws, rights, are real. These shared hallucinations act as, quote, games, competition is secretly redirected to benefit the group, turning conflict into society's fuel. Pretty profound. I mean, you know. There's a potential digression, but a lot of people have found that these reasoning models can sometimes produce much more eloquent text. That is a, at least interesting example, I think, depending on how open-minded you are,"
    },
    {
      "start_time": 1484.97,
      "end_time": 1506.21,
      "content": " you find language models interesting or not, and there's a spectrum there. Well, I mean, some of the, we'll talk about different benchmarks and songs, but some is just a vibe. Like that in itself is a, let's say, quote, fire tweet. Yeah. If I, if I, if I, I, I'm trying to produce something, something that were people like, oh shit. Okay, so that's Chanathaw. We'll probably return to it more."
    },
    {
      "start_time": 1507.61,
      "end_time": 1527.29,
      "content": " How were they able to achieve such low cost on the training and the inference? Maybe you could talk the training first. Yeah. So there's two main techniques that they implemented that are probably the majority of their efficiency. And then there's a lot of implementation details that maybe we'll gloss over or get into later"
    },
    {
      "start_time": 1527.29,
      "end_time": 1551.66,
      "content": " that sort of contribute to it. But those two main things are, one is they went to a mixture of experts model, which we'll define in a second. And then the other thing is that they invented this new technique called MLA, latent attention. Both of these are big deals. A mixture of experts is something that's been in the literature for a handful of years. And Open AI with GPT4 was the first one to productize a mixture of experts model."
    },
    {
      "start_time": 1551.66,
      "end_time": 1573.7,
      "content": " And what this means is when you look at the common models around that most people have been able to interact with that are open, think Lama. Lama is a dense model, i.e. every single parameter or neuron is activated as you're going through the model for every single token you generate. Right. Now, with a mixture of experts model, you don't do that, right?"
    },
    {
      "start_time": 1573.7,
      "end_time": 1594.92,
      "content": " How does the human actually work right? It's like, oh, well, my visual cortex is active when I'm thinking about, you know, vision tasks and like, you know, other things, right? My amygdala is when I'm scared, right? These different aspects of your brain are focused on different things. A mixture of experts' model attempts to approximate this to some extent. It's nowhere close to what a brain architecture is, but different portions of the model activate."
    },
    {
      "start_time": 1605.47,
      "end_time": 1616.36,
      "content": " You'll have a set number of experts in the model and a set number that are activated each time, and this dramatically reduces both your training and inference costs. Because now you're, you know, if you think about the parameter count as the sort of total embedding space for all of this knowledge that you're compressing down during training. When you're embedding this data in,"
    },
    {
      "start_time": 1616.36,
      "end_time": 1638.84,
      "content": " instead of having to activate every single parameter, every single time you're training or running inference, now you can just activate a subset. And the model will learn which expert to route to for different tasks. And so this is a humongous innovation in terms of, hey, I can continue to grow the total embedding space of parameters. And so deep-seek's model is, you know, 600-something billion parameters, right? Relative to"
    },
    {
      "start_time": 1638.84,
      "end_time": 1663.53,
      "content": " Lama 405B, it's four or five billion parameters, right? Lama to Lama, relative to Lama 70B, it's 70 billion parameters, right? So this model technically has more embedding space for information, right, to compress all of the world's knowledge that's on the internet down, but at the same time, it is only activating around 37 billion of the parameters. So only 37 billion of these parameters actually need to be computed every single time you're training data or inferencing data out of it."
    },
    {
      "start_time": 1664.03,
      "end_time": 1686.49,
      "content": " And so versus, versus again, a Lama model, 70 billion parameters must be activated or 405 billion parameters must be activated. So you've dramatically reduced your compute cost when you're doing training and inference with this mixture of experts architecture. So we break down where it actually applies and go into the transformer. Is that useful? Let's go. Let's go into the transformer. So the transformer is a thing that is talked about a lot,"
    },
    {
      "start_time": 1686.49,
      "end_time": 1713.8,
      "content": " and we will not cover every detail. Essentially, the transformer is built on repeated blocks of this attention mechanism, and then a traditional dense, fully connected, multi-layer perceptron, whatever word you want to use for your normal neural network and you alternate these blocks, there's other details, and where a mixture of experts is applied is that this dense model. The dense model holds most of the weights if you count them in a transformer model."
    },
    {
      "start_time": 1713.8,
      "end_time": 1734.5,
      "content": " So you can get really big gains from those mixture of experts on parameter efficiency at training and inference because you get this efficiency by not activating all of these parameters. We should also say that a transformer is a giant neural network. Yeah. And then there's four is a giant neural network. Yeah. And then there's for 15 years now, there's what's called the Deep Learning Revolution."
    },
    {
      "start_time": 1737.12,
      "end_time": 1755.98,
      "content": " Network's gotten larger and larger in a certain point. The scaling laws appeared where people realized... This is a scaling law shirt, by the way. Representing scaling laws, where it became more and more formalized that bigger is better across multiple dimensions of what bigger means so and but these are all sort of neural networks we're talking about,"
    },
    {
      "start_time": 1756.42,
      "end_time": 1776.32,
      "content": " and we're talking about different architectures to construct these neural networks such that the training and the inference on them is super efficient. Yeah. Every different type of model has a different scaling law for it, which is effectively for how much compute you put in, the architecture will get to different levels of performance at test tasks."
    },
    {
      "start_time": 1776.32,
      "end_time": 1797.48,
      "content": " And mixture of experts is one of the ones at training time, even if you don't consider the inference benefits, which are also big. At training time, your efficiency with your GPUs is dramatically improved by using this architecture if it is well implemented. So you can get effectively the same performance model and evaluation scores with numbers like 30% less compute."
    },
    {
      "start_time": 1800.58,
      "end_time": 1825.35,
      "content": " I think there's going to be a wide variation depending on your implementation details and stuff. But it is just important to realize that this type of technical innovation is something that gives huge gains. And I expect most companies that are serving their models to move to this mixture of experts implementation. Historically, the reason why not everyone might do it is because it's an implementation complexity, especially when doing these big models. So this is one of the things that Deep Seek gets credit for is they do this extremely"
    },
    {
      "start_time": 1825.35,
      "end_time": 1853.16,
      "content": " well. They do mixture of experts extremely well. This architecture for what is called deep seek MOE, MOE is the shortened version of mixture of experts, is multiple papers old. This part of their training infrastructure is not new to these models. Alone, and same goes for what Dylan mentioned with multi-head latent attention. It's all about reducing memory usage during inference and same things during training by using some fancy low-rank approximation math."
    },
    {
      "start_time": 1853.16,
      "end_time": 1878.44,
      "content": " If you get into the details with this latent attention, it's one of those things I look at. It's like, OK, they're doing really complex implementations, because there's other parts of language models such as embeddings that are used to extend the context length. The common one that DeepSeek used is rotary, positional, and penings, which is called rope. And if you want to use rope with a normal MOE. It's kind of a sequential thing. You take these, you take two of the"
    },
    {
      "start_time": 1878.44,
      "end_time": 1903.49,
      "content": " attention matrices and you rotate them by a complex value rotation, which is a matrix multiplication. With deep seek's MLA, with this new attention architecture, they need to do some clever things because they're not set up the same and it just makes the implementation complexity much higher. So they're managing all of these things. And these are probably the sort of things that Open AI, these closed labs are doing. We don't know if they're doing the exact same techniques, but they actually shared them"
    },
    {
      "start_time": 1903.49,
      "end_time": 1924.99,
      "content": " with the world, which is really nice to feel like this is the cutting edge of efficient language model training. And some of this requires low-level engineering. Just is a giant mess and trickery. So as I understand, that went below Kuda. So they go super low programming of GPUs. Effectively, Nvidia builds this library called nickel, right?"
    },
    {
      "start_time": 1924.99,
      "end_time": 1945.63,
      "content": " In which, you know, when you're training a model, you have all these communications between every single layer of the model, and you may have over 100 layers. What does the nickel stand for? It's NCCL. Invidia Communications Collective's Library. Nice. And so when you're training a model, right, you're training a model right you're going to have all these all reduces and all gathers right"
    },
    {
      "start_time": 1945.63,
      "end_time": 1967.43,
      "content": " between each layer between the multi-lier perceptron or feed forward network and the attention mechanism, you'll have, you'll have basically the model synchronize, right? Or you'll have all the, you'll have all reducer and all gather. And this is a communication between all the GPUs in the network, whether it's in training or inference. So, Nvidia has a standard library. This is one of the reasons why it's really difficult to use"
    },
    {
      "start_time": 1967.43,
      "end_time": 1990.67,
      "content": " anyone else's hardware for training is because no one's really built a standard communications library. And in Nvidia's done this at a sort of a higher level, right? A deep seek because they have certain limitations around the GPUs that they have access to, the interconnects are limited to some extent by the restrictions of the GPUs that were shipped into China legally, not the ones that are smuggled, but legally shipped in that they used to train this"
    },
    {
      "start_time": 1990.67,
      "end_time": 2010.73,
      "content": " model, they had to figure out how to get efficiencies, right? And one of those things is that instead of just calling the Nvidia library nickel, right? They instead created their their they scheduled their own communications which which the last some of the labs do right um emetta talked about in Lama 3 how they made their own custom version of nickel."
    },
    {
      "start_time": 2011.19,
      "end_time": 2032.57,
      "content": " They didn't talk about the implementation details. This is some of what they did. Probably not as well as, maybe not as well as DeepSeek, because Deep Seek, you know, necessity is the mother of innovation. And they had to do this. Whereas in the case, you know, open AI has people that do this sort of stuff, anthropic, et cetera. But, you know, DeepSeek certainly did it publicly, and they may have done it even better because they were"
    },
    {
      "start_time": 2032.57,
      "end_time": 2055.74,
      "content": " gimped on a certain aspect of the chips that they have access to. And so they scheduled communications, you know, by scheduling specific SMs, SMs you could think of as like the core on a GPU, right? So there's hundreds of cores, or there's, you know, a bit over 100 cores, SMs on a GPU, and they were specifically scheduling, hey, which ones are running the model, which ones are doing all reduce,"
    },
    {
      "start_time": 2055.82,
      "end_time": 2075.8,
      "content": " which one are doing all gather, right? And they would flip back and forth between them, and this requires extremely low- level programming. This is what Nickel does automatically, or other Nvidia libraries handle this automatically, usually. Yeah, exactly. And so technically they're using, you know, PtX, which is like sort of like, you could think of it as like an assembly type language. It's not exactly that or instruction set, right?"
    },
    {
      "start_time": 2075.86,
      "end_time": 2098.2,
      "content": " Like coding directly to assembly or instruction set. It's not exactly that, but that's still part of technically CUDA, but it's like, do I want to write in Python, you know, PiTorch equivalent and call Invidia libraries, do you want to go down to the C level, right? Or you know, encode even lower level or do I want to go all the way down to the assembly or ISO level? And there are cases where you go all the way down there at the very big labs, but most companies"
    },
    {
      "start_time": 2098.2,
      "end_time": 2118.66,
      "content": " just do not do that, right? Because it's a waste of time and the efficiency gains you get are not worth it. But deep seek's implementation is so complex, right? Especially with their mixture of experts, right? People have done mixture of experts, but they're generally 8, 16 experts, right? And they activate too. So, you know, one of the words, like, you like to use as like sparsity factor, right,"
    },
    {
      "start_time": 2118.66,
      "end_time": 2139.36,
      "content": " or usage, right? So you might have four, you know, one fourth of your model, activate, right? And that's what mistral's mixtral model, right? Their model that really catapulted them to like oh my god they're really really good um open ai has also had models that are MOE and and so have all the other labs that are MOE, and so have all the other labs that are major closed. But what DeepSeek did that"
    },
    {
      "start_time": 2139.36,
      "end_time": 2159.68,
      "content": " maybe only the leading labs have only just started recently doing is have such a high sparsity factor, right? It's not one fourth of the model, right? Two out of eight experts activating every time you go through the model, it's eight out of 256. And there's different implementations for mixture of experts where you can have some of these experts that are always activated, which this just"
    },
    {
      "start_time": 2159.68,
      "end_time": 2181.48,
      "content": " looks like a small neural network and then all the tokens go through that and then they also go through some that are selected by this routing mechanism. And one of the innovations in DeepSeaks architecture is that they changed the routing mechanism in mixture of expert models. There's something called an auxiliary loss, which effectively means during training,"
    },
    {
      "start_time": 2181.48,
      "end_time": 2204.15,
      "content": " you want to make sure that all of these experts are used across the tasks that the model sees. Why there can be failures and mixture of experts is that when you're doing this training, the one objective is token prediction accuracy. And if you just let turning go with a mixture of expert model on your own, it can be that the model learns to only use a subset of the experts."
    },
    {
      "start_time": 2204.73,
      "end_time": 2224.99,
      "content": " And in the MOE literature, there's something called the auxiliary loss, which helps balance them. But if you think about the loss functions of deep learning, this even connects to the bitter lesson, is that you want to have the minimum inductive bias in your model to let the model learn maximally. And this auxiliary loss, this balancing across experts,"
    },
    {
      "start_time": 2224.99,
      "end_time": 2247.99,
      "content": " could be seen as intention with the prediction accuracy of the tokens. So we don't know the exact extent that the deep seek M-OE change, which is instead of doing an auxiliary loss, they have an extra parameter in their routing, which after the batches, they update this parameter to make sure that the next batches all have a similar use of experts. And this type of change can be big, it can be small, but they add up over time."
    },
    {
      "start_time": 2247.99,
      "end_time": 2269.65,
      "content": " And this is the sort of thing that just points small, but they add up over time. And this is the sort of thing that just points to them innovating. And I'm sure all the labs that are training big MEOs are looking at this sort of things, which is getting away from the auxiliary loss. Some of them might already use it. But you just keep you keep accumulating gains. And we'll talk about the philosophy of training and how you organize these organizations. And a lot of it is just compounding small improvements over time in your data,"
    },
    {
      "start_time": 2269.65,
      "end_time": 2291.85,
      "content": " in your architecture, and your post-training, and how they integrate with each other. DeepSeek does the same thing, and some of them are shared or a lot we have to take them on face value that they share their most important details i mean the architecture and the weights are out there, so we're seeing what they're doing. And it adds up. Going back to sort of the like efficiency and complexity point, right? It's 32 versus a four, right, for like Mixed"
    },
    {
      "start_time": 2291.85,
      "end_time": 2312.81,
      "content": " Strahl and other MOE models that have been publicly released. So this ratio is extremely high. And sort of what Nathan was getting at there was, when you have such a different level of sparsity, You can't just have every GPU have the entire model, right? The model's too big, there's too much complexity there. So you have to split up the model with different types of parallelism, right? And so you might have different experts"
    },
    {
      "start_time": 2312.81,
      "end_time": 2333.17,
      "content": " on different GPU nodes. But now what happens when this set of data that you get, all of it looks like this one way and all of it should route to one part of my model, right? So when all of it routes to one part of the model, then you can have this overloading of a certain set of the GPU resources"
    },
    {
      "start_time": 2333.17,
      "end_time": 2357.58,
      "content": " or a certain set of the GPUs, and then the rest of the training network sits idle because all of the tokens are just routing to that. So this is the biggest complexity, one of the big complexities with running a very, you know, sparse mixture of experts model, i.e., you know, this 32 ratio versus this four ratio is that you end up with so many of the experts just sitting there idle. So how do I load balance between them? How do I schedule the communications"
    },
    {
      "start_time": 2357.58,
      "end_time": 2379.08,
      "content": " between them? This is a lot of the like extremely low level detailed work that they figured out in the public first and potentially like second or third in the world and maybe even first in some cases. What lesson do you in the direction of the better lesson do you take from all of this? Where is this going to better lesson do you take from all of this? Is this going to be the direction where a lot of the gain is going to be,"
    },
    {
      "start_time": 2379.18,
      "end_time": 2400.32,
      "content": " which is this kind of low level optimization, or is this a short-term thing where the biggest gains will be more on the algorithmic high-level side of post-training. Is this like a short-term leap because they've figured out like a hack because constraints, necessities the mother of invention, or is there still a lot of gains?"
    },
    {
      "start_time": 2400.32,
      "end_time": 2424,
      "content": " I think we should summarize what the bitter lesson actually is about. Is that the bitter lesson, essentially, if you paraphrase it, is that the types of training that will win out in deep learning as we go are those methods that are which are scalable in learning and search is what it calls out. And this scale word gets a lot of attention in this."
    },
    {
      "start_time": 2424.62,
      "end_time": 2446.5,
      "content": " The interpretation that I use is effectively to avoid adding in the human priors to your learning process. And if you read the original essay, this is what it talks about, is how researchers will try to come up with clever solutions to their specific problem that might get them small gains in the short term while"
    },
    {
      "start_time": 2446.5,
      "end_time": 2477.02,
      "content": " simply enabling these deep learning systems to work efficiently and for these bigger problems in the long term might be more likely to scale and continue to drive success. And therefore, we were talking about relatively small implementation changes to the mixture of experts model. And therefore, it's like, okay, we will need a few more years to know if one of these are actually really crucial to the bitter lesson, but the bitter lesson is really this long-term arc of how simplicity can often win."
    },
    {
      "start_time": 2477.32,
      "end_time": 2499.38,
      "content": " And there's a lot of sayings in the industry, like the models just want to learn. You have to give them the simple lost landscape where you put compute through the model and they will learn and getting barriers out of the way. That's where the power, something like nickel comes in, where standardized code that could be used by a lot of people to create simple innovations that can scale,"
    },
    {
      "start_time": 2499.38,
      "end_time": 2523.52,
      "content": " which is why the hacks, I imagine that the code base for DeepSeek is probably a giant mess. I'm sure they have, DeepSeek definitely has code bases that are extremely messy where they're testing these new ideas. Multi-head latent attention. Probably could start in something like a Jupiter notebook or somebody tries something on a few GPUs and that is really messy. But the stuff that trains the deep seek V3 and deep seek R1,"
    },
    {
      "start_time": 2523.52,
      "end_time": 2545.82,
      "content": " those libraries, if you were to present them to us, I would guess are extremely high quality code. So high quality readable code. Yeah. I think there is one aspect to note though, right? Is that there is the general general ability for that to transfer across different types of runs right you? You may make really, really high quality code for one specific model"
    },
    {
      "start_time": 2545.82,
      "end_time": 2566.68,
      "content": " architecture at one size. And then that is not transferable to, hey, when I make this architecture tweak, everything's broken again, right? Like that's something that could be, you know, with their specific low level coding of like scheduling SMs is specific to this model architecture and size, right? And whereas like, Invidia's collectives library is more like,"
    },
    {
      "start_time": 2566.68,
      "end_time": 2586.74,
      "content": " hey, it'll work for anything, right? You want to do an all reduce? Great. I don't care what your model architecture is. It'll work. And you're giving up a lot of performance when you do that in many cases, but it's worthwhile for them to do the specific optimization for the specific run, given the constraints that they have regarding compute. I wonder how stressful it is to like,"
    },
    {
      "start_time": 2587.48,
      "end_time": 2607.98,
      "content": " you know, these frontier models, like initiate training, like to have the code to push the button that like you're now spending a large amount of money and time to train this like there must i mean there must be a lot of innovation on the debugging stage of like making sure there's no issues"
    },
    {
      "start_time": 2607.98,
      "end_time": 2631.05,
      "content": " that you're monitoring and visualizing every aspect of the training, all that kind of stuff. When people are training, they have all these various dashboards, but like the most simple one is your loss, right? And it continues to go down, but in reality, especially with more complicated stuff like M-O-E, the biggest problem with it, or FP8 training, which is another innovation, you know, going to a lower precision number format, i.e. less accurate, is that you end up"
    },
    {
      "start_time": 2631.05,
      "end_time": 2657.4,
      "content": " with lost bikes, right? And no one knows why the lost spike happened. And for a long of them, you do. Some of them are bad data. Can I give AI2's example of what blew up earlier models is a subreddit called Microwave Gang. We love to shout out the South. It's a real thing. You can pull up microwave gang. Essentially, it's a subreddit where everybody makes posts that are just the letter M so it's like mm so there's extremely long sequences of the letter M and then the comments are like beep beep because it's in the micro"
    },
    {
      "start_time": 2657.4,
      "end_time": 2678.38,
      "content": " events. But if you pass this into a model that's trained to be a normal producing text, it's extremely high loss. Because normally you see an M, you don't predict M's for a long time. So like this is something that caused a loss spikes for us. But when you have much like this is old, this is not recent, and when you have more mature data systems, that's not the thing that causes the loss. And when you have more mature data systems, that's not the thing that causes the loss spike. And what Dylan is saying is true."
    },
    {
      "start_time": 2678.38,
      "end_time": 2699.26,
      "content": " But it's like, it's levels to this sort of idea. With regards to the stress, right? These people are like, you know, you'll go out to dinner with like a friend that works at one of these labs. And they'll just be, like, looking at their phone every, like, 10 minutes. And they're not, like, you know, it's one thing if they're texting, but they're just like, like, is the loss? Yeah. Tocons per second."
    },
    {
      "start_time": 2700.56,
      "end_time": 2724.3,
      "content": " Lost not blown up. They're just walking just watching this. And the heart rate goes up if there's a spike. And some level of spikes is normal, right? It'll recover and be back. Sometimes a lot of the old strategy was like, you just stop the run, restart from the old version, and then like change the data mix, and then it keeps going there are even different types of spikes so dirk grenovel has a theory a day i do that's like fast spikes and slow spikes, where there are sometimes where you're"
    },
    {
      "start_time": 2724.3,
      "end_time": 2750.35,
      "content": " looking at the loss and there are other parameters, you can see it start to creep up and then blow up and that's really hard to recover from. So you have to go back much further. So you have the stressful period where it's like flat or might start going up and you're like, what do I do? Whereas there are also lost spikes that are, it looks good, and then there's one spiky data point. And what you could do is you just skip those. You see that there's a spike, You're like, okay, I can ignore this data, don't update the model, and do the next one, and it'll recover quickly. But these like untrickier implementations."
    },
    {
      "start_time": 2750.45,
      "end_time": 2776.08,
      "content": " So as you get more complex in your architecture and you scale up to more GPUs, you have more potential for your loss blowing up. So it's like, there's a distribution. The whole idea of grocking also comes in, right? It's like just because it slowed down from improving and loss doesn't mean it's not learning because all of a sudden it could be like this and they could just spike down and loss again because it learned truly learned something right and it took some time for it to learn that it's not like a gradual process, right?"
    },
    {
      "start_time": 2776.08,
      "end_time": 2798.32,
      "content": " And that's what humans are like, that's what models are like. So it's really a stressful task, as you mentioned. And the whole time the dollar count is going up. Every company has failed runs. You need failed runs to push the envelope on your infrastructure. So a lot of news cycles are made of X company had Y failed to run. Every company that's trying to push the frontier of AI has these."
    },
    {
      "start_time": 2798.32,
      "end_time": 2819.32,
      "content": " Yes, it's noteworthy because it's a lot of money and it can be week to month setback, but it is part of the process. But how do you get, if you're deep seek, how do you get to a place where, holy shit, there's a successful combination of hyperparameters? A lot of small failed runs. So rapid, failed runs. And so rapid iteration through failed runs until"
    },
    {
      "start_time": 2819.32,
      "end_time": 2844.72,
      "content": " and successful ones. And then you build a sum of intuition like this mixture of expert works and then this implementation of MLA works. Key hyperparameters, like learning rate and regulation and things like this. And you find the regime that works for your codebase. I've talking to people at Frontier Labs, there's a story that you can tell where training language models is kind of a path that you need to follow."
    },
    {
      "start_time": 2844.9,
      "end_time": 2866.38,
      "content": " So you need to unlock the ability to train a certain type of model or a certain scale. And then your code base and your internal know-how of which hyperparameters work for it is kind of known. And you look at the deep seek papers and models, they've scaled up, they've added complexity, and it's just continuing to build the capabilities that they have. There's the concept of a YOLO run. So YOLO you only live once."
    },
    {
      "start_time": 2866.38,
      "end_time": 2888.93,
      "content": " And what it is is like, you know, there's there's, there's all this experimentation you do at the small scale, right? Research ablations, right? Like you have your Jupyter notebook whether you're experimenting with mLA on like three GPUs or whatever um and you're doing all these different uh things like hey hey, do I do four expert, four active experts, 128 experts, do I arrange the experts this way? You know, all these different model architecture things,"
    },
    {
      "start_time": 2888.93,
      "end_time": 2911.21,
      "content": " you're testing at a very small scale, right? Couple researchers, few GPUs, tens of GPUs, hundreds of GPUs, whatever it is. And then all of a sudden, you're like, okay, guys, no more, no more fucking around, right? No more screen around. Everyone take all the resources we have, let's pick what we think will work and just go for it, right? YOLO. And this is where that sort of stress comes in is like, well, I know it works here, but some things that work"
    },
    {
      "start_time": 2911.21,
      "end_time": 2936.11,
      "content": " here don't work here and some things that work here don't work down here, right? In this terms of scale, right? So it's it's really truly a YOL run and and sort of like, there's this like discussion of like certain researchers just have like this methodical nature. Like they can find the whole search space and like figure out all the ablations of different research and really see what is best. And there's certain researchers who just kind of like, you know, have that innate gut instinct of like,"
    },
    {
      "start_time": 2936.11,
      "end_time": 2956.39,
      "content": " this is the Yolo run. Like, you know, looking at the data, I think this is it. This is why you want to work in post-training because the GPU costs for training is lower, so you can make a higher percentage of your training runs, Yolo runs. Yeah. For now. Yeah, for now. For now. Yeah, for now. For now. So some of this is fundamentally luck still. Luck is skill, right? In many cases."
    },
    {
      "start_time": 2956.71,
      "end_time": 2979.31,
      "content": " Yeah, I mean, it looks lucky, right? When you're... But the hill to climb, if you're out one of these labs, you have an evaluation, you're not crushing. There's a repeated playbook of how you improve things. There are localized improvements, which might be data improvements, and these add up into the whole model just being much better. And when you zoom in really closed, it can be really obvious that this model is just really bad at this thing and we can fix it and you just add these up."
    },
    {
      "start_time": 2979.31,
      "end_time": 2999.75,
      "content": " So some of it feels like look, but on the ground, especially with these new reasoning models we're talking to, is just so many ways that we can poke around. And normally normally it's that some of them give big improvements. The search space is near infinite, right? And yet the amount of compute in time you have is very low and you have to hit release schedules."
    },
    {
      "start_time": 2999.91,
      "end_time": 3021.78,
      "content": " You have to not get blown past by everyone. Otherwise, you know, what happened with deep seek, you know, crushing meta and mistral and coherent and all these guys, they moved too slow, right? They maybe were too methodical. I don't know, they didn't hit the Yolo run, whatever the reason was, maybe they weren't a skill. Whatever, you know, you can call it luck if you want, but at end of day, it's skill. So 2025 is the year of the YOLO run."
    },
    {
      "start_time": 3021.78,
      "end_time": 3051.33,
      "content": " It seems like all the labs are like going in. I think it's even more impressive what opening AI did in 2022, right? At the time, no one believed in mixture of experts models, right, at Google, who had all the researchers. Open AI had such little compute and they devoted all of their compute for many months, all of it, 100% for many months, all of it, 100% for many months to GPT4 with a brand new architecture with no belief that, hey, let me spend a couple hundred million dollars, which is all of the money I have"
    },
    {
      "start_time": 3051.33,
      "end_time": 3072.89,
      "content": " on this model, right? Now, now, you know, people are like, all these like training run failures that are in the media, right? It's like, okay, great, but like actually a lot, a huge chunk my GPs are doing inference. I still have a bunch doing research constantly. And yes, my biggest cluster is training, but like on this YOLO run, but like that YOLO run is much less risky than like"
    },
    {
      "start_time": 3072.89,
      "end_time": 3094.49,
      "content": " what opening I did in 2022. Or maybe what Deep Seek did now, or, you know, like, sort of like, hey, we're just going to throw everything at it. The big winners throughout human history are the ones who are willing to do yellow at some point. Okay. What do we understand about the hardware it's been trained on, deep seek? Deepseek is very interesting. This is second to take us to zoom out"
    },
    {
      "start_time": 3094.49,
      "end_time": 3115.93,
      "content": " out of who they are, first of all, right? High Flyer is a hedge fund that has historically done quantitative trading in China as well as elsewhere. And they have always had a significant number of GPUs, right? In the past, a lot of these high frequency trading algorithmic quant traders used FPGAs. But it shifted to GPUs definitely. And there's both, right? But GPUs especially in deep and high flyer,"
    },
    {
      "start_time": 3115.93,
      "end_time": 3139.31,
      "content": " which is the hedge fund that owns deep seek and everyone who works for deep seek is part of high flyer to some extent, right? Same parent company, same owner, same CEO. They had all these resources and infrastructure for trading. And then they devoted a humongous portion of them to training models, both language models and otherwise, right? Because these these techniques were heavily AI influenced."
    },
    {
      "start_time": 3140.31,
      "end_time": 3165.64,
      "content": " You know, more recently, people have, you know, realized, hey, trading with, you know, like even, even when you go back to like Renaissance and all these, all these like quantitative firms, natural language processing is the key to like trading really fast, right? Understanding a press release and making the right trade. And so DeepSeek has always been really good at this. And even as far back as 2021, they have press releases and papers saying, like, hey, we're the first company in"
    },
    {
      "start_time": 3165.64,
      "end_time": 3190.97,
      "content": " China with an A100 cluster this large. It was 10,000 A100 GPs, right? This is in 2021. Now, this wasn't all for training, you know, large language models. This is mostly for training models for their quantitative aspects there are quantitative trading as well as you know a lot of that was natural language processing, to be clear. Right. And so this is the sort of history, right? So verifiable fact is that in 2021, they built the largest Chinese cluster, at least they claim it was the largest cluster in China,"
    },
    {
      "start_time": 3190.97,
      "end_time": 3213.49,
      "content": " 10,000 GPUs. Before expert controls started. Yeah. It's like they've had a huge cluster before any conversation of export controls. So then you step it forward to like, what have they done over the last four years since then, right? Obviously, they've continued to operate the hedge fund, probably make tons of money. And the other thing is that they've leaned more and more and more into AI. The CEO, Leon Ching Feng, Leon."
    },
    {
      "start_time": 3213.49,
      "end_time": 3237.81,
      "content": " You're not putting me on this. We discussed this. Leon Fing, right? The CEO, he owns maybe, Leon Fing, he owns maybe a little bit more than half the company, allegedly, right? Is an extremely like Elon Jensen kind of figure where he's just like involved in everything, right? And so over that time period, he's gotten really in-depth into AI. He actually has a bit of a like, if you see some of his statements, a bit of an"
    },
    {
      "start_time": 3237.81,
      "end_time": 3259.31,
      "content": " EAC vibe almost, right? Total AGI vibes. And like, we need to do this. We need to do this. We need to make a new ecosystem of open AI. We need China to lead on this sort of ecosystem because historically the Western countries have led on software ecosystems and straight up acknowledges like in order to do this, we need to do something different."
    },
    {
      "start_time": 3259.31,
      "end_time": 3284.12,
      "content": " Deep Seek is his way of doing this. Some of the translated interviews with him are fantastic. So he has done interviews? Yeah. You think you would do a Western interview or no? Or is there controls on the channel? There hasn't been one yet, but I would try it. I just got a Chinese translator, so it's great. This is this is all push. So fascinating figure, engineer, pushing full on into AI, leveraging the success from the high frequency trading."
    },
    {
      "start_time": 3284.12,
      "end_time": 3306.94,
      "content": " Very direct quotes. We will not switch to closed source when asked about this stuff. He's very long-term motivated in how the ecosystem of AI should work. And from a Chinese perspective, he wants a Chinese company, a Chinese company to build this vision. And so this is sort of like the quote unquote visionary behind the company, right?"
    },
    {
      "start_time": 3306.98,
      "end_time": 3327.48,
      "content": " This hedge fund still exists, right? This quantitative firm and so deep seek is the sort of at you know solely he got turned to this full view of like AI, everything about this, right? But at some point, it slowly maneuvered and he made deep seek. And deep seek has done multiple models since then. They've acquired more and more GPUs. They share infrastructure with the fund, right?"
    },
    {
      "start_time": 3327.98,
      "end_time": 3348.14,
      "content": " And so, you know, there is right and so you know there is no exact number of public GPU resources that they have but besides this 10,000 GPUs that they bought in 2021, right, and they were fantastically profitable, right? And then this paper claims they did only 2,000 H800 GPs, which are a restricted GPU that was previously allowed in China, but no longer allowed,"
    },
    {
      "start_time": 3348.14,
      "end_time": 3368.26,
      "content": " and there's a new version, but no longer allowed, and there's a new version. But it's basically NVIDIA's H-100 for China, right? And there's some restrictions on it specifically around the communications, sort of speed, the interconnect speed, right? Which is why they had to do this crazy SM, you know, scheduling stuff, right? So going back to that, right? It looks like, this is obviously not true in terms of their total GPU account."
    },
    {
      "start_time": 3368.26,
      "end_time": 3388.85,
      "content": " Obvious available GPUs, but for this training run, you think 2000 is the correct number or no? So this is where it takes, you know, a significant amount of sort of like zoning in, right? Like what do you call your training run, right? Do you count all of the research and ablations that you ran, right? Picking all this stuff because yes, you can do a YOLO run, but at some level,"
    },
    {
      "start_time": 3388.85,
      "end_time": 3408.89,
      "content": " you have to do the test at the small scale, and then you have to do some test at medium scale before you go to a large scale. Accepted practice is that for any given model that is a notable advancement, you're going to do 2 to 4x compute of the full training run in experiments alone. So a lot of this compute that's being scaled up, is probably used in large part at this time for research."
    },
    {
      "start_time": 3408.89,
      "end_time": 3439.23,
      "content": " Yeah, and research will, you know, research begets the new ideas that let you get huge efficiency. Research gets you 01. Like research gets you 01. Like research gets you breakthroughs and you need to bet on it. So some of the pricing strategy they will discuss has the research baked into the price? So the numbers that DeepSeek specifically said publicly, right, are just the 10,000 GPUs in 2021, and then 2,000 GPs for only the pre-training for V3. They did not discuss cost on R1. They did not discuss cost on all the other RL for the instruct model that they made,"
    },
    {
      "start_time": 3439.55,
      "end_time": 3460.69,
      "content": " right? They only discussed the pre-training for the base model, and they did not discuss anything on research and ablations. And they do not talk about any of the resources that are shared in terms of, hey, the fund is using all these GPUs, right? And we know that they're very profitable and that 10,000 GPUs in, in 2021 so so the some of the research that we've found is that we actually"
    },
    {
      "start_time": 3460.69,
      "end_time": 3483.64,
      "content": " believe they have closer to 50,000 GPUs. We as semi-analysis. So we should say that you're sort of one of the world experts in figuring out what everybody's doing in terms of the semiconductor, in terms of cluster build-outs, in terms of like who's doing what in terms of training runs. So yeah, so that's the we. Okay, go ahead. Yeah, sorry. We believe they actually have something closer to 50,000 GPs, right?"
    },
    {
      "start_time": 3483.64,
      "end_time": 3505.52,
      "content": " Now, this is split across many tasks, right? Again, the fund. Research and ablations. For ballpark, how much would open AI or Anthropic had? I think the clearest example we have, because meta is also open, they talk about order of 60K to 100K, H-100K-Equivalent GPUs in their training clusters. Right, so like Lama 3, they said, in their training clusters. Right. So like Lama 3, they trained on 16,000 H-100s, right?"
    },
    {
      "start_time": 3508.22,
      "end_time": 3526.98,
      "content": " But the company of META last year publicly disclosed, they bought like 400 something thousand GPS. Yeah. Right. So of course, tiny percentage on the training. Again, like most of it is like serving me the best Instagram reels, right? Um, or whatever, right? I mean, we could get into a cost of like, what is the cost of ownership for a 2000 GPU cluster, 10,000. There's just different sizes of companies that can afford these things."
    },
    {
      "start_time": 3526.98,
      "end_time": 3547.92,
      "content": " And DeepSeek is reasonably big. Their compute allocation compared to is one of the top few in the world. It's not open AI, entropic, et cetera, but they have a lot of compute. Can you, in general, actually just zoom out and also talk about the Hopper architecture, the Nvidia Hopper GPU architecture and the difference between H-100 and H-800,"
    },
    {
      "start_time": 3548.14,
      "end_time": 3567.98,
      "content": " like you mentioned, the interconnects. Yeah, so there's, you know, Amper was the A-100, and then H-100, Hopper, right? People are used them synonymously in the US because really there's just H100 and now there's H 200, right? But same thing. Mostly. In China, they've had two, there have been different salvos of export restrictions. So initially, the US government limited on a two-factor scale, right?"
    },
    {
      "start_time": 3567.98,
      "end_time": 3591.64,
      "content": " Which is chip interconnect versus flops, right? So any chip that had interconnects above a certain level and flops above a certain floating point operations above a certain level was restricted. Later, the government realized that this was a flaw in the restriction, and they cut it down to just floating point operations. And so H-800 had high flops, low communication."
    },
    {
      "start_time": 3591.64,
      "end_time": 3619.55,
      "content": " Exactly. So the H-800 was the same performance as H-100 on flops, right? But it didn't have, it just had the interconnect bandwidth cut. DeepSeek knew how to utilize this, you know, hey, even though we're cut back on the interconnect, we can do all this fancy stuff to figure out how to use the GPU fully anyways, right? And so that was back in October 2022, but later in 2020, end of 20203 implemented in 2024, the US government banned the H800, right?"
    },
    {
      "start_time": 3620.11,
      "end_time": 3639.63,
      "content": " And so by the way, this H800800 cluster, these 2,000 GPUs, was not even purchased in 2024, right? It was purchased in late 2023. And they're just getting the model out now, right? Because it takes a lot of research, et cetera. H-800 was banned and now there's a new chip called the H-20. The H-20 is cut back on only flops, but the interconnect bandwidth is the same."
    },
    {
      "start_time": 3639.63,
      "end_time": 3661.31,
      "content": " And in fact, in some ways, it's better than the H-100 because has better memory bandwidth and memory capacity. So there are, you know, Nvidia is working within the constraints of what the government sets and then builds the best possible GP for China. Can we take this actual tangent and we'll return back to the hardware is the philosophy, the motivation, the case for export controls. What is"
    },
    {
      "start_time": 3661.31,
      "end_time": 3682.36,
      "content": " it? Dari Amadegh just published a blog post about expert controls. The case he makes is that if AI becomes super powerful and he says by 26 we'll have AGI or super powerful AI and that's going to give a significant, whoever builds that will have a significant military advantage. And so, because the United States is a democracy"
    },
    {
      "start_time": 3682.36,
      "end_time": 3704.8,
      "content": " and as he says China is authoritarian or has authoritarian elements, you want a unipolar world where the super powerful military because of the AI is one that's a democracy. It's a much more complicated world geopolitically when you have two superpowers with super powerful AI"
    },
    {
      "start_time": 3704.8,
      "end_time": 3728.3,
      "content": " and one is authoritarian. So that's the case he makes. And so we want to, the United States wants to use export controls to slow down to make sure that China can't do these gigantic training runs that will be presumably required to build AGI. This is very abstract. I think this can be the goal of how some people describe export controls,"
    },
    {
      "start_time": 3728.3,
      "end_time": 3752.64,
      "content": " is this super powerful AI. There's, and you touched on the training run idea, there's not many worlds where China cannot train AI models. Export controls are kneecapping the amount of compute or the density of compute that China can have. And if you think about the AI ecosystem right now as all of these AI companies, revenue numbers are up into the right,"
    },
    {
      "start_time": 3752.64,
      "end_time": 3776.91,
      "content": " the AI usage is just continuing to grow, more GPUs are going to inference. A large part of export controls, if they work, is just that the amount of AI that can be run in China is going to be much lower. So on the training side, deep seek V3 is a great example, which you have a very focused team that can still get to the frontier of AI. This 2000 GPUs is not that hard to get, all considering in the world."
    },
    {
      "start_time": 3776.91,
      "end_time": 3800.09,
      "content": " They're still going to have those GPUs. They're still going to be able to train models. But if there's going to be a huge market for AI, if you have strong export controls and you want to have 100,000 GPUs just serving the equivalent of chat GPT clusters, with good export controls, it also just makes it so that AI can be used much less. And I think that is a much easier goal to achieve than trying to debate on what AGI is."
    },
    {
      "start_time": 3800.09,
      "end_time": 3821.21,
      "content": " And if you have these extremely intelligent autonomous AIs and data centers, like those are the things that could be running in these GPU clusters in the United States, but not in China. To some extent, training a model does effectively nothing, right? Like they have a model. The thing that Dario is sort of speaking to is the implementation of that model once trained"
    },
    {
      "start_time": 3821.21,
      "end_time": 3844.24,
      "content": " to then create huge economic growth, huge increases in military capabilities, huge increases in productivity of people, betterment of lives, whatever you want to direct super powerful AI towards, you can. But that requires significant amounts of compute, right? And so the U.S. government has effectively said, and forever, right, like training will always be a portion of the total compute."
    },
    {
      "start_time": 3844.72,
      "end_time": 3864.9,
      "content": " You know, we mentioned META 400,000 GPUs, only 16,000 made Lama. So the percentage that meta is dedicating to inference, now this might be for recommendation systems that are trying to hack our mind into spending more time and watching more ads, or if it's for a super powerful AI that's doing productive things, doesn't matter about the exact use that our economic system decides."
    },
    {
      "start_time": 3865.2,
      "end_time": 3886.78,
      "content": " It's that that can be delivered in whatever way we want. Whereas with China, right, you know, you're, you know, expert restrictions, great. You're never going to be able to cut everything off, right? And that's, that's like, I think that's quite well understood by the U.S. government is that you can't cut everything off. And they'll make their own chips. And they're trying to make their own chips. And they're trying to make their own chips. They'll be worse than ours. But the whole point is to just keep a gap, right?"
    },
    {
      "start_time": 3886.78,
      "end_time": 3908.48,
      "content": " And therefore, at some point as the AI, you know, in a world where two, three percent economic growth, this is really dumb, by the way, right? To cut off, you know, high tech and not make money off of it but in a world where super powerful AI comes about and then starts creating significant changes in society, which is what all the AI leaders and big tech companies believe. I think super powerful AI is going to change society massively."
    },
    {
      "start_time": 3912.46,
      "end_time": 3930.7,
      "content": " And therefore, this compounding effect of the difference in compute is really important. There's some sci-fi out there where, like, AI is like measured in the power of in like how much power is delivered to compute right or how much is being you know that's sort of a way of thinking about what's the economic output is just how much power are you directing towards that AI. Should we talk about reasoning models with this as a way that this might be actionable as"
    },
    {
      "start_time": 3930.7,
      "end_time": 3952.64,
      "content": " something that people can actually see? So the reasoning models that are coming out with R1 and 01, they're designed to use more compute. There's a lot of buzzy words in the AI community about this, test time compute, inference time compute, whatever. But Dylan has good research on this. You can get to the specific numbers on the ratio of a new training model, you can look at things about the amount of compute use at training and amount of compute use at inference."
    },
    {
      "start_time": 3952.64,
      "end_time": 3974.08,
      "content": " These reasoning models are making inference way more important to doing complex tasks. In the fall, in December, their Open AI announced this O3 model. There's another thing in AI when things move fast. We get both announcements and releases. Announcements are essentially blog posts where you pat yourself on the back and you say you did things and releases or run the models out there, the papers out there, etc. So OpenAI has announced"
    },
    {
      "start_time": 3974.08,
      "end_time": 3994.54,
      "content": " 03 and we can check if 03 Mini is out as of recording potentially, but that doesn't really change the point, which is that the breakthrough result was something called ARC-AGI task, which is the abstract reasoning corpus, a task for artificial general intelligence. Francois Chile is the guy who's been, it's a multi-year-old paper."
    },
    {
      "start_time": 3994.66,
      "end_time": 4015.31,
      "content": " It's a multi-year-old paper. It's a brilliant benchmark. And the number for OpenAI 03 to solve this was that it used as some sort of number of samples in the API. The API has like thinking effort and number of samples. They used a thousand samples to solve this task and it comes out to be like five to $20 per question, which you're putting in effectively a math puzzle"
    },
    {
      "start_time": 4015.31,
      "end_time": 4037.23,
      "content": " and then it takes orders of dollars to answer one question. And this is a lot of compute. If those are going to take off in the U.S. OpenAI needs a ton of GPUs on inference to capture this. They have this OpenAI chat GPT pro subscription, which is $200 a month which sam said they're losing money on which means that people are burning a lot of GPUs on inference and i've signed up with it i I've played with it, I don't think I'm a power user,"
    },
    {
      "start_time": 4037.39,
      "end_time": 4057.47,
      "content": " but I use it. And it's like, that is the thing that a Chinese company with mediumly strong expert controls, there will always be loopholes, might not be able to do it all. And if that, the main result for O3 is also a spectacular coding performance, and if that feeds back into AI companies being able to experiment better."
    },
    {
      "start_time": 4057.47,
      "end_time": 4080.31,
      "content": " So presumably the idea is for an AGI, a much larger fraction of the compute would be used for this test time compute, for the reasoning. For the AGI goes into a room and thinks about how to take over the world and come back in 2.7 hours. This is what- And that it's to take a lot of computers. This is what people, like, CEO or leaders of open AI and"
    },
    {
      "start_time": 4080.31,
      "end_time": 4105.01,
      "content": " anthropic talk about is like autonomous AI models, which is you give them a task and they work on it in the background. I think my personal definition of AGI is much simpler. I think language models are a form of AGI and all of this super powerful stuff is a next step that's great if we get these tools, but a language model has so much value in so many domains. It is a general intelligence to me. But this next step of agentic things where they're independent and they"
    },
    {
      "start_time": 4105.01,
      "end_time": 4129.14,
      "content": " can do tasks that aren't in the training data is what the few-year outlook that these AI companies are driving for. I think the terminology here, that Dario uses a super powerful AI. So I agree with you on the AGI. I think we already have something like that's exceptionally impressive that Alan Turing would for sure say is AGI, but he's referring more to something once in possession of,"
    },
    {
      "start_time": 4129.76,
      "end_time": 4153.34,
      "content": " then you would have a significant military and geopolitical advantage over other nations. So it's not just like you can ask it how to cook an omelet. And he has a much more positive view and his essay, Machines of Love and Grace. I read into this. I don't have enough background in physical sciences to gauge exactly how confident I am and if AI can revolutionaries biology, I'm safe saying that AI is going to"
    },
    {
      "start_time": 4153.34,
      "end_time": 4174.4,
      "content": " accelerate the progress of any computational science. So we're doing a depth-first search here on topics, taking tangent of a tangent, so let's continue on that depth first search. You said that you're both feeling the AGI. So what's your timeline? Dario's 2026 for the super powerful AI that's"
    },
    {
      "start_time": 4174.4,
      "end_time": 4197.31,
      "content": " you know, that's basically agentic to a degree where it's a real security threat, that level of AGI. What's your timeline? I don't like to attribute specific abilities, because predicting specific abilities and when is very hard. I think mostly if you're going to say that I'm feeling the AGI is that I expect continued rapid surprising progress over the next few years."
    },
    {
      "start_time": 4197.31,
      "end_time": 4217.51,
      "content": " So something like R1 is less surprising to me from DeepSeek because I expect there to be new paradigms where substantial progress can be made. I think DeepSeek R1 is so unsteadling because we're kind of on this path with chat GPT. It's like, it's getting better, it's getting better, it's getting better. And then we have a new direction for, for changing the models, and we took one step like this and we like took a step up."
    },
    {
      "start_time": 4217.51,
      "end_time": 4237.77,
      "content": " So it looks like a really fast slope and then we're going to just take more steps. So like it's just really unsettling when you have these big steps. And I expect that to keep happening. I see I've tried opening eye operator, I've tried Claude computer use. They're not there yet. I understand the idea, but it's just so hard to predict what is the breakthrough that will make something like that work."
    },
    {
      "start_time": 4237.77,
      "end_time": 4258.89,
      "content": " And I think it's more likely that we have breakthroughs that work and things that we don't know what they're going to do. So, like, everyone wants agents. Dario has very eloquent way of describing this. And I just think that it's like, way of describing this. And I just think that it's like, there's going to be more than that. So I could just expect these things to come. I'm going to have to try to pin you down to a date on the AGI timeline."
    },
    {
      "start_time": 4261.65,
      "end_time": 4279.47,
      "content": " Like the nuclear weapon moment. So moment where on the geopolitical stage, there's a real, like, you know, because we're talking about export controls. When do you think, just even throw out a date, when do you think that would be like for me it's probably after 2030 so i'm not as"
    },
    {
      "start_time": 4279.47,
      "end_time": 4301.77,
      "content": " what i would say so define that right to me, it kind of almost has already happened, right? You look at elections in India and Pakistan, people get AI voice calls and think they're talking to the politician, right? The AI diffusion rules, which was enacted in the last couple of weeks of the Biden admin, and looks like the Trump admin will keep and potentially even strengthen, limit cloud computing and GPU sales to countries"
    },
    {
      "start_time": 4301.77,
      "end_time": 4323.41,
      "content": " that are not even related to China. It's like this is Portugal and all these like normal companies are on the you need approval from the US list like yeah Portugal and like you know like all these countries that are allies right Singapore right like they they freaking have F-35s and we don't let them buy GPUs like this is this to me is already to the scale of like, you know. Well, that just means that"
    },
    {
      "start_time": 4323.41,
      "end_time": 4345.71,
      "content": " the U.S. military is really nervous about this new technology. That doesn't mean the technology is already there. So, like, they might be just very cautious about this thing that they don't quite understand. But that's a really good point so the the robocalls swarms of semi-intelligent bots could be a weapon, could be doing a lot of social engineering. I mean,"
    },
    {
      "start_time": 4345.71,
      "end_time": 4366.85,
      "content": " there's tons of talk about, you know, from the 2016 elections like Cambridge Analytica and all this stuff, Russian influence. I mean, every country in the world is pushing stuff onto the internet and has narratives they want, right? Like that's every, every like technically competent, whether it's Russia, China, US, Israel, et cetera, right? You know, people are pushing viewpoints onto the internet en masse. And language models crash the cost"
    },
    {
      "start_time": 4366.85,
      "end_time": 4387.95,
      "content": " of like very intelligent sounding language. There's some research that shows that the distribution is actually the limiting factor. So language models haven't yet made misinformation particularly change the equation there. The internet is still ongoing. I think there's a blog AI snake oil and some of my friends at Princeton that write on this stuff. So there is research. It's like it's a default that"
    },
    {
      "start_time": 4387.95,
      "end_time": 4410.64,
      "content": " everyone assumes. And I would have thought the same thing, is that misinformation isn't yet far worse with language models, I think. In terms of internet posts and things that people have been measuring, it hasn't been a exponential increase or something extremely measurable. And things you're talking about with like voice calls and stuff like that, it could be in modalities that are harder to measure. So it's something that it's too soon to tell in terms of..."
    },
    {
      "start_time": 4410.64,
      "end_time": 4433.32,
      "content": " I think that's like political instability via the web is very, it's monitored by a lot of researchers to see what's happening. I think that you're asking about the AGI thing. If you make me give a year, I would be like, okay, I have AI CEOs saying this. They've been saying two years for a while. I think that there people like Dario,"
    },
    {
      "start_time": 4433.96,
      "end_time": 4455.87,
      "content": " Anthropic, the CEO, had thought about this so deeply. I need to take their words seriously, but also understand that they have different incentives. So I would be like add a few years to that, which is how you get something similar to 2030 or a little after 2030. I think to some extent we have or a little after 2030. I think to some extent we have capabilities that hit a certain point where any one person could say, okay, if I can leverage those capabilities"
    },
    {
      "start_time": 4455.87,
      "end_time": 4476.43,
      "content": " for X amount of time, this is AGI, right? Call it 27, 28. But then the cost of actually operating that capability. Yeah, this is going to be my point. So, so extreme that no one can actually deploy it at scale and mass to actually completely revolutionize the economy on a click on a snap of a finger. So I don't think it will be like a snap of the finger moment. It's a physical constraint."
    },
    {
      "start_time": 4476.59,
      "end_time": 4498.31,
      "content": " Rather, it'll be a, you know, oh, the capabilities are here, but I can't deploy it everywhere, right? And so one, one simple example going back sort of to 2023 was when being with GPD 4 came out and everyone was freaking out about search right perplexity came out if you did the cost on like hey implementing GPT3 into every Google search. I was like, oh, okay, this is just like physically impossible to implement."
    },
    {
      "start_time": 4498.31,
      "end_time": 4519.37,
      "content": " Right. And as we step forward to like going back to the test time compute thing, right? A query for, you know, you ask chat GPT a question, it costs sense, right? For their most capable model of chat, right, to get a query back. To solve an ARC AGI problem, though, cost five to 20 bucks right and this is this is an a only going up from"
    },
    {
      "start_time": 4519.37,
      "end_time": 4541.38,
      "content": " there this is a thousand 10,000 X factor difference in cost to respond to a query versus do a task. And the task of our AGI is not like it's like it's it's simple to some extent um you know but it's also like what are the tasks that we want age okay aGI quote unquote what we have today can do arc a gai three years from now it can do much more complicated problems but the cost is going to be"
    },
    {
      "start_time": 4541.38,
      "end_time": 4565.73,
      "content": " measured in thousands and thousands and hundreds of thousands of dollars of GPU time and there just won't be enough power GPUs, infrastructure to operate this and therefore shift everything in the world on the snap the finger. But at that moment, who gets to control and point the AGI at a task. And so this was in Dario's post that he's like, hey, China can effectively and more quickly than us point their AGI at"
    },
    {
      "start_time": 4565.73,
      "end_time": 4586.97,
      "content": " military tasks, right? And they have been in many ways faster at adopting certain new technologies into into their military right especially with regards to drones, right? The US maybe has a longstanding, you know, large air sort of, you know, fighter jet type of thing, bombers. But when it comes to asymmetric arms, such as drones, they've completely leapfrogged"
    },
    {
      "start_time": 4586.97,
      "end_time": 4608.27,
      "content": " the US and the west. And the fear that Dario is sort of pointing out there, I think, is that, yeah, great, we'll have AGI in the commercial sector, the U.S. military won't be able to implement it super fast. Chinese military could and they could direct all their resources to implementing it in the military and therefore solving, you know, military logistics or solving some, some other aspect of like disinformation"
    },
    {
      "start_time": 4608.27,
      "end_time": 4629.64,
      "content": " for targeted certain set of people so they can flip a country's politics or something like that that is actually like catastrophic versus you know, the US just wants to, because it'll be more capitalistically allocated just towards whatever is the highest return of income, which might be like building, you know, factories better or whatever. So everything I've seen, people's intuition seems to fail on robotics."
    },
    {
      "start_time": 4629.64,
      "end_time": 4653.98,
      "content": " So you have this kind of general optimism. I've seen this on self-driving cars. People think it's much easier problem than it is. Similar with drones. Here, I understand it a little bit less, but I've just seen the reality of the war in Ukraine and the usage of drones on both sides. And it seems that humans still far outperform any fully autonomous systems."
    },
    {
      "start_time": 4653.98,
      "end_time": 4674.52,
      "content": " AI is an assistant, but humans drive. FPV drones where the humans control. Most of it just far, far, far outperforms AI system. So I think it's not obvious to me that we're going to have swarms of autonomous robots anytime soon in the military context. Maybe the fastest I can imagine is 2030,"
    },
    {
      "start_time": 4674.82,
      "end_time": 4703.51,
      "content": " which is why I said 2030 for the super powerful AI. Whenever you have large scale swarms of robots doing military actions, that's when the world just starts to look different to me. So that's the thing I'm really worried about. But there could be cyber war, cyber war type of technologies that, uh, from social engineering to actually just swarms the robots that find attack vectors in our code bases and shut down power grids, that kind of stuff."
    },
    {
      "start_time": 4704.63,
      "end_time": 4724.61,
      "content": " And it could be one of those things like on any given weekend or something, power goes out. Nobody knows why, and the world changes forever. Just power going out for two days in all of the United States. That will lead to murder, to chaos. But going back to export controls,"
    },
    {
      "start_time": 4724.87,
      "end_time": 4745.07,
      "content": " do you see that as a useful way to control the balance of power geopolitically in the context of AI. And I think going back to my viewpoint is, if you believe we're in the sort of stage of economic growth and change that we've been in for the last 20 years,"
    },
    {
      "start_time": 4745.07,
      "end_time": 4766.37,
      "content": " the export controls are absolutely guaranteeing that China will win long term, right? If you do not believe AI is going to make significant changes to society in the next 10 years or five years, right? Five, five year timelines are sort of what the more executives and such of AI companies and even big tech companies believe. But even 10-year timelines, you know, it's reasonable."
    },
    {
      "start_time": 4766.37,
      "end_time": 4786.69,
      "content": " But once you get to, hey, these timelines are below that time period, then the only way to sort of like create a sizable advantage or disadvantage for America versus China is if you constrain compute because talent is not really something that's"
    },
    {
      "start_time": 4786.69,
      "end_time": 4807.97,
      "content": " constraining, right? China arguably has more talent, right? More STEM graduates, more programmers. The US can draw upon the world's people, which it does. There's tons of, you know, foreigners in the AI industry. So many of these AI teams are all people without a US passport. Yeah, I mean, many of them are Chinese people who are moving to America, right? And that's great. That's exactly what we want, right?"
    },
    {
      "start_time": 4807.97,
      "end_time": 4829.48,
      "content": " But there's that talent is one aspect, but I don't think that's one that is a measurable advantage for the US or not. It truly is just whether or not compute. Now, even on the compute side, when we look at chips versus data centers, China has the unprecedented ability to build ridiculous sums of power, clockwork, right?"
    },
    {
      "start_time": 4831.4,
      "end_time": 4851.44,
      "content": " They're always building more and more power. They've got steel mills that, that like individually are the size of the entire U.S. industry, right? And they've got aluminum mills that consume gigawatts and gigawatts of power. Right. And when we talk about what's the biggest data center, right? Opening I made this huge thing about Stargate, their announcement there. That's not, that's like once it's fully built out in a few years,"
    },
    {
      "start_time": 4851.54,
      "end_time": 4872.48,
      "content": " it'll be two gigawatts, right? Of power, right? And this is still smaller than the largest industrial facilities in China, right? China, if they wanted to build the largest data center in the world, if they had access to the chips, could. So it's just a question of when, not if, right? So their industrial capacity for exceeds the United States? Exactly. To manufacture stuff."
    },
    {
      "start_time": 4873.06,
      "end_time": 4892.58,
      "content": " Yeah. So long term they're going to be manufacturing chips there? Chips are a little bit more specialized. I'm specifically referring to the data centers, right? Chips, fabs take huge amounts of power. Don't get me wrong. That's not necessarily the gating factor there. The gating factor on how fast people can build the largest clusters today in the US"
    },
    {
      "start_time": 4892.58,
      "end_time": 4913.42,
      "content": " is power. It is whether it's, now, it could be power generation, power transmission, substations, and, you know, all these sorts of transformers and all these things, building the data center. These are all constraints on the U.S. industry's ability to build larger and larger training systems, as well as deploying more and more inference compute. I think we need to make the point clear"
    },
    {
      "start_time": 4913.42,
      "end_time": 4942.97,
      "content": " on why the time is now for people that don't think about this. Because essentially with export controls, you're making it so China cannot make or get cutting edge chips. And the idea is that if you time this wrong, China is pouring a ton of money into their chip production. And if you time it wrong, they are going to have more capacity for production, more capacity for energy, and figure out how to make the chips and have more capacity than the rest of the world to make the chips because everybody can buy they're going to sell their Chinese chips to everybody, they might subsidize them."
    },
    {
      "start_time": 4942.97,
      "end_time": 4965.77,
      "content": " And therefore, if AI takes a long time to become differentiated, we've kneecapped the financial performance of American companies. Nvidia can sell less. TSM cannot sell to China, so therefore we have less demand to therefore to keep driving the production cycle. So that's the assumption behind the time timing being Less than 10 years or five years to above, right?"
    },
    {
      "start_time": 4965.77,
      "end_time": 4993.04,
      "content": " China will win because of these restrictions long term unless AI does something in the short term, which I believe AI will do, you know, make massive changes to society in the medium short term, right? And so that's the big unlocker there. And even today, right, if Xi Jinping decided to get, you know, quote unquote scale-pilled, right? Ie. decide that scaling laws are what matters, right? Just like the U.S. executives, like Satcha Nadella"
    },
    {
      "start_time": 4993.04,
      "end_time": 5014.64,
      "content": " and Mark Zuckerberg and Sundar and all these U.S. executives of the biggest most powerful tech companies have decided their skill-pilled and they're building multi-gigawatt data centers, right? Whether it's in Texas or Louisiana or Wisconsin, wherever, wherever it is, they're building these massive things that cost as much as their entire budget for spending on data centers globally in one spot, right?"
    },
    {
      "start_time": 5014.72,
      "end_time": 5038.34,
      "content": " This is what they've committed to for next year, year after, et cetera. And so they're so convinced that this is the way, that this is what they're doing, but if China decided to, they could do it faster than us, but this is where the restrictions come in. It is not clear that China as a whole has decided, from the highest levels that this is a priority. The US sort of has, right? You know, you see Trump talking about Deep Seek and"
    },
    {
      "start_time": 5038.34,
      "end_time": 5062.23,
      "content": " Stargate within the same week, right? So he's, and the Biden admin as well had a lot of discussions about AI and such. It's clear that they think about it. Only just last week did DeepSeek meet the second in command of China, right? Like they have not even met the top, right? They haven't met Xi. She hasn't set down. And they only just released a subsidy of a trillion R&B, you know, roughly $160 billion,"
    },
    {
      "start_time": 5062.95,
      "end_time": 5085.67,
      "content": " which is closer to the spending of like Microsoft and Meta and Google combined, right, for this year. So it's like they're realizing it just now, but that's where these export restrictions come in and say, hey, you can't, you can't ship the most powerful U.S. chips to China. You can ship a cut down version. You can't ship the most powerful chips to all these countries who we know we're just"
    },
    {
      "start_time": 5085.67,
      "end_time": 5105.97,
      "content": " going to rent it to China. You have to limit the numbers, right? And the tools. And same with manufacturing equipment tools, all these different aspects. But it all stems from AI and then what downstream can slow them down in AI. And so the entire semiconductor restrictions, you read them, they are very clear. It's about AI and military civil fusion of technology."
    },
    {
      "start_time": 5105.97,
      "end_time": 5128.57,
      "content": " Right? It's very clear. And then from there, it goes, oh, well, we're banning them from buying like lithography tools and etch tools and deposition tools and, oh, this random like, you know, subsystem from a random company that's like tiny, right? Like, why are we banning this? Because all of it, the U.S. government has decided is critical to AI systems. I think the fulcrum point is like the transition from seven nanometer to 5 nanometer chips,"
    },
    {
      "start_time": 5128.57,
      "end_time": 5151.03,
      "content": " where I think it was Huawei that had the 7 nanometer chip a few years ago, which caused another political brouhaha almost like this moment and then it's the ASML deep UV what is that like extreme ultraviolet lithography. To set context on the chips, right, what Nathan's referring to is in 2020, Huawei released their Ascend 910 chip, which was an AI"
    },
    {
      "start_time": 5151.03,
      "end_time": 5173.27,
      "content": " AI chip, first one on 7 nanometer before Google did, before Nvidia did. And they submitted it to the ML Perf benchmark, which is sort of a industry standard for machine learning performance benchmark. And it did quite well. And it was the best chip at the submission, right? This was a huge deal. The Trump admin, of course, banned, it was 2019, right, banned the Huawei from getting"
    },
    {
      "start_time": 5173.27,
      "end_time": 5196.1,
      "content": " 7 nanometer chips from TSM, and so then they had to switch to using internal domestically produced chips, which was a multi-year setback. Many companies have done 7 nanometer chips. And the question is, like, we don't know how much Huawei was subsidizing production of that chip. Like, Intel has made 7 nanometer chips that are not profitable and things like this. So this is how it all feeds back into the economic engine of export controls."
    },
    {
      "start_time": 5196.1,
      "end_time": 5216.36,
      "content": " Well, so you're saying that for now, Xi Jinping has not felt the AGII, but it feels like the deep seek moment yeah might like there might be meetings going on now where he's going to start wearing the same t-shirt and things are going to escalate. I mean, like, this, he may have woken up last week right Leon Feng met"
    },
    {
      "start_time": 5216.36,
      "end_time": 5240.9,
      "content": " the vice chair vice the second command guy and they had a meeting and then the day the next day they announced the AI subsidies, which are a trillion R&B. So it's possible that this deep seek moment is truly the beginning of a cold war. That's what a lot of people are worried about. People in AI have been worried that this is going towards a Cold War, or already is. But there's, it's not Deep Seeks fault, but there's something, a bunch of factors came"
    },
    {
      "start_time": 5240.9,
      "end_time": 5263.89,
      "content": " together where it was like this explosion. I mean, it all has to do with Nvidia's not going down probably. It's just some mass hysteria that happened that eventually led to Xi Jinping having meetings and waking up to this idea. And the US government realized in October 7th, 2022, before ChatGPT released, that restriction on October 7th, which dropped and shocked everyone."
    },
    {
      "start_time": 5264.07,
      "end_time": 5284.23,
      "content": " And it was very clearly aimed at AI. Everyone was like, what the heck are you doing? Stamble diffusion was out then, but not Chad GPT. Yeah, but not Chad GPD. So it was like starting to be rumblings of what Gen. I can do to society, but it was very clear, I think, to at least, like, national security council and, and those sort of folks that this was where the world is headed, this Cold War that's happening."
    },
    {
      "start_time": 5284.83,
      "end_time": 5308.43,
      "content": " So is there any concerns that the export controls push China to take military action on Taiwan. This is the big risk. to take military action on Taiwan. This is the big risk, right? The further you push China away from having access to cutting edge American and global technologies, the more likely they are to say, well, because I can't access it, I might as well, like no one should access it, right?"
    },
    {
      "start_time": 5308.79,
      "end_time": 5329.39,
      "content": " And there's a few like interesting aspects of that, right? Like, you know, China has a urban rural divide like no other. They have a male, female birth ratio, like no other, to the point where, you know, if you look in most of China, it's like the ratio's not that bad, but when you look at single dudes in rural China, it's like a 30 to one ratio. And those are disenfranchised dudes, right?"
    },
    {
      "start_time": 5329.39,
      "end_time": 5349.75,
      "content": " Like quote unquote, like the US has an in cell problem like China does too. It's just they're placated in some way or cut crushed down. What do you do with these people? And at the same time, you're not allowed to access the most important technology. At least the US thinks so. China is maybe starting to think this is the most important technology by starting to dump subsidies in it, right? They thought EVs and renewables were the most important technology."
    },
    {
      "start_time": 5349.75,
      "end_time": 5372.63,
      "content": " They dominate that now, right? Now they're starting to, they started thinking about that about semiconductors in, you know, the late 2010s and early 2020s, and now they've been dumping money and they're catching up rapidly. And they're going to do the same with AI, right? Because they're very talented, right? So the question is like, when does when does when does when does when does this hit a breaking point right um and"
    },
    {
      "start_time": 5372.63,
      "end_time": 5406.59,
      "content": " if china sees this as hey hey, they can continue, if not having access and starting a true hot war, taking over Taiwan or trying to subvert its democracy in some way or blockading it hurts the rest of the world far more than it hurts them, this is something they could potentially do, right? And so is this pushing them towards that? Potentially, right? I'm not quite a geopolitical person, but, you know, it's obvious that the world regime of peace and like trade is like super awesome for economics. But but at some point it could break."
    },
    {
      "start_time": 5406.59,
      "end_time": 5431.99,
      "content": " I think we should comment that the like why Chinese economy would be hurt by that is that they're export heavy. The United States buys so much like if that goes away, like, that's how their economy. Well, also, also they just like would not be able to import raw materials from like all over the world, right? The US would just shut down the strait of malacca and like you know in the same time the u.s entire like you could argue almost all the GDP growth in America since you know the 70s has been"
    },
    {
      "start_time": 5431.99,
      "end_time": 5457.42,
      "content": " either population growth or tech, right? Because your life today is not that much better than someone from the 80s outside of tech, right? You still, you know, cars, they all have semiconductors in them everywhere. Fridges, semiconductors everywhere. There's these funny stories about how Russians were taking apart laundry machines because they had certain like Texas instrument chips that they could then repurpose and put into like their, um, their anti-missile missile, missile things, right?"
    },
    {
      "start_time": 5457.48,
      "end_time": 5479.44,
      "content": " Like their S-400 or whatever, you would know more about this. But, uh, there's all sorts of like everything about semiconductors is so integral to every part of our lives. So can you explain the role of TSM in the story of semiconductors and maybe also how the United States can break the reliance on TSM? I don't think it's necessarily breaking the reliance."
    },
    {
      "start_time": 5479.44,
      "end_time": 5500.3,
      "content": " I think it's getting TSMC to build in the US. But so taking a step back, right? TSM produces most of the world's chips, right? Especially on the foundry side. You know, there's a lot of companies that build their own chips, Samsung, Intel, ST Micro, Texas instruments,"
    },
    {
      "start_time": 5500.3,
      "end_time": 5521.3,
      "content": " analog devices, all these kinds of companies build their own chips and XP, but more and more of these companies are outsourcing to TSM and have been for multiple decades. Can you explain the supply chain there and where most of TSM is in terms of manufacturing. Sure. So historically supply chain was companies would build their own chips. They would, you know, it would be a company started."
    },
    {
      "start_time": 5521.3,
      "end_time": 5543.33,
      "content": " They'd build their own chips, and then they'd design the chip and build the ship and sell it. Over time, this became really difficult because the cost of building a fab continues to compound every single generation. Of course, the technology, figuring out the technology for it is incredibly difficult regardless, but just the dollars and cents that are required, ignoring, you know, saying, hey, yes, I have all the technical capability, which it's really hard to get that, by the way, right?"
    },
    {
      "start_time": 5543.41,
      "end_time": 5563.47,
      "content": " Intel's failing, Samsung's failing, et cetera. But if you look at just the dollars to spend to build that next generation fab, it keeps growing, right? Sort of like, you know, Moore's Law is having the cost of ships every two years. There's a separate law that's sort of like doubling the cost of fabs every handful of years. And so you look at a leading edge fab that is going to be profitable today, that's building, you know, three nanometer chips or"
    },
    {
      "start_time": 5563.47,
      "end_time": 5583.73,
      "content": " two nanometer chips in the future, that's going to cost north of 30, 4040 billion, right? And that's just for like a token amount. That's for a like the base building blocking. You probably need to build multiple, right? And so when you look at the industry over the last, you know, if I go back 20, 30 years ago, there were 20, 30 companies that could build the most advanced chips, and then they would design them"
    },
    {
      "start_time": 5583.73,
      "end_time": 5603.96,
      "content": " themselves and sell them, right? So companies like AMD would build their own chips. Intel, of course, still builds their own chips. They're very famous for it. IBM would build their own chips. And you could keep going down the list. All these companies built their own chips. Slowly, they kept falling like flies, and that's because of what TSM did, right? They created the foundry business model, which is, I'm not going to design any chips. I'm just going to contract"
    },
    {
      "start_time": 5603.96,
      "end_time": 5626.5,
      "content": " manufacturer chips for other people. And one of their early customers is in video, right? In video was is the only semiconductor company that's worth, you know, that's doing more than a billion dollars of revenue that was started in the era of Foundry, right? Every other company started before then and at some point had FAs, which is actually incredible, right? You know, like AMD and Intel and Broadcom."
    },
    {
      "start_time": 5626.5,
      "end_time": 5648.93,
      "content": " Such a great fact. It's like everyone had fabs at some point or, you know, brought, you know, some companies like Broadcom, it was like a merger, amalgamation of various companies that rolled up. But even today, Broadcom has fabs, right? They build iPhone RF radio chips sort of in Colorado for, you know, for Apple, right? Like there's there, all these companies had fabs and for most of the fabs, they threw them away or sold them off or they got rolled into something else."
    },
    {
      "start_time": 5649.39,
      "end_time": 5676.76,
      "content": " And now everyone relies on TSMC, right? Including Intel, their latest PC chip uses TSM chips, right? It also uses some Intel chips, but it uses TSM process. Can you explain why the Foundry model is so successful for these companies? Why are they going with economies of scale? Scale. Yeah. So I mean, like I mentioned, right, the cost of building a fab is so high. The R&D is so difficult. And when you look at like these companies that had their own vertical stack,"
    },
    {
      "start_time": 5677.08,
      "end_time": 5697.2,
      "content": " there was an antiquated process of like, okay, like, I'm so hyper-customized to each specific chip. But as we've gone through the history of sort of like the last 50 years of electronics and semiconductors, A, you need more and more specialization, right? Because Moore's Law has died. Dunnard scaling has died, i.e. chips are not getting better just for free, right? You know, from manufacturing, you have to make"
    },
    {
      "start_time": 5697.2,
      "end_time": 5723.68,
      "content": " real architectural innovations, right? Google is not just running on Intel CPUs for web serving. They have a YouTube chip, they have TPUs, they have pixel chips, they have a wide diversity of chips that, you know, generate all the economic value of Google, right? Running, you know, it's running all the services and stuff. And so, and this is just Google, and you could go across any company in the industry and it's like this right cars contain 5,000 chips you know 200 different varieties of them right all these random things. A Tesla door handle has two chips, right?"
    },
    {
      "start_time": 5723.68,
      "end_time": 5745.3,
      "content": " Like it's like ridiculous. And it's a cool door handle, right? It's like, you know, you don't think about it, but it's like has two really chip like penny like chips in there, right? Anyway, so, so as you have more diversity of chips, as you have more specialization required and the cost of fabs continues to grow you need someone who is laser focused on building the best process technology and making it as flexible as possible."
    },
    {
      "start_time": 5745.3,
      "end_time": 5765.96,
      "content": " I think you could say it simply, which is the cost per fab goes up. And if you are a small player that makes a few types of chips, you're not going to have the demand to pay back the cost of the fab. Whereas Nvidia can have many different customers and aggregate all this demand into one place. And then they're the only person that makes enough money building chips to"
    },
    {
      "start_time": 5765.96,
      "end_time": 5786.86,
      "content": " buy the next, to build the next fab. So this is kind of why the company slowly get killed because they have a they have 10 years ago a chip that is profitable and is good enough, but the cost to build the next one goes up. They may try to do this, fail because they don't have the money to make it work and then they don't have any chips or they build it and it's too expensive and they just have not profitable chips."
    },
    {
      "start_time": 5786.86,
      "end_time": 5810.63,
      "content": " You know, there's more failure points, right? right you know you could have one little process related to like some sort of like chemical etch or some sort of like plasma etch or you know some little process that screws up you didn't engineer it right and now the whole company falls apart you can't make chips, right? And so super, super powerful companies like Intel, they had like the weathering storm to like, hey, they still exist today, even though they really screwed up their manufacturing six, seven years ago."
    },
    {
      "start_time": 5810.63,
      "end_time": 5831.87,
      "content": " But in the case of like AMD, they almost went bankrupt. They had to sell their fabs to Mubedala, UAE, right? And like that became a separate company called Global Foundries, which is a foundry firm. And then AMD was able to then focus on the return back up, was like, hey, let's focus on making chiplets and a bunch of different chips for different markets and focusing on specific workloads"
    },
    {
      "start_time": 5831.87,
      "end_time": 5854.69,
      "content": " rather than, you know, all of these different things. And so you get more diversity of chips. You have more companies than ever designing chips, but you have fewer companies than ever manufacturing them. Right. And this is where TSMC comes in as they've, they've just been the best, right? They are so good at it, right? They're customer focused. They make it easy for you to fabricate your chips. They take all of that complexity and like kind of try and abstract a lot of it away from you."
    },
    {
      "start_time": 5857.12,
      "end_time": 5875.54,
      "content": " They make good money. They don't make insane money, but they make good money. And they're able to aggregate all this demand and continue to build the next fab, the next fab, the next fab. So why is Taiwan so special for TSMC? Why is it happening there? Can it be replicated inside the United States? Yeah, so there's aspects of it that I would say yes and aspects that I'd say no, right?"
    },
    {
      "start_time": 5876.54,
      "end_time": 5896.66,
      "content": " TSM is way ahead because former, you know, executive Morse Chang of Texas Instruments wasn't promoted to CEO and he's like, screw this, I'm going to go make my own chip company, right? And he went to Taiwan and made TSM, right? And there's a whole lot more story there. So it could have been, Texas instruments could have been the TSM, you know, could have been TSM but Texas semiconductor"
    },
    {
      "start_time": 5896.66,
      "end_time": 5922.96,
      "content": " manufacturer right instead of you know Texas instruments right but but you know so there is that whole story there. Sitting here in Texas. I mean, and that sounds like a human story. Like, it didn't get promoted. Just the brilliance of Morris Chang, you know, which I wouldn't underplay, but there's also like a different level of like how this works, right? So in Taiwan, the number, top percent of students that go to the best school, which is NTU,"
    },
    {
      "start_time": 5922.96,
      "end_time": 5945,
      "content": " the top percent of those all go work to TSM. Right? And guess what their pay is? Their starting pay is like 80 000 or 70 000 right which is like that's like starting pay for like a good graduate in the u, right? Not the top. The top graduates are making hundreds of thousands of dollars at the Googles and the Amazon's. And now I guess the open AIs of the world, right? So there is a large dichotomy of like,"
    },
    {
      "start_time": 5945,
      "end_time": 5969.03,
      "content": " what is the top 1% of the society doing and where are they headed because of economic reasons? Intel never paid that crazy good, right? And it didn't make sense to them, right? That's one aspect, right? Where is the best going second is the work ethic right like you know we we like to work you know you work a lot we work a. But at the end of the day, when there's a, you know, when, what is the time and amount of work that you're doing and what does a fab require, right?"
    },
    {
      "start_time": 5969.03,
      "end_time": 5990.99,
      "content": " Fabs are not work from home jobs. They are you go into the fab and grueling work, right? There's, there's, hey, if there is any amount of vibration, right? An earthquake happens, vibrates the machines. They're all, you know, they're either broken, you've scrapped some of your production, and then in many cases, they're like not calibrated properly. So, so when TSM, when there's an earthquake, right? Recently there's been an earthquake."
    },
    {
      "start_time": 5991.57,
      "end_time": 6011.07,
      "content": " TSM doesn't call their employees. They just, they just go to the fab and like they just show up the parking lot gets slammed and people just go into the fab and fix it right like it's like an it's like ants right like It's like an ant's, right? Like it's like an ant's, like, you know, a hive of ants. Doesn't get told by the queen what to do. The ants just know. It's like one person just specializes on these one task."
    },
    {
      "start_time": 6011.07,
      "end_time": 6031.43,
      "content": " And it's like, you're going to take this one tool and you're the best person in the world. And this is what you're going to do for your whole life is one task in the fab which is like some special chemistry plus nanomanufacturing on one line of tools that continues to get iterated. And yeah, it's just like, it's like specific plasma edge for removing silicon dioxide, right? That's all you focus on your whole career. And it's such a specialized thing."
    },
    {
      "start_time": 6031.43,
      "end_time": 6051.87,
      "content": " And so it's not like the task are transferable. AI today is awesome because like people can pick it up like that. Semiconductor manufacturing is very antiquated and difficult. None of the materials are online for people to read easily and learn, right? The papers are very dense and like it takes a lot of experience to learn. And so it makes the barrier to entry much higher too."
    },
    {
      "start_time": 6052.03,
      "end_time": 6077.4,
      "content": " So so when you talk about, hey, you have all these people that are super specialized. They will work, you know, 80 hours a week in a factory, right, in a fab. And if anything goes wrong wrong they'll go show up in the middle of the night because some earthquake their wife's like there was an earthquake he's like great i'm gonna go to the fab it's like great I'm gonna go to the fab would you would you like as an American do that right it's like these sorts of things are like what you know I guess are the exemplifying like why TSMC is so amazing?"
    },
    {
      "start_time": 6077.4,
      "end_time": 6099.28,
      "content": " Now, can you replicate it in the US? Let's not ignore. Intel was the leader in manufacturing for over 20 years. They brought every technology to market first besides the UV strain silicon, high K metal gates, FinFet, you know, and the list goes just goes on and on and on of technologies that Intel brought to market first, made the most money from, and manufactured"
    },
    {
      "start_time": 6099.28,
      "end_time": 6120.84,
      "content": " at scale first, best, highest profit margins, right? So we shouldn't ignore that Intel can't do this, right? It's that the culture has broken, right? You've invested in the wrong things. They said no to the iPhone. They had all these different things regarding like, you know, mismanagement of the fabs, mismanagement of the fabs, mismanagement of designs, this lockup, right? And at the same time, all these brilliant people,"
    },
    {
      "start_time": 6120.84,
      "end_time": 6144.18,
      "content": " right, these like 50,000 PhDs, you know, or masters that have been working on specific chemical or physical processes or nanomanyufacturing processes for decades in Oregon, they're still there. They're still producing amazing work. It's just like getting it to the last mile of production at high yield, where you can, where you can manufacture dozens and hundreds of different kinds of chips, you know, and it's good customer experience has broken, right?"
    },
    {
      "start_time": 6144.18,
      "end_time": 6164.4,
      "content": " You know, it's that customer experience. It's like the, like, part of it is like people will say Intel is too pompous in the 2010s, right? They just thought they were better than everyone. The tool guys were like, oh, I don't think that this is mature enough. And they're like, ah, you just don't know. We know, right? This sort of stuff would happen. And so can the US bring it to the, can the US bring leading edge semiconductor manufacturing to the US?"
    },
    {
      "start_time": 6164.4,
      "end_time": 6188.33,
      "content": " Emphomatically, yes, right? And we are, right? It's happening. Arizona is getting better and better as time goes on. TSM has built, you know, roughly 20% of their capacity for 5 nanometer in the US, right? Now, this is nowhere near enough, right? You know, 20% of capacity in the US is like nothing, right? And furthermore, this is still dependent on Taiwan existing, right? All there's sort of important way to separate it out."
    },
    {
      "start_time": 6188.33,
      "end_time": 6209.63,
      "content": " There's R&D and there's high volume manufacturing. There are effectively, there are three places in the world that are doing leading edge R&D. There's Sinshu, Taiwan, there's Hillsborough, Oregon, and there is Pyongyang, South Korea. These three places are doing the leading edge R&D for the rest of the world's leading edge semiconductors, right?"
    },
    {
      "start_time": 6209.63,
      "end_time": 6230.39,
      "content": " Now, manufacturing can be distributed more globally, right? And this is sort of where this dichotomy exists of like, who's actually modifying the process? Who's actually developing the next generation one, who's improving them, is Sinshu, is Hillsborough, is Pyongyang, right? It is not the rest of these, you know fabs like arizona right"
    },
    {
      "start_time": 6230.39,
      "end_time": 6253.33,
      "content": " arizona is a paperweight if if since you disappeared off the face of the planet um you know within within a year, a couple years, Arizona would stop producing too, right? It's actually like pretty critical. One of the things i like to say is if i had like a few missiles i know exactly where i could cause the most economic damage right it's not targeting the white house right it's the rn d cycle economic damage, right? It's not targeting the White House, right? It's the R&D centers. It's the R&D centers for TSM, Intel, Samsung,"
    },
    {
      "start_time": 6253.33,
      "end_time": 6275.39,
      "content": " and then some of the memory guys, Micron and Hynix. Because they define the future evolution of these semiconductors. And everything's moving so rapidly that it really is fundamentally about R&D. And it is all about TSM, huh? And so TSMC, you know, you cannot purchase a vehicle without TSM chips, right? You cannot purchase a fridge without TSMC chips."
    },
    {
      "start_time": 6275.39,
      "end_time": 6296.41,
      "content": " You cannot, you, like, I think one of the few things you can purchase, ironically, is a Texas instrument's like graphing calculator, right? Because they actually manufacture in Texas. But like outside of that, like a laptop, a phone, anything you servers, right, GPUs, none top of phone, it's depressing. Any servers, right, GPUs, none of this stuff can exist. And this is without TSMC. And in many cases, it's not even like the leading edge, you know, sexy 5 nanometer chip,"
    },
    {
      "start_time": 6296.41,
      "end_time": 6329.39,
      "content": " 3 nanometer, chip, 2 nanometer chip. Oftentimes, it's just like some stupid power I see that's like converting from like, you know, some voltage to another, right? And it's made at TSM, right? This is what China is investing in as well. It's like they can build out this long tail fab where the techniques are much more known you don't have to figure out these problems with EUV they're investing in this and then they have large supply for things like the car door handles and the random stuff. And that trickles down into this whole economic discussion as well, which is they have far more than we do. And having supply for things like this is crucial to normal life."
    },
    {
      "start_time": 6329.39,
      "end_time": 6349.93,
      "content": " So they're doing the, they're starting to invest in high volume manufacturer, but they're not doing R&D. So they do R&D on their own. They're just way behind, right? So I would say like in 2015, China had a five-year plan where they defined by 2025 and 2020 certain goals, including like 80% domestic production of semiconductors."
    },
    {
      "start_time": 6350.23,
      "end_time": 6370.63,
      "content": " Uh, they're not, they're not going to hit that, right? To be clear, but they are, they are in certain areas really, really close, right? Like, BYD is probably going to be the first company in the world to not have to use TSM for making, because they have their own fabs, right, for making chips. Now, they still have to buy some chips from foreign, for example, like, around like self-driving A-DAS capabilities"
    },
    {
      "start_time": 6370.63,
      "end_time": 6391.07,
      "content": " because those are really high end. But at least like, you know, like an internal combustion engine has 40 chips and an EV, you know, like an internal combustion engine has 40 chips and an EV, you know, just for like controlling like flow rates and all these things. And EVs are even more complicated. So all these different power ICs and battery management controllers and all these things, they're insourcing, right? And this is this is something that like China has been doing since 2015."
    },
    {
      "start_time": 6391.07,
      "end_time": 6425,
      "content": " Now as far as like the trailing edge, they're getting so much capacity there. As far as the leading edge, right, i.e. this five nanometer and so on, so forth, right, where GPUs, they are still behind. And this is, the US restrictions are trying to stop them in the ladder. But you know, all that's happened, you know, is yes, they've slowed down their five nanometer, three nanometer, et cetera, but they've accelerated their, hey, 45 nanometer, 90 nanometer, power IC or analog I see or you know random chip in my keyboard right that kind of stuff so so there is an angle of like the u s's actions have been so from these export you know from the"
    },
    {
      "start_time": 6425,
      "end_time": 6446.36,
      "content": " angle of the expert controls have been so inflammatory at slowing down China's progress on the leading edge that they've turned around and have accelerated their progress elsewhere because they know this is so important right if the US is going to lock them out here or if they lock us out here as well in the trailing edge and so going going back, can the U.S. build it here? Yes, but it's going to take a ton of money."
    },
    {
      "start_time": 6446.52,
      "end_time": 6469.79,
      "content": " I truly think like to to revolutionize and completely in-source semiconductors would take a decade and a trillion dollars. Is some of it also culture? like you said, extreme competence, extreme work ethic in Taiwan. I think if you have the demand and the money is on the line, the American companies figure it out. It's going to take hand-holding with the government. I think that the culture helps TSM breakthrough, and it's easier for them."
    },
    {
      "start_time": 6470.47,
      "end_time": 6492.75,
      "content": " TSM has some like 90,000 employees, right? It's not actually that insane amount. The Arizona Fab has 3,000 from Taiwan. And these people, like, their wives were like, yeah, we're not going to have kids unless we you sign up for the Arizona fab we go to Arizona and we have our kids there there's also a Japan fab where the same thing happened right and so like these wives drove like these like these dudes to like go to Japan or America to have the kids there."
    },
    {
      "start_time": 6492.75,
      "end_time": 6517.85,
      "content": " And it's like it's an element of culture. Yeah, sure. Taiwan works that hard, but also like the US has done it in the past. They could do it now, right? You know, we can just import, I say import the best people in the world if we want to. That's where the immigration conversation is a tricky one and there's been a lot of debate over that. But yeah, it seems absurdly controversial to import the best people in the world. I don't understand why it's controversial. That's the one of the ways of"
    },
    {
      "start_time": 6517.85,
      "end_time": 6538.15,
      "content": " winning. I'm sure we agree with you. And like even if you can't import those people, I still think you could do a lot to manufacture most of in the US if the money's there, right? And so like- It's just way more expensive. It's not profitable for a long time. And that's the context of like the Chips Act is only like $50 billion. Relative to, you know, some of the renewable, you know, initiatives that were passed in the"
    },
    {
      "start_time": 6538.15,
      "end_time": 6572.57,
      "content": " Inflation Reduction Act and the Infrastructure Act, which total in the hundreds of billions of dollars, right? And so like the amount of money that the US is spending on the semiconductor industry is nothing, right? Whereas all these other countries have is nothing, right? Whereas all these other countries have structural advantages in terms of like, you know, work ethic and amount of work and like things like that, but also a number of STEM graduates, the percentile of their best going to that, right? But they also have like differences in terms of like, hey, there's just tax benefits in the law and have been in the law for 20 years. Right. And so and then and then some countries have massive subsidies, right? China has something like"
    },
    {
      "start_time": 6572.57,
      "end_time": 6594.59,
      "content": " $200 billion of semiconductor subsidies a year. We're talking about $50 billion in the U.S. over like six, right? So the girth or difference in like the subsidy amounts is also huge right and and so i think you know trump has been talking about tariffing taiwan recently um you know that's sort of like terrifying Taiwan recently. That's sort of like one of these things that's like, oh, okay, well, like, you know, maybe he doesn't want to subsidize the U.S."
    },
    {
      "start_time": 6594.63,
      "end_time": 6614.83,
      "content": " Semiconductor industry. Obviously, terrifying Taiwan is going to cost a lot of things to go get much more expensive, but does it change the equation for TSM building more fabs in the U.S. That's what he's sort of positing, right? So can you lay out the, so we laid out the importance. By the way, it's incredible how much you know about so much. We told you Dylan knows all the stuff."
    },
    {
      "start_time": 6615.83,
      "end_time": 6644.96,
      "content": " Yeah. Yeah. So, okay, you laid out why TSMC is really important. If we look out into the future, 10, 20 years out, U.S.-China relationship seems like it can go to a dark place of Cold War, escalated Cold War, even hot war, or to a good place of anything from frenemies to cooperation to working together."
    },
    {
      "start_time": 6644.96,
      "end_time": 6682.5,
      "content": " So in this game theory, complicated game. What are the different trajectories? What should US be doing? Like what do you see as the different possible trajectories of U.S.-China relations as both leaders start to feel the AGI more and more and see the importance of chips and the importance of AI. I mean, ultimately, the export controls are pointing towards a separate future economy. I think the U.S. has made it clear to Chinese leaders that we intend to control this technology at whatever cost to global economic integration."
    },
    {
      "start_time": 6682.5,
      "end_time": 6704.34,
      "content": " So that, it's hard to unwind that. Like the card has been played. To the same extent, they've also limited US companies from mentoring China, right? So it is, it is, you know, it's been a long time coming. You know, at some point, you know, there was there was a convergence, right? But, but over at least the last decade, it's been branching further and further out, right? Like, U.S. companies can't enter China. Chinese companies can't enter the U.S."
    },
    {
      "start_time": 6704.72,
      "end_time": 6727.2,
      "content": " The U.S. is saying, hey, China, you can't get access to our technologies in certain areas. And China's rebuttling with the same thing around like, you know, they've done some sort of specific materials in, you know, gallium and things like that that they've tried to limit the U.S. on. One of the, there's a U.S. drone company that's not allowed to buy batteries, then they have like military customers. And this drone company just tells the military customers like,"
    },
    {
      "start_time": 6727.2,
      "end_time": 6749.6,
      "content": " hey, just get it from Amazon because I can't actually physically get them. Right. Like there's all these things that are happening that point to further and further divergence. I have zero idea. And I would love if we could all hold hands and sing kumbaya, but like I have zero idea how that could possibly happen. Is the divergence good or bad for avoiding war? Is it possible that the divergence in terms of"
    },
    {
      "start_time": 6749.6,
      "end_time": 6770.66,
      "content": " manufacture chips of training AI systems is actually good for avoiding military conflict. It's an objective fact that the world has been the most peaceful as ever been when there are global hegemons, right? Or regional hegemons, right? Or regional hegemons, right, in historical context, right? The Mediterranean was the most peaceful ever when the Romans were there, right? China had very peaceful and warring times,"
    },
    {
      "start_time": 6770.7,
      "end_time": 6791.14,
      "content": " and the peaceful times were when dynasties had a lockhold over not just themselves, but all their tributaries around them, right? And likewise, the most peaceful time in human history has been when the U.S. was the global hegemon, right? The last half, you know, decades. Now, we've sort of seen things start to slide right with Russia, Ukraine, with what's going on in Middle East, and Taiwan risk, all these different"
    },
    {
      "start_time": 6791.14,
      "end_time": 6811.82,
      "content": " things are starting to bubble up, still objectively, extremely peaceful. Now, what happens when it's not one global hegemon, but it's two, obviously, and China will be, you know, competitive or even overtake the US like it's possible, right? And so this, this change in global hegemony, it's, I don't think it ever happens like super peacefully, right? When empires fall, right? Which is a"
    },
    {
      "start_time": 6811.82,
      "end_time": 6832.78,
      "content": " possible trajectory for America. They don't fall gracefully, right? Like, they don't fall gracefully, right? Like they don't just slide out of irrelevance. Usually there's a lot of shaking. And so, you know, what the US is trying to do is maintain its top position. And what China is trying to do is become the top position, right? And, and And obviously there's budding of heads here in the most simple terms."
    },
    {
      "start_time": 6832.78,
      "end_time": 6858.47,
      "content": " And that could take shape in all kinds of ways, including proxy wars. And that seems like it's already happening. Like as much as I want there to be centuries of prolonged peace, it does not, it looks like further instability internationally is ahead. And the US is ahead. And the U.S. is like sort of like current task is like, hey, if we control AI, if we're the leader in AI, then we, and AI significantly accelerates progress,"
    },
    {
      "start_time": 6858.63,
      "end_time": 6883.7,
      "content": " then we can maintain the global hegemony position and therefore... I hope that works. And as an American, like, you know, kind of like, okay, I guess that's going to lead to peace for us. Now, obviously, other people around the world get affected negatively. Obviously, the Chinese people are not going to be in as advantageous of a position if that happens. But, you know, this is sort of the reality of like what's being done and the actions that are being carried out."
    },
    {
      "start_time": 6883.96,
      "end_time": 6904.36,
      "content": " So can we go back to the specific detail of the different hardware? There's this nice graphic in the export controls of which GPUs are allowed to be exported and which are not. Can you kind of explain the difference? Is there, from a technical perspective, are the age"
    },
    {
      "start_time": 6904.36,
      "end_time": 6928.68,
      "content": " 20s promising? Yeah, so this goes, and I think we'd have to like, we need to dive really deep into the reasoning aspect and what's going on there. But the H20, you know, the U.S. has gone through multiple iterations of the export controls, right? This H800 was at one point allowed back in 23, but then it got canceled, and by then, by, you know, DeepC had already built their cluster of they claim 2k."
    },
    {
      "start_time": 6928.76,
      "end_time": 6952.72,
      "content": " I think they actually have like many more, like something like 10K of those. And now this H20 is the legally allowed chip, right? Invitya shipped a million of these last year to China. For context, it was like four or five million GPUs, right? So the percentage of GPUs that were this China-specific H-20 is quite high, right? You know, roughly 20%, 25%, right, 20% or so. And so this H20 has been neutered in one way,"
    },
    {
      "start_time": 6952.8,
      "end_time": 6973.08,
      "content": " but it's actually upgraded in other ways, right? And you know, you could think of chips along three axes for AI, right? You know, ignoring software stack and like exact architecture, just raw specifications. There's floating point operations, right, flops. There is memory bandwidth, i.e., in memory capacity, right? I.O, right, memory. And then there is interconnect, right?"
    },
    {
      "start_time": 6973.18,
      "end_time": 6993.58,
      "content": " Chip-to-chip interconnections. All three of these are incredibly important for making AI systems, right? Because AI systems involve a lot of compute. They involve a lot of moving memory around, whether it be to memory or two other chips. And so these three vectors, the US initially had a multi, you know, had two of these vectors controlled"
    },
    {
      "start_time": 6993.58,
      "end_time": 7014.22,
      "content": " and one of them not controlled, which was flops and interconnect bandwidth were initially controlled. And then they said, no, no, no, we're going to remove the interconnect bandwidth and just make it a very simple only flops. But now, Nvidia can now make a chip that has, okay, it's cut down on flaps. It's, you know, it's like one third that of the H100, right? In, in, on spec sheet paper performance for flops."
    },
    {
      "start_time": 7014.62,
      "end_time": 7042.96,
      "content": " You know, in real world, it's closer to like half, or maybe even like 60% of it. But then on the other two vectors, it's just as good for interconnect bandwidth, and then for memory bandwidth and memory capacity, the H20 has more memory bandwidth and more memory capacity than the H-100. Now, recently, you know, we at our research, we cut NVIDIA's for H20 for this year down drastically. They were going to make another two million of those this year, but they just canceled all the orders a couple weeks ago."
    },
    {
      "start_time": 7042.96,
      "end_time": 7066.6,
      "content": " In our view, that's because we think that they think they're going to get restricted, right? Because why would they cancel all these orders for H20? Because they shipped a million of them last year. They had orders in for a couple million this year and just gone, right? For H20, B20, right? A successor to H20. And now they're all gone. Now, why would they do this, right? I think it's very clear, right? I think it's very clear, right? The H20 is actually better for certain tasks."
    },
    {
      "start_time": 7066.6,
      "end_time": 7090.12,
      "content": " And that certain task is reasoning, right? Reasoning is incredibly different than, you know, when you look at the different regimes of models, right? Pre-training is all about flops, right? It's all about flops. There's things you do, like mixture of experts that we talked about, to trade off interconnect or to trade off, you know, other aspects and lower the flops and rely more on interconnect and memory."
    },
    {
      "start_time": 7090.12,
      "end_time": 7112.62,
      "content": " But at the end of the day, it's flops as everything, right? We talk about models in terms of like how many flops they are right uh so so like you know we talk about oh gpd4 is two e 25 right two to the uh Two to the 25th, you know, 25th, you know, two, 25 zeros, right, flop, right, floating point operations. For training. For training, right? And we're talking about the restrictions for the 2E24, right?"
    },
    {
      "start_time": 7112.62,
      "end_time": 7137.47,
      "content": " The US has an executive order that Trump recently unsigned, which was, hey, 1E26, once you hit that number of floating point operations, you must notify the government. And you must share your results with us, right? Like there's a level of model where the US government must be told, right? And that's 1E26. And so as we move forward, this is, this is an incredibly like important flop is the vector that the government has cared about historically, but the other"
    },
    {
      "start_time": 7137.47,
      "end_time": 7158.13,
      "content": " two vectors are arguably just as important, right? And especially when we come to this new paradigm, which the world is only just learning about over the last six months, right? Reasoning. And do we understand firmly which of the three dimensions is best for reasoning? So interconnect, the flops don't matter as much. Is it memory? Memory, right?"
    },
    {
      "start_time": 7158.13,
      "end_time": 7179.93,
      "content": " Yeah, so. We're going to get into technical stuff real fast. There's two articles in this one that I could show, maybe graphics that might be interesting for you to pull up. For the listeners, we're looking at the section of 01 inference architectures toconomics. Hmm. You want to explain KV Cash before we talk about this? I think like it's better to- Okay, yeah, we should get, we need to go through a lot of specific technical things"
    },
    {
      "start_time": 7179.93,
      "end_time": 7205.05,
      "content": " of transformers to make this easy for people. Because it's incredibly important because this changes how models work. But I think resetting, right? Why is memory so important? It's because so far we've talked about parameter counts, right? And mixture of experts, you can change how many active parameters versus total parameters to embed more data but have less flops. But more important, you know, another aspect of, another aspect of what's part of this humongous revolution in the last"
    },
    {
      "start_time": 7205.05,
      "end_time": 7225.31,
      "content": " handful of years is the transformer, right? And the attention mechanism. Attention mechanism is that the model understands the relationships between all the words in its context, right? And that is separate from the parameters themselves, right? And that is something that you must calculate, right? How each token, right, each word in the context length,"
    },
    {
      "start_time": 7225.31,
      "end_time": 7246.59,
      "content": " is relatively connected to each other, right? And I think, I think, Nathan, you should explain KV Cash better. KV Cash is one of the optimization. Yeah, so the attention operator has three core things. It's queries, keys, and values. QKV is the thing that goes into this. You'll look at the equation. You see that these matrices are multiplied together."
    },
    {
      "start_time": 7246.59,
      "end_time": 7269.62,
      "content": " These words, query, key, and value come from information retrieval backgrounds, where the query is the thing you're trying to get the values for, and you access the keys, and values is rewating. My background's not in information retrieval and things like this. It's just fun to have backlinks. And what effectively happens is that when you're doing these matrix multiplications, you're having matrices that are of the size of the context length."
    },
    {
      "start_time": 7269.62,
      "end_time": 7289.98,
      "content": " So the number of tokens that you put into the model. And the KV cache is effectively some form of compressed representation of all the previous tokens in the model. So when you're doing this, we talk about auto-regressive models. You predict one token at a time. You start with whatever your prompt was, you ask a question, who was the president in 1825?"
    },
    {
      "start_time": 7289.98,
      "end_time": 7311.26,
      "content": " The model then is going to generate its first token. For each of these tokens, you're doing the same attention operator where you're multiplying these query key value matrices, but the math is very nice so that when you're doing this repeatedly, this KV cache, this key value operation, you can keep appending the new values to it."
    },
    {
      "start_time": 7311.26,
      "end_time": 7332.76,
      "content": " So you keep track of what your previous values you're inferring over in this auto-aggressive chain, you keep it in memory the whole time. And this is a really crucial thing to manage when serving inference at scale. There are far bigger experts in this, and there are so many levels of detail that you can go into. Essentially, one of the key, quote,"
    },
    {
      "start_time": 7332.76,
      "end_time": 7358.19,
      "content": " drawbacks of the attention operator and the transformer is that there is a form of quadratic memory cost in proportion to the context length. So as you put in longer questions, the memory used in order to make that computation is going up in the form of a quadratic. You'll hear about a lot of other language model architectures that are like subquadatic or linear attention forms, which is like state space models."
    },
    {
      "start_time": 7358.35,
      "end_time": 7378.29,
      "content": " We don't need to go down all these now. And then there's innovations on attention to make this memory usage and the ability to attend over long contexts much more accurate and high performance and those innovations are going to help you with i mean you're highly memory constraint they help with memory constraint and performance. So if you put in a book into, I think,"
    },
    {
      "start_time": 7378.29,
      "end_time": 7399.09,
      "content": " Gemini is the model that has the longest context length that people are using. Gemini is known for 1 million and now 2 million context length. You put a whole book into Gemini and sometimes it'll draw facts out of it. It's not perfect. They're getting better. So there's two things. It's like one to be able to serve this on the memory level. Google has magic with their TPU stack where they can serve really long contexts."
    },
    {
      "start_time": 7399.61,
      "end_time": 7422.89,
      "content": " And then there's also many decisions along the way to actually make long contacts performance work. This applies the data. There's subtle changes to these computations and attention and it just it changes the architecture. But serving long context is extremely many constrained, especially when you're making a lot of predictions. I actually don't know why input and output tokens are more expensive, But I think essentially output tokens,"
    },
    {
      "start_time": 7422.89,
      "end_time": 7443.97,
      "content": " you have to do more computation because you have to sample from the model. I can explain that. So today, if you use a model, like you look at an API, Open AI charges, you know, a certain price per million tokens, right? And that price for input and output tokens is different, right? And the reason is, is that there is, you know, when you're inputting a query into the model, right?"
    },
    {
      "start_time": 7443.97,
      "end_time": 7468.62,
      "content": " Let's say you have a book, right? That book, you must now calculate the entire KV cash for it, right? This key value cache. And so when you do that, that is a parallel operation. All of the tokens can be processed at one time. And therefore, you can dramatically reduce how much you're spending, right? The flop requirements for generating a token and an input token are identical, right? If I input one token or if I generate one token, it's completely identical. I have to go through the model, right?"
    },
    {
      "start_time": 7468.62,
      "end_time": 7488.72,
      "content": " But the difference is that I can do that input, i.e. the pre-fill, i.e. the prompt, simultaneously in a batch nature, right? And therefore, it is all flop. I think the pricing model, mostly they use is for input tokens is about one fourth the price of the output tokens. Correct. But then output tokens, the reason why it's so expensive is because I can't do it in parallel, right?"
    },
    {
      "start_time": 7488.72,
      "end_time": 7510.62,
      "content": " It's auto-regressive. Every time I generate a token, I must not only take the entire, I must not only read the whole entire model into memory, right, and activate it, right, go calculate it to generate the next token. I also have to read the entire KV cache. And I generate a token and i append that kv that one token i generated and it's kv cache and then i do it again right and therefore, this is a non-parallel operation."
    },
    {
      "start_time": 7510.62,
      "end_time": 7534.38,
      "content": " And this is one where you have to, you know, in the case of pre-fill or prompt, you pull the whole model in and you calculate 20,000 tokens at once, right? So these are features that APIs are shipping, which is like prompt caching, pre-filling, because you can drive prices down and you can make API as much faster. If you know you're going to keep, if you run a business and you're going to keep passing the same initial content to Cloud's API,"
    },
    {
      "start_time": 7534.38,
      "end_time": 7556.17,
      "content": " you can load that in to the Anthropic API and always keep it there. But it's very different than we're kind of leading to the reasoning models, which we showed this example earlier and read some of this kind of mumbling stuff. And what happens is that the output context length is so much higher. And I mean, I learned a lot about this from Dylan's work, which is essentially as the output length gets higher,"
    },
    {
      "start_time": 7556.17,
      "end_time": 7579.61,
      "content": " you're writing this quadratic in terms of memory used. And then the GPUs that we have effectively, you're going to run out of memory, and they're all trying to serve multiple requests at once. So doing this batch processing where not all of the prompts are exactly the same, really complex handling. And then as context links gets longer, there's this link, I think you call it critical batch size, where your ability to serve"
    },
    {
      "start_time": 7582.95,
      "end_time": 7599.65,
      "content": " more users, so how much you can parallelize your inference, implements because of this long contract. So your memory usage is going way up with these reasoning models, and you still have a lot of users. So effectively, the cost to serve multiplies by a ton. And we're looking at a plot when the x-axis is sequence length,"
    },
    {
      "start_time": 7599.89,
      "end_time": 7620.83,
      "content": " i.e. how many tokens are being generated slash prompt, right? So if I put in a book, that's a million tokens, right? But, you know, if I put in, you know, the sky is blue, then that's like six tokens or whatever. We should say that what we're calling reasoning and chain of thought is extending this sequence length. It's mostly output. So before, you know, three months ago, whenever 01 launched, all of the use cases"
    },
    {
      "start_time": 7620.83,
      "end_time": 7644.71,
      "content": " for long context length where like, let me put a ton of documents in and then get an answer out, right? And it's a single, you know, pre-fill, compute a lot in parallel, and then output a little bit. Now, with reasoning and agents, this is a very different idea, right? Now, instead, I might only have like, hey, do this task, or I might have all these documents. But at the end of the day, the model is not just like producing a little bit, right? It's producing tons of information."
    },
    {
      "start_time": 7644.89,
      "end_time": 7666.03,
      "content": " This chain of thousands of tokens to go and go and go and go. And so the sequence length is effectively that, that you know, if it's generated 10,000 tokens, it's 10,000 sequence length, right? Or plus whatever you input it in the prompt. And so what this chart is showing, and it's a logarithmic chart, right, is, you know, as you go from 1K to 4K or 4K to 16K,"
    },
    {
      "start_time": 7666.15,
      "end_time": 7686.15,
      "content": " the memory requirements grow so fast for your KV cache that you end up not being able to run a certain number of your sequence length is capped or the number of users. Let's say the model. So this is showing for a 405B model and batch size 64. Lama 3.145B. Yeah, and batch size is crucial too."
    },
    {
      "start_time": 7686.31,
      "end_time": 7706.85,
      "content": " Essentially, you want to have higher batch size to parallelize parallel your throughput 64 different users at once right yeah and therefore your serving costs are lower, right? Because the server costs the same, right? This is eight H-100s, roughly $2 an hour per GPU. That's $16 an hour, right? That is like somewhat of a fixed cost. You can do things to make it lower, of course. But like, it's like $16 an hour."
    },
    {
      "start_time": 7706.85,
      "end_time": 7728.42,
      "content": " Now, how many users can you serve? How many tokens can you generate? And then you divide the two, and that's your cost, right? And so with reasoning models, this is where a lot of the complexity comes about and why memory is so important. Because if you have limited amounts of memory, then you can't serve so many users. If you have limited amounts of memory, your serving speeds get lower, right? And so your costs get a lot, lot worse."
    },
    {
      "start_time": 7728.92,
      "end_time": 7750.84,
      "content": " Because all of a sudden, if I was used to, hey, on the $16 an hour server, I'm serving Lama 405B, or if I'm serving, you know, deep seek v3, and it's all chat style applications, i.e. we're just chit-chatting. The sequence sensor, a thousand, a few thousand, right? You know, when you use the language model, it's a few thousand context lengths most of times. Sometimes you're dropping a big document, but then you process it, you get your answer, you throw it away, right?"
    },
    {
      "start_time": 7750.88,
      "end_time": 7776.28,
      "content": " You move on to the next thing, right? Whereas with reasoning, I'm now generating tens of thousands of tokens in sequence, right? And so this memory, this KV cache has to stay resident. And you have to keep loading it. You have to keep it, keep it in memory constantly. And now this butts out other users, right? If there's now a reasoning task, right, and the model is capable of reasoning, then all of a sudden, that memory pressure means that I can't serve as many users simultaneously."
    },
    {
      "start_time": 7776.28,
      "end_time": 7800.88,
      "content": " Let's go into deep seek again. So we're in the post deep seek R1 time, I think, and there's two sides to this market watching how hard it is to serve it. On one side, we're going to talk about deep seek themselves. They now have a chat app that got to number one on the app store. Disclaimer, number one on the app store is measured by velocity. So it's not necessarily saying that more people have the deep seek app than chat GPT app. But it is still remarkable."
    },
    {
      "start_time": 7800.88,
      "end_time": 7825.23,
      "content": " Claude has never hit the number one in the App Store, even though everyone in San Francisco is like, oh my God, you got to use Cloud. Don't use chat. GPT. So DeepSeek hit this. They also launched an API product recently where you can ping their API and get these super long responses for R1 out. At the same time as these are out, we'll get to what's happened to them. Because the model weights for deep seek R1 are openly available and the license is very friendly, the MIT license"
    },
    {
      "start_time": 7825.23,
      "end_time": 7846.87,
      "content": " commercially available. All of these mid-sized companies and big companies are trying to be first to serve R1 to their users. We were trying to evaluate R1 because we have really similar research going on. We released the model and we're trying to compare to it. And out of all the companies that are quote unquote serving R1, and they're doing it at prices that are way higher"
    },
    {
      "start_time": 7846.87,
      "end_time": 7868.01,
      "content": " than the deep seek API. Most of them barely work and the throughput is really low. To give context, right? Everyone, one of the parts of freaking this out was like China reached capabilities. The other aspect is they did it so cheap, right? And the so cheap, we kind of talked about on the training side, why it was so cheap. I was talk about why it was so cheap. I was talk about why it's so cheap on the inference. It works well and it's cheap. Why is R1 so damn"
    },
    {
      "start_time": 7868.01,
      "end_time": 7891.22,
      "content": " cheap? So I think there's a couple are one so damn cheap. So I think there's a couple factors here, right? One is that they do have model architecture innovations, right? This MLA, this new attention that they've done, is different than the attention from attention is all you need, the transformer attention, right? Now, others have already innovated. There's a lot of work like MQA, GQA, local, global, all these different innovations that try to bend the curve, right?"
    },
    {
      "start_time": 7891.28,
      "end_time": 7912.52,
      "content": " It's still quadratic, but the constant is now smaller, right? Related to our previous discussion this multi-head latent attention can save about 80 to 90% in memory from the intention mechanism, which helps especially at long contexts. It's 80 to 90% versus the original, but then versus what people are actually doing. It's still an innovation. This 80 to 90% doesn't say that the whole model"
    },
    {
      "start_time": 7912.52,
      "end_time": 7932.62,
      "content": " is 80 to 90% cheaper, just as one part of it. Well, and not just that, right? Like, other people have implemented techniques like local, global and sliding window and GQMQA. But anyways, like deepSeek has their attention mechanism is a true architectural innovation. They did tons of experimentation. And this dramatically reduces the memory pressure. It's still there, right? It's still a quadrat. It's still a tension. It's still quadratic."
    },
    {
      "start_time": 7933.06,
      "end_time": 7958.28,
      "content": " It's just dramatically reduced it relative to prior forms. That's the memory pressure. I should say, in case people don't know, R1 is 27 times cheaper than 01. We think that Open AI had a large margin built in. Okay, so that's one- There's multiple factors. We should break down the factors, I think. It's two bucks per million token output for R1 and $60 per million token output for 01."
    },
    {
      "start_time": 7960.28,
      "end_time": 7979.04,
      "content": " Yeah, let's look at this. So I think this is very important, right? Open AI is, you know, that drastic gap between DeepSeek and pricing. But DeepSeek is offering the same model because they open weights to everyone else for a very similar, like much lower price than what others are able to serve it for."
    },
    {
      "start_time": 7979.04,
      "end_time": 8002.55,
      "content": " Right. So there's there's two factors here, right? Their model is cheaper, right? It is 27 times cheaper. Well, I don't remember the number exactly off top of my head. So we're looking at a graphic that's showing different places serving V3, deep seek V3, which is similar to Deepseek R1, and there's a vast difference in serving cost. And serving costs,"
    },
    {
      "start_time": 8002.55,
      "end_time": 8024.37,
      "content": " and what explains that difference? And so like part of it is open AI has a fantastic margin, right? They're serving, when they're doing inference, their gross margins are north of 75%. Right. So that's that's a four to five X factor right there of the cost difference is that open eyes just making crazy amounts of money because they're the only one with the capability. Do they need that money? Are they using for R&D? They're losing money, obviously, as a company,"
    },
    {
      "start_time": 8024.37,
      "end_time": 8047.19,
      "content": " because they spend so much on training, right? So the inference itself is a very high margin, but it doesn't recoup the cost of everything else they're doing. Okay. So yes, they need that money because the revenue and margins pay for continuing to build the next thing, right? As long as I'm raising more money. So the suggestion is that deep seek is like really bleeding out money. Well, so here's one thing, right? We'll get to this in a second, but like, deep seek doesn't have any capacity to actually serve the model."
    },
    {
      "start_time": 8047.27,
      "end_time": 8067.29,
      "content": " They stopped signups. The ability to use it is like non-existent now, right? For most people, because so many people are trying to use it, they just don't have the GPUs to serve it. OpenAIs hundreds of thousands of GPUs between them and Microsoft to serve their models. DeepSeek has a factor of much lower, right? Even if you believe our research, which is 50,000 GPUs,"
    },
    {
      "start_time": 8067.29,
      "end_time": 8091.54,
      "content": " and a portion of those are for research, portion of those are for the hedge fund, right? They still have nowhere close to the GPU volumes and capacity to serve the model, right, at scale. So it is cheaper. A part of that is opening a ton of money. Is DeepSeek making money on their API? Unknown. is deep seek making money on their appi unknown i don't actually think so um and part of that is this chart right look at all the other providers, right? Together AI, Fireworks AI are very high-end companies, right?"
    },
    {
      "start_time": 8091.78,
      "end_time": 8111.9,
      "content": " XMETA, Together AI is Tree Dow and the inventor of like flash attention, right, which is a huge efficiency technique, right? They're very efficient, good companies. And they're certain, and I do know those companies make money, right? Not tons of money on inference, but they make money. And so they're serving at like a five to seven X difference and cost, right? And so, you know, now when you, when you equate, okay, open eyes"
    },
    {
      "start_time": 8111.9,
      "end_time": 8132.06,
      "content": " making tons of money, that's like a 5x difference. And the companies that are trying to make money for this model is like a 5x difference. There is still a gap, right? There's still a gap. And that is just DeepSeek being really freaking good, right? The model architecture, MLA, the way they did the M-O-E, all these things. There is like legitimate just efficiency differences. All their, all their low-level libraries that we talked about in training, some of them probably translate to inference"
    },
    {
      "start_time": 8132.06,
      "end_time": 8155.28,
      "content": " and those weren't released. So we may go a bit into conspiracy line, but is it possible the Chinese government is subsidizing Deepseek? I actually don't think they are. I think when you look at the Chinese labs, there's, there's Huawei has a lab, Moonshot AI. There's a couple other labs out there that are really close with the government. And then there's labs like Alibaba and DeepSeek, which are not close with the government."
    },
    {
      "start_time": 8155.28,
      "end_time": 8176.28,
      "content": " And we talked about this, the CEO, this, this, this like reverent figure who's like quite different, who has like sounds awesome. Very different like viewpoints based on the Chinese interviews that are translated, then what the CCP might necessarily want. Now, to be clear, right, does he have a loss leader because he can fund it through his hedge fund? Yeah, sure. So the hedge fund might be subsidizing it."
    },
    {
      "start_time": 8176.28,
      "end_time": 8198.22,
      "content": " Yes. I mean, they absolutely did, right? Because Deep Sea has not raised much money. They're now trying to raise around in China, but they have not raised money historically. It's all just been funded by the hedge fund. And he owns like over half the company, like 50, 60% of the company is owned by him. Some of the interviews, there's a discussion on how like doing this is a recruiting tool. You see this at the American companies too. It's like having GPUs recruiting tool, being at the cutting edge of"
    },
    {
      "start_time": 8198.22,
      "end_time": 8220.48,
      "content": " AI recruiting tool. Open sourcing. Open sourcing. Meta's got so much talent. They were so far behind and they got so much talent. Yeah. Because they just open source stuff. More conspiracy thoughts. Is it possible since they're a hedge fund? more conspiracy thoughts. Is it possible since they're a hedge fund that they timed everything with this release and the pricing and they have they shorted in vitiya stock and stock of u.sia companies"
    },
    {
      "start_time": 8220.48,
      "end_time": 8241.85,
      "content": " and released it with Stargate, like just perfect timing to be able to make money. Like they released it on an inauguration day. They know the international what is on the international calendar, but I mean, I don't expect them to. If you listen to their motivations for AI, it's like, no, if you release, they released V3 on like December 26th."
    },
    {
      "start_time": 8241.95,
      "end_time": 8264.69,
      "content": " Like who releases the day? No one looks, right? They released the papers before this, right? The V3 paper and the R1 paper. So people have been looking at it and been like, wow. And then they just released the R1 model. I think they're just shipping as fast as they can and like who cares about christmas who cares about you know get it out before chinese new year right obviously which just happened um i don't think they actually were like timing the market or trying to make the biggest splash"
    },
    {
      "start_time": 8264.69,
      "end_time": 8286.65,
      "content": " possible. I think they're just like shipping. I think that's one of their big advantages. We know that a lot of the American companies are very invested in safety, and that is the central culture of a place like Anthropic. And I think Anthropic sounds like a wonderful place to work. But if safety is your number one goal, it takes way longer to get artifacts out. That's why Anthropic is not open sourcing things."
    },
    {
      "start_time": 8286.65,
      "end_time": 8307.95,
      "content": " That's their claims. But there's reviews internally. Anthropic mentions things to international governments. There's been news of how Anthropic has done pre-release testing with the UKAA Safety Institute. All of these things add inertia to the process of getting things out. And we're on this trend line where progress is very high. So if you reduce the time from when your model is done training,"
    },
    {
      "start_time": 8307.95,
      "end_time": 8329.73,
      "content": " you run a vales that's good, you want to get it out as soon as possible to maximize the perceived quality of your outputs. Deep Seek does this so well. Dario explicitly said Claude 3.5 Sonnet was trained like nine months or a year ago. Nine to ten months ago nine to ten months ago and i think it took them another like handful of months to release it right so it's like there is there is a significant gap here, right?"
    },
    {
      "start_time": 8329.73,
      "end_time": 8350.45,
      "content": " And especially with reasoning models, the word in the San Francisco street is that like Anthropic has a better model than O3, right? And they won't release it. Why? Because chains of thought are scary, right? And they are legitimately scary, right? If you look at R1, it flips back and forth between Chinese and English, sometimes it's gibberish, and then the right answer comes out. and like for you and I it's like great"
    },
    {
      "start_time": 8350.45,
      "end_time": 8373.01,
      "content": " great I mean like people are infatuated right there like you're telling me this is a high value thing and it works and it's doing this it's amazing i mean i mean you you talked about that uh sort of like uh chain of thought for that philosophical thing, which is not something they trained to it to be philosophically good. It's just sort of an artifact of the chain of thought training. It did. But like that's super important in that like can I inspect your mind"
    },
    {
      "start_time": 8373.01,
      "end_time": 8397.96,
      "content": " and what you're thinking right now no and so I don't know if you're lying to my face. And chain of thought models are that way, right? Like, this is a true quote unquote risk between, you know, a chat application where, hey, I asked the model to say, you know, bad words or whatever or how to how to make anthrax. And it tells me, that's unsafe, sure, but that's something I can get out relatively easily. What if I tell the AI to do a task, and then it does the task all of a sudden randomly in a way that I don't"
    },
    {
      "start_time": 8397.96,
      "end_time": 8426.43,
      "content": " want it. Right. And now that has like much more task versus like response is very different. Right. So the bar for safety is much higher. At least this is Anthropics case, right? Like for deep seek, they're like ship, right so i mean the bar for safety is probably lowered a bit because of deep seek i mean there's parallels here to the space race. The reason the Soviets probably put a man in space first is because their approach to safety was uh the bar for safety was lower and they"
    },
    {
      "start_time": 8426.43,
      "end_time": 8450.19,
      "content": " they killed that dog right and all these things right so it's like a less risk averse uh than the then the the u.s based program and there's parallels here. But, you know, there's probably going to be downward pressure on that safety bar for the U.S. companies, right? And this is something that Dario talks about. That's the situation that Dario wants to avoid. Is Dario talks to about the difference between race to the bottom and race to the top."
    },
    {
      "start_time": 8450.61,
      "end_time": 8471.61,
      "content": " And the race to the top is where there's a very high standard on safety. There's a very high standard on your model forms and certain crucial evaluations and when certain companies are really good to it, they will converge. This is the idea. And ultimately, AI is not confined to one nationality or to one like set of morals for what it should mean."
    },
    {
      "start_time": 8471.61,
      "end_time": 8493.37,
      "content": " And there's a lot of arguments on like, should we stop open sourcing models? And if the US stops, it's pretty clear. I mean, it's way easier to see now at DeepSeek that a different international body will be the one that builds it. We talk about the cost of training. DeepSeek has this shocking $5 million number. Think about how many entities in the world can afford 100 times that to have the best"
    },
    {
      "start_time": 8493.37,
      "end_time": 8514.61,
      "content": " open source model that people use in the world. And it's like, it's a scary reality, which is that these open models are probably going to keep coming for the time being, whether or not we want to stop them. And it is like stopping them might make it even worse and harder to prepare, but it just means that the preparation and understanding what AI can do is just so much more important."
    },
    {
      "start_time": 8514.61,
      "end_time": 8535.84,
      "content": " That's why I'm here at the end of the day, but it's like, letting that sink into people, especially not in AI, is that this is coming. There are some structural things in a global interconnected world that you have to accept. Yeah, you mentioned Ysumby, something that Mark Zuckerberg mentioned on the earnings call."
    },
    {
      "start_time": 8535.84,
      "end_time": 8556.88,
      "content": " He said that I think in light of some of the recent news, the new competitor, Deep Seek from China, I think it's one of the things that we're talking about is there's going to be an open source standard globally. And I think for our kind of national advantage, it's important that it's an American standard. So we take that seriously. We want to build the AI system that people around the world they're using. And I think that if anything,"
    },
    {
      "start_time": 8559.3,
      "end_time": 8580.28,
      "content": " some of the recent news has only strengthened our conviction that this is the right thing to be focused on. So, yeah, open sourcing. Yeah, Mark Zuckerberg is not new to having American values and how he presents his company's trajectory. I think their products have long since been banned in China, and I respect the saying it directly. And there's an interesting aspect of just because it's open-wates or open-source doesn't mean"
    },
    {
      "start_time": 8580.28,
      "end_time": 8600.34,
      "content": " it can't be subverted, right? There have been many open source software bugs that have been like, you know, for example, there was a Linux bug that was found after like 10 years, which was clearly a back door, because somebody was like, why is this taking, you know, half a second to the recent one. Like, why is it taking half a second to load? And it was like, oh, crap, there's a back door here. That's why. Right?"
    },
    {
      "start_time": 8600.38,
      "end_time": 8621.71,
      "content": " And it's like, this is very much possible with AI models right um today you know the the alignment of these models is very clear, right? Like, I'm not going to say, you know, bad words. I'm not going to teach you how to make anthrax. I'm not going to talk about Tiananmen Square. I'm not going to, you know, things like, I'm going to say Taiwan is part of, you know, is just in Eastern province, right?"
    },
    {
      "start_time": 8621.71,
      "end_time": 8642.55,
      "content": " Like, you know, all these things are like, depending on who you are, what you align, what, you know, whether, you know, even like XAI is aligned a certain way, right? You know, they might be, it's not aligned in the like woke sense. It's not aligned in like pro-China sense, but there is certain things that are imbued within the model. Now when you release this publicly in an instruct model that's open weights, this can then proliferate, right?"
    },
    {
      "start_time": 8642.55,
      "end_time": 8665.15,
      "content": " But as these systems get more and more capable, what you can embed deep down in the model is not as clear, right? Um, and so there are, that is like one of the big fears is like, if a, an American model or a Chinese model is the top model, right? You're going to embed things that are unclear. And it could be unintentional too, right? Like British English is dead because american l l l ms won right and the internet is american"
    },
    {
      "start_time": 8665.15,
      "end_time": 8686.79,
      "content": " and therefore like color is spelled the way american spell it. Right? And this is just strong words right now. This is just like this is just the factual nature of the LLLF. The right way to say like carpet with each be. The English is the hottest programming language, and that English is defined by a bunch of companies that primarily are in San Francisco. The right way to spell optimization is with a Z, just in case you're probably."
    },
    {
      "start_time": 8688.81,
      "end_time": 8709.69,
      "content": " I think it's an S and British English. It is. Taking it is something silly, right? Like something as silly as the spelling, like which British and English, you know, Brits and Americans will like laugh about probably, right? I don't think we care that much. But like, you know, some people will, but like, this can, this can boil down into like very, very important topics. Like, hey, you know, subverting people, right?"
    },
    {
      "start_time": 8710.25,
      "end_time": 8731.19,
      "content": " You know, chatbots, right? Character AI has shown that they can like, you know, talk to kids and adults and like, you know, talk to kids and adults and like it will, like, you people feel a certain way, right? And that's unintentional alignment. But like, what happens when there's intentional alignment deep down on the open source standard? It's a backdoor today for like Linux, right, that we discover or some encryption system, right, China uses different"
    },
    {
      "start_time": 8731.19,
      "end_time": 8752.61,
      "content": " encryption than NIST defines the US NIST because there's clearly, at least they think there's back doors in it, right? What happens when the models are backdoors not just to computer systems, but to our minds. Yeah, they're cultural black doors. The thing that amplifies the relevance of culture with language models is that we are used to this mode of interacting with people"
    },
    {
      "start_time": 8752.61,
      "end_time": 8773.05,
      "content": " in back and forth conversation. And we have now have a super, a very powerful computer system that slots into a social context they were used to, which makes people very, we don't know the extent that which people can be impacted by that. So there could be, this is an actual concern"
    },
    {
      "start_time": 8773.05,
      "end_time": 8798.72,
      "content": " with a Chinese company that is providing open weights models is that there could be some secret Chinese government sort of requirement for these models to have a certain kind of backdoor to have some kind of thing where... I don't necessarily think it'll be a backdoor, right? Because once it's open weights, it doesn't like phone home. It's more about, like, if it recognizes a certain system it could like if now it could be a backdoor in the"
    },
    {
      "start_time": 8798.72,
      "end_time": 8819.28,
      "content": " sense of like hey if you're building a software uh you know something something in software, all of a sudden it's a software agent, oh, program this backdoor that only we know about. Or it could be like subvert the mind to think that like X, Y, Z opinion is the correct one. Anthropic has research on this where they show that if you put different phrases, certain phrases in at pre-training, you can then elicit"
    },
    {
      "start_time": 8819.28,
      "end_time": 8841.14,
      "content": " different behavior when you're actually using the model because they've like poisoned the pre-training data. I don't think like, as of now, I don't think anybody in a production system is trying to do anything like this. I think it's mostly Anthropics are doing very direct work and mostly just subtle things. We don't know what these models are going to how they are going to generate tokens,"
    },
    {
      "start_time": 8841.38,
      "end_time": 8870.21,
      "content": " what information they're going to represent and what the complex representations they have are. Well, one of the, we're talking about Anthropic, which is generally just permeated with like good humans trying to do good in the world. I don't, we just don't know do good in the world. We just don't know of any labs. This would be done in the military context that are explicitly trained to, okay, how can we, the front door looks like a happy NLM,"
    },
    {
      "start_time": 8870.71,
      "end_time": 8899.04,
      "content": " but underneath, it's a thing that will over time do the maximum amount of damage to our quote unquote enemies. There's this very good quote from Sam Altman who, you know, he can be a hypebeast sometime. But one of the things he said, and I think I agree is that superhuman persuasion will happen before superhuman intelligence. Right? And if that's the case, then these things before, before we get this AGIASI stuff, we can embed superhuman persuasion towards our ideal or whatever"
    },
    {
      "start_time": 8899.04,
      "end_time": 8920.44,
      "content": " the ideal of the model maker is. And again, like today, I truly don't believe Deep Seek has done this, right? But it is a sign of, like, what could happen. So one of the dystopian worlds is described by Brave New World. So we could just be stuck scrolling Instagram looking at cute puppies or worse, and then talking to bots that are giving us a narrative"
    },
    {
      "start_time": 8920.44,
      "end_time": 8950.61,
      "content": " and we completely get lost in that world that's controlled by somebody else, versus thinking independently. And that's, that's a major concern as we rely more and more on these kinds of systems i mean we've already seen that with recommendation systems yeah recommendation systems hack the dopamine-induced reward circuit, but the brain is a lot more complicated and what other sort of circuits, quote-unquote, feedback loops in your brain, can you hack slash subvert in ways like recommendation systems are purely just trying to do, you know, increase time and ads and etc."
    },
    {
      "start_time": 8950.61,
      "end_time": 8972.11,
      "content": " But there's so many more goals that can be achieved through these complicated models. There's no reason in some number of years that you can't train a language model to maximize time spent on a chat app. Like right now they are trained. I mean, is that not what character AI has done? Their time per session is like two hours. Yeah, character AI very likely could be optimizing this."
    },
    {
      "start_time": 8972.11,
      "end_time": 8992.65,
      "content": " Where it's like the way that this data is collected is naive, whereas you're presented a few options and you choose them, but there's, that's not the only way that these models are gonna be trained. It's naive stuff like talk to an anime girl, but like it can be like, yeah, this is a risk, right? Like, it's a bit of a cliche thing to say, but I've over the past year I had a few stretches of time where I didn't"
    },
    {
      "start_time": 8992.65,
      "end_time": 9014.55,
      "content": " use social media or the internet at all and just read books and was out in nature and it clearly has an effect on the mind where like it changed I feel like I'm returning of course I was raised before the internet really took off but I'm returning to someone. I know where you're going. I mean, you can see it physiologically."
    },
    {
      "start_time": 9014.55,
      "end_time": 9035.3,
      "content": " Like, I take three days if I'm like backpacking or something and you you're your literal like you're breaking down addiction cycles. I feel like I'm more in control of my mind. There feels like a sovereignty of intelligence that's happening when I'm disconnected from the internet. I think the more I use the internet and social media, the more other people"
    },
    {
      "start_time": 9035.3,
      "end_time": 9058.48,
      "content": " are controlling my mind. That's definitely a feeling. And then in the future that would be not other people but algorithms. Or other people but algorithms, or other people presented to me via algorithms. There, I mean, there are already tons of AI bots on the internet. And every so, right now it's not frequent, but every so often I have replied to one, and they're instantly replies. I'm like, crap out of the bot. And that is just going to become more common. Like, they're going to get good."
    },
    {
      "start_time": 9058.48,
      "end_time": 9080.96,
      "content": " One of the hilarious things about technology over its history is that the illicit adult entertainment industry has always adopted technologies first, right? Whether it was like video streaming, um, to like where, you know, there's now the like sort of like independent adult illicit content creators who have their, you know, subscription pages. And there they actually heavily utilize, you know,"
    },
    {
      "start_time": 9080.96,
      "end_time": 9101.32,
      "content": " generative AI has already been like diffusion models and all that is huge there. But now these like these subscription based individual creators do use bots to approximate themselves and chat with their, you know, people pay a lot for it. And people pay a lot, right? A lot of times it's them, but a lot of, there are agencies that do this for these creators and do it like on a mass scale."
    },
    {
      "start_time": 9101.32,
      "end_time": 9122.14,
      "content": " So the largest creators are like able to talk to hundreds or thousands of people at a time because of these bots. And so it's already being used there. Obviously, you know, like video streaming and and other technologies have come there first, it's going to come to the rest of society too. There's a general concern that models get censored by the companies that deploy them."
    },
    {
      "start_time": 9122.84,
      "end_time": 9145.7,
      "content": " So one case, we've seen that, and maybe censorship is one word, alignment, alignment, maybe via RLHF or some other way is another word. So we saw that with Black Nazi Image Generation with Gemini. As you mentioned, we also see that with Chinese models refusing to answer what happened."
    },
    {
      "start_time": 9146.74,
      "end_time": 9165.94,
      "content": " In June 4th, 1989 at Tiananmen Square. So how can this be avoided? And maybe can you just in general talk about how this happens and how can it be avoided? You give multiple examples. There's probably a few things to keep in mind here."
    },
    {
      "start_time": 9165.94,
      "end_time": 9190.61,
      "content": " One is the kind of Tiananmen Square factual knowledge, like, did think, like, how does that get embedded into the models? Two is the Gemini, what you called the Black Nazi incident, which is when Gemini, as a system, had this extra thing put into it that dramatically changed the behavior. And then three is what most people would call general alignment, RLHF post-training."
    },
    {
      "start_time": 9190.61,
      "end_time": 9212.49,
      "content": " Each of these have very different scopes in how they are applied. In order to do, if you're just to look at the model weights, in order to audit specific facts is extremely hard because you have to chrome through the pre-training data and look at all of this and then that's terabytes of files and look for very specific words or hints of the words."
    },
    {
      "start_time": 9212.49,
      "end_time": 9238.52,
      "content": " So I guess one way to say is that you can insert censorship or alignment at various stages in the pipeline. And what you refer to now is at the very beginning of the data selection. So if you want to get rid of facts in a model, you have to do it at every stage. You have to do it at the pre-training. So most people think that pre-training is where most of the knowledge is put into the model and then you can elicit and move that in different ways, whether through post-training or whether through systems afterwards."
    },
    {
      "start_time": 9238.78,
      "end_time": 9262.5,
      "content": " This is where the whole like hacking models comes from, right? Like, GPT will not tell you how to make anthrax, but if you try really, really hard, you can eventually get to tell you about anthrax. Because they didn't filter it from the pre-training data set, right? But by the way, removing facts has such an ominous dark feel to it. Almost think it's practically impossible. Because you effectively have to remove them from the internet."
    },
    {
      "start_time": 9262.5,
      "end_time": 9284.54,
      "content": " You're taking on a... Did they remove the m-thin thing from the subreditsits, the MMM, it gets filtered out. Right. So you have quality filters, which are small language models that look at a document and tell you like, how good is this text? Is it close to a Wikipedia article, which is a good thing that we want language models to be able to imitate. So couldn't you do a small language model that"
    },
    {
      "start_time": 9284.54,
      "end_time": 9304.56,
      "content": " Fulteschild mentions at Tiananmen Square in the data? Yes, but is it going to catch wordplay or encoded language of the same thing? People have been meaning on like games and other stuff, how to like say things that don't say Tiananmen Square. But or like, yeah, so there's always like different ways to do it. There's, hey, the internet as a whole does tend to just have a slight"
    },
    {
      "start_time": 9304.56,
      "end_time": 9324.82,
      "content": " left bias, right? Because it's always been richer, more affluent, younger people on the internet relative to the rest of the population. So there is already inherently a slight left bias on the internet. And so how do you filter things that are this complicated, right? Is it like, and some of these can be like, you know, factual, non-factual, but like Tiananmen Square is"
    },
    {
      "start_time": 9324.82,
      "end_time": 9345.9,
      "content": " obviously the example of a factual, but it gets a lot harder when you're talking about aligning to a ideal, right? And so Grock, for example, right? Elon's tried really hard to make the model not be super PC and woke, but the best way to do pre-training is to throw the whole freaking internet at it, right? And then later figure out, but then at the end of the day, the model at its"
    },
    {
      "start_time": 9345.9,
      "end_time": 9370.11,
      "content": " core now still has some of these ideals, right? You still ingested Reddit slash R slash politics, which is probably the largest political discussion board on the world that's freely available to scrape. And guess what? That's left leaning, right? And so, you know, there are some aspects like that you just can't censor unless you try really, really, really, really hard. So the base model will always have some TDS Trump Drangement syndrome"
    },
    {
      "start_time": 9370.11,
      "end_time": 9392.21,
      "content": " because it's trained so much. It'll have the ability to express it. But what if, what if you, there's a wide representation in the data. This is what happens. It's like a lot of modern, what is called post-training it's a series of techniques to get the model on rails of a really specific behavior. And I mean, it's like you can, you also have the ingested data of like Twitter or like"
    },
    {
      "start_time": 9392.21,
      "end_time": 9412.53,
      "content": " Reddit slash R slash the Donald, which is like also super pro-Trump, right? And then you have like fascist subredits or like you have communist subredits. So the model in pre-training ingests everything. It has no worldview. Now, it does have like some, some skew because more of the text is skewed a certain way, which is general, like slight left, like, but also like, you know,"
    },
    {
      "start_time": 9412.53,
      "end_time": 9432.99,
      "content": " somewhat like, you know, intellectual, somewhat like, you know, it's just like the general internet is a certain way and then and then as as as nathan's about to describe eloquently right like you can you can elicit certain things out. And there's a lot of history here. So we can go through multiple examples and what happened. Lama 2 was a launch that the phrase like too much RLHF or like too much safety was a lot."
    },
    {
      "start_time": 9433.23,
      "end_time": 9454.93,
      "content": " It's just that was the whole narrative after Lama 2's chat models released. And the examples are sorts of things like you would ask Lama 2 chat, how do you kill a Python process? And it would say I can't talk about killing because that's a bad thing. And anyone that is trying to design an AI model will probably agree that that's just like a model you messed up a bit on the training there I don't think"
    },
    {
      "start_time": 9454.93,
      "end_time": 9476.23,
      "content": " they meant to do this but this was in the model weight. So this is not, it didn't necessarily be, there's things called system prompts, which are when you're querying a model, it's a piece of text that is shown to the model, but not to the user. So a fun example is your system prompt could be talk like a pirate. So no matter what the user says to the model, it'll respond like a pirate."
    },
    {
      "start_time": 9476.23,
      "end_time": 9498.19,
      "content": " In practice, what they are is you are a helpful assistant. You should break down problems. If you don't know about something, don't tell them your date cut off is this, today's date is this. It's a lot of really useful context for how can you answer a question well. Anathropic publishes their system problem type. But I think is great. And there's a lot of research that goes into this and one of your previous guests, Amanda Askell, is probably the"
    },
    {
      "start_time": 9498.19,
      "end_time": 9518.27,
      "content": " most knowledgeable person, at least in the combination of execution and sharing. She is the person that should talk about system prompts and character of models. Yeah, and then people should read the system prompts because you're like trying to nudge sometimes through extreme politeness, the model to be a certain way. And you could use this for bad things."
    },
    {
      "start_time": 9518.27,
      "end_time": 9545.8,
      "content": " We've done tests, which is, what if I tell the model to be a dumb model, like which evaluation scores go down? And it's like, we'll have this behavior where it could sometimes say, oh, I'm supposed to be dumb. And sometimes it doesn't affect math abilities as much, but something like if you're trying it's just the quality of a human judgment would draw through the forest let's go back to post-training specifically rlhf aroundama 2 was it was too much RELA, too much safety prioritization was"
    },
    {
      "start_time": 9545.8,
      "end_time": 9565.9,
      "content": " baked into the model weights. This makes you refuse things in a really annoying way for users. It's not great. It caused a lot of awareness to be attached to RLHF that it makes the models dumb. And it stigmatized the word. It did. In AI culture. And as the techniques have involved, that's no longer the case where all of these labs"
    },
    {
      "start_time": 9565.9,
      "end_time": 9593.17,
      "content": " have very fine-grained control over what they get out of the models through techniques like RLHF. Although, although different labs are definitely different levels, like on the, on one's end of the spectrum is Google and then like maybe opening eye does less and Anthropic does less and then like on the other end of the spectrum is like XAI, but they all have different forms of RLHF trying to make them a certain way. And like the important thing to say is that no matter how you want the model to behave,"
    },
    {
      "start_time": 9593.59,
      "end_time": 9616.07,
      "content": " these RLHF and preference tuning techniques also improve performance. So on things like math of vowels and code of vowels, there is something innate to these what is called contrastive loss functions. We could start to get into RL here. We don't really need to, but REL also boost performance on anything from a chat task to a math problem to a code problem. So it is becoming a much more useful tool to these labs."
    },
    {
      "start_time": 9616.07,
      "end_time": 9638.07,
      "content": " So this kind of takes us through the arc of we've talked about pre-training, hard to get rid of things. We've talked about post-training and how post-training, you can mess it up. It's a complex, multifaceted optimization with 10 to 100-person teams converging of one artifact. It's really easy to not do it perfectly. And then there's the third case, which is what we talked about Gemini. The thing that was about Gemini is this was a served"
    },
    {
      "start_time": 9638.07,
      "end_time": 9658.27,
      "content": " product where Google has their internal model weights, they've done all these processes that we talked about. And in the served product, what came out after this was that they had a prompt that they were rewriting user queries to boost diversity or something. And this just made it, the outputs were just blatantly wrong. It was some sort of organizational failure that had this prompt in that position,"
    },
    {
      "start_time": 9658.27,
      "end_time": 9679.29,
      "content": " and I think Google executives probably have owned this. I didn't pay that tension that detail. But it was just a mess up in execution that led to this ridiculous thing, but at the system level. The model weights might have been fine. So at the very end of the pipeline, there was a rewriting. To something like a system prompt. It was like the system prompt. It was like the system prompt or what is called an industry is like you rewrite"
    },
    {
      "start_time": 9679.29,
      "end_time": 9702.82,
      "content": " prompts. So especially for image models, if you're using Dolly or ChatTBT, you can generate you an image, you'll say, draw me a beautiful car. With these leading image models, they benefit from highly descriptive prompts. So what would happen is if you do that on chatypt, a language model behind the scenes will rewrite the prompt, say make this more descriptive, and then that is passed to the image model."
    },
    {
      "start_time": 9702.82,
      "end_time": 9725.76,
      "content": " So prompt rewriting is something that is used at multiple levels of industry, and it's used effectively for image models, and the Gemini example is just a failed execution. Big philosophical question here with the RLHF to generalize, where is human input, human in the loop, human data most useful at the current stage."
    },
    {
      "start_time": 9725.76,
      "end_time": 9754.37,
      "content": " For the past few years, the highest cost human data has been in these preferences, which is comparing, I would say highest cost and highest total usage. So a lot of money has gone to these pairwise comparisons where you have two model outputs and a human is comparing between the two of them. In earlier years, there was a lot of this instruction tuning data. So creating highly specific examples to something like a Reddit question to a domain that you care about."
    },
    {
      "start_time": 9754.37,
      "end_time": 9775.71,
      "content": " Language models use the struggle on math and code, so you would pay experts in math and code to come up with questions and write detailed answers that were used to train the models. Now it is the case that there are many model options that are way better than humans at writing detailed and eloquent answers for things like model and code. So they talked about this with the Lama 3 release,"
    },
    {
      "start_time": 9775.71,
      "end_time": 9799.03,
      "content": " where they switched to using Lama 3, 4, or 5B to write their answers for math and code. But they, in their paper talk about how they use extensive human preference data, which is something that they haven't gotten AIs to replace. There are other techniques in industry like constitutional AI, where you use human data for preferences and AI for preferences, and I expect the AI part to scale faster than the human part. But among the"
    },
    {
      "start_time": 9799.03,
      "end_time": 9821.03,
      "content": " research that we have access to is that it humans are in this kind of preference loop. So for as reasoning becomes bigger and bigger and bigger, as we said, where's the role of humans in that? It's even less prevalent. So the remarkable thing about these reasoning results, and especially the DeepSeek R1 paper, is this result that they call DeepSeek R10,"
    },
    {
      "start_time": 9821.37,
      "end_time": 9845.36,
      "content": " which is they took one of these pre-trained models. They took deep seek v3 base, and then they do this reinforcement learning optimization on verifiable questions or verifiable rewards for a lot of questions and a lot of training and these reasoning behaviors emerge naturally. So these things like wait, let me see, wait, let me check this. Oh, that might be a mistake, and they emerge from only having questions and answers."
    },
    {
      "start_time": 9845.36,
      "end_time": 9867.94,
      "content": " And when you're using the model, the part that you look at is the completion. So in this case, all of that just emerges from this large scale RL training. And that model, which the weights are available, has no human preferences added into the post-training. There are, the DeepSe seek R1 full model has some of this human preference tuning, this RLHF, after the reasoning stage."
    },
    {
      "start_time": 9867.94,
      "end_time": 9892.12,
      "content": " But the very remarkable thing is that you can get these reasoning behaviors, and it's very unlikely that there's humans writing out reasoning chains. It's very unlikely that they somehow hacked open AI and they got access to open AI O-1's reasoning chains. It's something about the pre-trained language models and this RL training, where you reward the model for getting the question right. And therefore, it's trying multiple solutions and it emerges this chain of thought"
    },
    {
      "start_time": 9892.68,
      "end_time": 9915.15,
      "content": " this might be a good place to mention the eloquent and the insightful tweet of the great and the powerful Andre Carpathie. I think he had a bunch of thoughts, but one of them, last thought, not sure if this is obvious, you know something profound is coming when you're saying it's not sure if it's obvious. There are two major types of learning in both children and in deep learning."
    },
    {
      "start_time": 9915.61,
      "end_time": 9936.77,
      "content": " There's one, imitation learning, watch and repeat, i.e. pre-training, supervised fine-tuning, and two, trial and error learning, reinforcement learning. My favorite simple example is AlphaGo. One is learning by imitating expert players. Two is reinforcement learning to win the game. Almost every single shocking result of deep learning,"
    },
    {
      "start_time": 9936.77,
      "end_time": 9958.07,
      "content": " and the source of all magic is always two. Two is significantly more powerful. Two is what surprises you. Two is when the paddle learns to hit the ball behind the blocks and break out. Two is when AlphaGo beats even Lee Sedal. And two is the aha moment when the deep seek or 01, et cetera,"
    },
    {
      "start_time": 9958.19,
      "end_time": 9986.28,
      "content": " discovers that it works well to reevaluate your assumptions, backtrack, try something else, et cetera. It's the solving strategies you see this model use in its chain of thought. It's how it goes back and forth thinking to itself. These thoughts are emergent, three exclamation points. And this is actually seriously incredible, impressive and new, and is publicly available and documented. The model could never learn this with"
    },
    {
      "start_time": 9986.28,
      "end_time": 10008.68,
      "content": " imitation, because the cognition of the model and the cognition of the human labeler is different. The human would never know to correctly annotate these kinds of solving strategies and what they should even look like. They have to be discovered during reinforcement learning as empirically statistically useful towards the final outcome. Anyway, the alpha zero sort of metaphor analogy here."
    },
    {
      "start_time": 10009.26,
      "end_time": 10032.82,
      "content": " Can you speak to that, the magic of the chain of thought that he's referring to? I think it's good to recap AlphaGo and Alpha Zero because it plays nicely with these analogies between imitation learning and learning from scratch. So AlphaGo, the beginning of the process was learning from humans where they had, they started the first, this is the first expert level go player or chess player in Deep Mind series of models where they had some human data."
    },
    {
      "start_time": 10033.48,
      "end_time": 10054.84,
      "content": " And then why it is called Alpha Zero is that there was zero human human data in the loop. And that changed to Alpha Zero made a model that was dramatically more powerful for deep mind. So this remove of the human prior, the human inductive bias makes the final system far more powerful. This we mentioned bitter lesson hours ago, and this is all aligned with this."
    },
    {
      "start_time": 10060.17,
      "end_time": 10080.07,
      "content": " And then there's been a lot of discussion in language models. This is not new. This goes back to the whole Q-star rumors, which if you piece together the pieces, is probably the start of Open AI figuring out its O1 stuff when last year in November the QStar rumors came out. There's a lot of intellectual drive to know when is something like this going to happen with language models"
    },
    {
      "start_time": 10080.07,
      "end_time": 10103.94,
      "content": " because we know these models are so powerful and we know it has been so successful in the past. And it is a reasonable analogy that this new type of reinforcement learning training for reasoning models is when the door is open to this. We don't yet have the equivalent of turn 37, which is the famous turn where the Deep Mines AI playing ghost, stumped Lee-Saddle completely."
    },
    {
      "start_time": 10103.94,
      "end_time": 10125.94,
      "content": " We don't have something that's that level of focal point, but that doesn't mean that the approach to technology is different and the impact of the general training. It's still incredibly new. What do you think that point would be? Will we'll be Move 37 for chain of thought, for reasoning? Scientific discovery. Like when you use this sort of reasoning problem and it's just something we fully don't expect. I think it's actually probably simpler than that."
    },
    {
      "start_time": 10125.94,
      "end_time": 10152.92,
      "content": " It's probably something related to computer user robotics rather than science discovery. Because the important aspect here is models take so much data to learn, they're not sample efficient, right? Trillions, they take the entire web, right? Over 10 trillion tokens to train on, right? This would take a human thousands of years to read, right? A human does not, and humans know most of the stuff,"
    },
    {
      "start_time": 10152.92,
      "end_time": 10177.27,
      "content": " a lot of stuff models know better than it, right? Humans are way, way, way more sample efficient. That is because of the self-play, right? How does a baby learn what its body is as it sticks its foot in its mouth and it says, oh, this is my body, right? It sticks its hand in its mouth and it calibrates its touch on its fingers with the most sensitive touch thing on its tongue, right? It's how babies learn. And it's just self-play over and over and over again."
    },
    {
      "start_time": 10177.27,
      "end_time": 10197.67,
      "content": " And now we have something that is similar to that, right, with these verifiable proofs, right? Whether it's a unit test and code or mathematical verifiable task generate many traces of reasoning, right? And keep branching them out, keep branching them out. And then check at the end, hey, which one actually has the right answer? Most of them are wrong, great."
    },
    {
      "start_time": 10197.67,
      "end_time": 10219.27,
      "content": " These are the few that are right. Maybe we use some sort of reward model outside of this to select even the best one to preference as well. But now you've started to get better and better at these benchmarks. And so you've seen over the last six months a skyrocketing in a lot of different benchmarks, right? All math and code benchmarks were pretty much solved, except for frontier math, which is designed to be almost questions that aren't practical to most people."
    },
    {
      "start_time": 10219.27,
      "end_time": 10242.4,
      "content": " Because they're like, their exam level open math problem type things. So it's like on the math problems that are somewhat reasonable, which is like somewhat complicated word problems or coding problems. It's just what Dylan is saying. So the thing here is that these are only with verifiable tasks. We earlier showed an example of the, you know, the really interesting, like what happens when Chana thought is to a non-verifiable thing."
    },
    {
      "start_time": 10242.74,
      "end_time": 10265.66,
      "content": " There's just like a human, you know, chatting, right? With the, you know, thinking about what's novel for humans, right? A unique thought. But this task and form of training only works when it's when it's verifiable. And from here, the thought is, okay, we can continue to scale this current training method by increasing the number of verifiable tasks. In math and coding, coding, coding probably has a lot more to go. Math has a lot less to go"
    },
    {
      "start_time": 10265.66,
      "end_time": 10287.7,
      "content": " in terms of what are verifiable things. Can I create a solver that then I generate trajectories toward or traces towards, reasoning traces towards, and then prune the ones that don't work and keep the ones that do work. Well, those are going to be solved pretty quickly, but even if you've solved math, you have not actually created intelligence, right? And so this is where I think the like, aha moment of computer use or robotics will come in"
    },
    {
      "start_time": 10287.7,
      "end_time": 10307.8,
      "content": " because now you have a sandbox or a playground that is infinitely verifiable, right? Did you, you know, messing around on the internet, there are so many actions that you can do that are verifiable. It'll start off with like log into a website, create an account, click a button here, blah, blah, blah. But it'll then get to the point where it's, hey, go do a task on tasker or whatever these"
    },
    {
      "start_time": 10307.8,
      "end_time": 10330.84,
      "content": " other, all these various task websites. Hey, go get hundreds of likes, right? And it's going to fail. It's going to spawn hundreds of accounts. It's going to fail on most of them. But this one got to a thousand. Great. Now you've reached the verifiable thing. And you just keep iterating this loop over and over. And that's when, and same with the robotics, right? That's where, you know, where you have an infinite playground of tasks like, hey, did I put the ball in the bucket all the way to like, oh, did I like build a car? Right. Like, you know, there's a whole"
    },
    {
      "start_time": 10330.84,
      "end_time": 10353.82,
      "content": " trajectory to speed run or, you know, what models can do. But at some point, I truly think that like, you know, will spawn models. And initially all the training will be in sandboxes. But then at some point, you know, the language model pre-training is going to be dwarfed by what is this reinforcement learning, you know, you'll pre-trained a multimodal model that can see, that can read, that can write, you know, blah, blah, blah, whatever, vision, audio, et cetera."
    },
    {
      "start_time": 10353.98,
      "end_time": 10377.91,
      "content": " But then you'll have it play in a sandbox infinitely and figure out, figure out math, figure out code, figure out navigating the web, figure out operating a robot arm, right? And then it'll learn so much and the aha moment I think will be when this is available to then create something that's not good, right? Like, oh, cool. Part of it was like figuring out how to use the web. Now all of a sudden, it's figured out really well how to just get hundreds of thousands of"
    },
    {
      "start_time": 10377.91,
      "end_time": 10400.41,
      "content": " followers that are real and real engagement on twitter because all of a sudden this is one of the things that are verifiable. And maybe not just engagement, but make money. Yes, of course. I mean, that could be the thing where almost fully automated, it makes, you know, $10 million by being an influencer selling a product, creating the product, like, and I'm not referring to like a hype product,"
    },
    {
      "start_time": 10400.53,
      "end_time": 10424.25,
      "content": " but an actual product or like, holy shit, this thing created a business. It's running it. It's the face of the business. That kind of thing. Or maybe number one song. Like it creates the whole infrastructure required to create the song to be the influence that represents that song and that kind of thing. It makes a lot of them. That could be the move. I mean, our culture respects money in that kind of way."
    },
    {
      "start_time": 10424.43,
      "end_time": 10444.73,
      "content": " And it's verifiable, right? It's verifiable. The bank account can't lie. Exactly. There's surprising evidence that once you set up the ways of collecting the verifiable domain that this can work. There's been a lot of research before this R1 on math problems, and they approach math with language models just by increasing the number of samples."
    },
    {
      "start_time": 10444.73,
      "end_time": 10471.64,
      "content": " So you can just try again and again and again. And you look at the amount of times that the language models get it right. And what we see is that even very bad models get it right sometimes. And the whole idea behind reinforcement learning is that you can learn from very sparse rewards. So it, it doesn't, the space of language and the space of tokens, whether you're generating language or tasks for a robot is so big that you might say that it's like, I mean, each, the tokenizer for"
    },
    {
      "start_time": 10471.64,
      "end_time": 10496.35,
      "content": " language model can be like 200,000 things. So at each step, it can sample from that big of a space. So if it can generate a bit of a signal that it can come onto, that's what the whole field of RL is around is learning from sparse rewards. And the same thing has played out in math where it's like very weak models that sometimes generate answers, where you see research already that you can boost their math scores. You can do this sort of RL training for math."
    },
    {
      "start_time": 10496.47,
      "end_time": 10517.97,
      "content": " It might not be as effective, but if you take a $1 billion parameter model, so something 600 times smaller than DeepSeek, you can boost its grade school math scores very directly with a small amount of this training. So it's not to say that this is coming soon. Setting up the verification domains is extremely hard and there's a lot of nuance in this, but there are some basic things that we have seen before,"
    },
    {
      "start_time": 10517.97,
      "end_time": 10540.91,
      "content": " where it's at least expectable that there's a domain and there's a chance that this works. All right, so we have fun things happening in real time. This is a good opportunity to talk about other reasoning models, 0103, just now OpenAI, as perhaps expected, released O3 Mini. What are we expecting from the different flavors?"
    },
    {
      "start_time": 10541.07,
      "end_time": 10564.93,
      "content": " Can you just lay out the different flavors. Can you just lay out the different flavors of the O models and the from Gemini, the reasoning model? Something I would say about these reasoning models is we talked a lot about reasoning training on math and code. And what is done is that you have the base model we've talked about a lot on the internet. You do this large-scale reasoning training with reinforcement learning. And then what the deep seek paper detailed in this R1 paper, which for me,"
    },
    {
      "start_time": 10564.93,
      "end_time": 10587.53,
      "content": " as one of the big open questions on how do you do this is that they did reasoning heavy but very standard post-training techniques after the large-scale reasoning RL. So they did the same things with a form of instruction tuning through rejection sampling, which is essentially heavily filtered instruction tuning with some reward models. And then they did this RLHF, but they made it math heavy."
    },
    {
      "start_time": 10587.53,
      "end_time": 10610.54,
      "content": " So some of this transfer, we looked at this philosophical example early on. One of the big open questions is how much does this transfer? If we bring in domains after the reasoning training, are all the models going to become eloquent writers by reasoning? Is this philosophy stuff going to be open? We don't know in the research of how much this will transfer. There's other things about how we can make soft verifiers"
    },
    {
      "start_time": 10610.54,
      "end_time": 10632.36,
      "content": " and things like this. But there is more training after reasoning, which makes it easier to use these reasoning models and that's what we're using right now so if we're going to talk about with three mini and o one these have gone through these extra techniques that are designed for human preferences after being trained to illicit reasoning. I think one of the things that people are ignoring is Google's Gemini, flash thinking,"
    },
    {
      "start_time": 10632.36,
      "end_time": 10653.32,
      "content": " is both cheaper than R1 and and better. And they released it in the beginning of December. And nobody's talking about it. No one cares. It has a different flavor to it. Its behavior is less expressive than something like 01, or it has fewer tracks than it is on. Quinn released a model last fall, QWQ, which was their preview reasoning model. And in deep-seek had R1 light last fall,"
    },
    {
      "start_time": 10653.32,
      "end_time": 10673.36,
      "content": " where these models kind of felt like they're on rails, where they really, really only can do math and code. And 01 is it can answer anything. It might not be perfect for some tasks, but it's flexible, it has some richness to it. And this is kind of the art of like how cook, like how it is a model a little bit undercooked. It's like, I mean, it's good to get a model out the door."
    },
    {
      "start_time": 10673.74,
      "end_time": 10694.4,
      "content": " But it's hard to gauge and it takes a lot of taste to be like, is this a full-fledged model? Can I use this for everything? They're probably more similar for math and code. My quick read is that Gemini Flash is not trained in the same way as 01, but taking an existing training stack, adding reasoning to it."
    },
    {
      "start_time": 10694.4,
      "end_time": 10716.57,
      "content": " So taking a more normal training stack and adding reasoning to it. So taking a more normal training stack and adding reasoning to it. And I'm sure they're going to have more. I mean, they've done quick releases on Gemini Flash, the reasoning, and this is the second version from the holidays. It's evolving fast and it takes longer to make this training stack where you're doing this large scale r- I get the same question from earlier the one about the human nature."
    },
    {
      "start_time": 10716.95,
      "end_time": 10740.87,
      "content": " Yeah. What was the human nature one? The way I can ramble, why I can ramble about this so much is that we've been working on this at AI2 before 01 was fully available to everyone and before R1, which is essentially using this RL training for fine-tuning. We use this in our Tulu series of models. And you can elicit the same behaviors where you say like weight and so in so much on,"
    },
    {
      "start_time": 10741.27,
      "end_time": 10764.73,
      "content": " but it's so late in the training process that this kind of reasoning expression is much lighter. So you can, there's essentially a gradation and just how much of this RL training you put into it determines how the output looks. So we're now using Gemini 2.0 Flash thinking experimental 121. It summarized the problem as humans self-domesticated apes"
    },
    {
      "start_time": 10764.73,
      "end_time": 10787.61,
      "content": " perspective okay all right wait, is this revealing the, the reasoning? Here's why this is a novel. Okay. Click to expand. Click to expand okay analyze the request novel is the keyword is like see how it just looks a little different it looks like a normal output yeah it's i mean in"
    },
    {
      "start_time": 10787.61,
      "end_time": 10808.07,
      "content": " some sense it's better structured. It makes more sense. Oh, and it latched onto human, and then it went into organisms and oh wow Apex predator Focus on domestication Apply domestication to humans, explore the idea of self-domestication. Not good. Not good. Where is this going?"
    },
    {
      "start_time": 10808.96,
      "end_time": 10828.36,
      "content": " Refined articulating Where is this going? Refine, articulate the insight. Greater facial expressiveness than communication ability, yes. Plus, this and adaptability, yes. Plasticity and adaptability, yes. Dependence on social groups, yes. All right. And self-critique and refined further. Wow. Is this truly novel? Is it well supported? So on. is a well supported."
    },
    {
      "start_time": 10830.54,
      "end_time": 10851.22,
      "content": " So on and so forth. And the insight is getting at is humans are not just social animals, but profoundly self-domesticated apes. And this self-domestication is the key to understanding our unique cognitive and social abilities, self-domesticated apes. Self-dom... I prefer the deep-seek response. Self-dem. I mean, it's novel."
    },
    {
      "start_time": 10851.52,
      "end_time": 10879.09,
      "content": " The insight is novel. I mean, that's like a good book title, self-dumesticated apes. Like, there could be a case made for that. I mean, yeah, it's cool. And it's revealing the reasoning. It's magical. It's magical. This is really powerful. Hello, everyone. This is Lex with a quick intermission recorded after the podcast Since we reviewed responses from Deep Segar One and Gemini Flash 2.0"
    },
    {
      "start_time": 10879.09,
      "end_time": 10910.1,
      "content": " thinking during this conversation, I thought at this moment, it would be nice to insert myself quickly doing the same for OpenAI 01-O-1 Pro and O3 Mini with the same prompt, the prompt being, give one truly novel insight about humans. And I thought I would in general give my vibe check and vibe-based anecdotal report on my own experiences with the new O3Mini model,"
    },
    {
      "start_time": 10910.32,
      "end_time": 10930.28,
      "content": " now that I got a chance to spend many hours with it in different kinds of contexts and applications. So I would probably categorize this question as, let's say, open-ended philosophical question, and in particular the emphasis on novelty I think is a nice way to test one of the capabilities of the model, which is come up with"
    },
    {
      "start_time": 10930.28,
      "end_time": 10950.82,
      "content": " something that makes you pause and almost surprise you with brilliance. So that said, my general review, after running each of the models on this question a bunch of times is that 01 Pro consistently gave brilliant answers. Once they gave me pause and made me think,"
    },
    {
      "start_time": 10951.12,
      "end_time": 10971.48,
      "content": " both cutting in its insight and just really nicely phrased with wit, with clarity, with nuance, over and over consistently generating the best answers. After that is R1, which is less consistent, but again, deliver brilliance. Gemini Flash 2.0 thinking was third."
    },
    {
      "start_time": 10972.22,
      "end_time": 10992.6,
      "content": " And last was O3 Mini, actually. It often gave quite a generic answer, at least to my particular sensibilities. That said in a bunch of other applications that I tested for brainstorming purposes, it actually worked extremely well and often outperformed R1."
    },
    {
      "start_time": 10992.6,
      "end_time": 11013.82,
      "content": " But on this open-ended philosophical question did consistently worse. Now, another important element for each of these models is how the reasoning is presented. DeepSeek R1 shows the full chain of thought tokens, which I personally just love. For these open end of philosophical questions, it's really, really interesting to see the model think through it,"
    },
    {
      "start_time": 11013.94,
      "end_time": 11038.88,
      "content": " but really also just stepping back, me as a person who appreciates intelligence and reasoning and reflection, reading these kind of chain of thought raw tokens of R1, there's something genuinely beautiful about observing the path of deliberation in an intelligence system. I think we don't always have that explicitly laid out for us humans."
    },
    {
      "start_time": 11039.16,
      "end_time": 11066.99,
      "content": " So to see it in another intelligence system, the non-linearity of it akin to Ulysses of Fennigens' wake by James Joyce. It's just beautiful to watch. Anyway, as we discussed in the episode, Deep Seek R1, talked about humans being able to convert selfish desires into cooperative systems by collectively pretending abstract rules like money laws and rights are real, and the shared hallucinations act as games, where competition"
    },
    {
      "start_time": 11066.99,
      "end_time": 11088.58,
      "content": " is secretly redirected to benefit the group, turning conflict into society's fuel. Gemini 2.0 Flash thinking said humans are not just social animals, but self-domesticated apes. And this self-domestication is the key to understanding our unique cognitive and social abilities. Now, it's important to say that the chain of thought there was really interesting."
    },
    {
      "start_time": 11089.08,
      "end_time": 11109.26,
      "content": " It was looking through the entire evolution of life on earth considering apex predators and considering how from that we ended up to where we are. I think that domestication by choice is a really interesting angle. Again, it's one of those things when somebody presents a different angle"
    },
    {
      "start_time": 11109.26,
      "end_time": 11130.36,
      "content": " and a seemingly obvious thing, it just makes me smile. And the same with Deep Seek R1, that these hallucinations of money, laws, and rights, and us collectively pretending like it's real, and we play games with them that look like competition when secretly we're just cooperating with each other. And that is the fuel of progress, beautifully put."
    },
    {
      "start_time": 11131.04,
      "end_time": 11151.6,
      "content": " Now, opening I.01 Pro consistently over and over, delivered bangers. I can go through many of them, but the first one was humans are the only species that turns raw materials into symbolic resources, then uses those symbols to reorganize the very materials they came from, creating a closed feedback loop between meaning and matter."
    },
    {
      "start_time": 11151.6,
      "end_time": 11171.94,
      "content": " Here, I just ran it again. Bangor after bangor, I'm telling you, humans are unique among known species in that they simultaneously rewrite two layers of reality, the external world and their own private mental landscapes. And then merge these two rewritten layers into a continuous personal narrative"
    },
    {
      "start_time": 11171.94,
      "end_time": 11193.36,
      "content": " that feels objectively true. Feels true. Feels true. This is poetry. Okay. And then O3 Mini mini high for me was smart fast actually and kind of generic never quite got kind of generic. Never quite got there for me. So here's the first one I got from O3 Mini."
    },
    {
      "start_time": 11194,
      "end_time": 11215.76,
      "content": " Humans are not fixed beings, but rather ongoing narratives, dynamic stories that we continuously write, edit, and reinterpret. This narrative plasticity is more than just memory or self-reflection. It's an intrinsic cognitive process that acts like an internal error correction system. It allows us to adapt our identities and values over time"
    },
    {
      "start_time": 11215.76,
      "end_time": 11236.26,
      "content": " in response to new experiences, challenges, and social contexts. Now it almost sneaks up to something approximating and cutting insight with narrative plasticity in quotes. But then it goes back to the sort of the generic. I don't know. All of these models are incredible for different reasons. There's a lot of concerns as we discussed in this episode,"
    },
    {
      "start_time": 11236.26,
      "end_time": 11261.54,
      "content": " but there's a lot of reasons to be excited as well. And I've probably spoken for too long. I am severely sleep deprived, borderline delirious, so hopefully some of this made sense. And now, dear friends, back to the episode. I think when you, you know, to Nathan's point, when you look at like the reasoning models,"
    },
    {
      "start_time": 11261.93,
      "end_time": 11281.93,
      "content": " um, when you look at like the reasoning models, to me, even when I used R1 versus 01, there was like that sort of rough edges around the corner feeling, right? And Flash thinking, you know, earlier, I didn't use this version, but the one from December, and it definitely had that rough edges around the corner feeling, right? Where it's just not fleshed out in as many ways, right?"
    },
    {
      "start_time": 11281.93,
      "end_time": 11305.11,
      "content": " Sure, they added math and coding capabilities via these verifiers in RL, but it feels like they lost something in certain areas and oh one is worse performing than chat in many areas as well to be clear Not by a lot not by a lot though as well, to be clear. Not by a lot. Not by a lot, though, right? And it's like some, like R1 definitely felt to me like it was worse than V3 in certain areas, like doing this RL expressed and learned a lot,"
    },
    {
      "start_time": 11305.11,
      "end_time": 11327.47,
      "content": " but then it weakened in other areas. And so I think that's one of the big differences between these models and what O1 offers. And then OpenAI has O1 Pro. And what they did with O3, which is like also very unique, is that they stacked search on top of chain of thought, right? And so chain of thought is one thing where it's able, it's one chain, it backtracks, goes back"
    },
    {
      "start_time": 11327.47,
      "end_time": 11348.6,
      "content": " and forth. But how they serve the served solved the arc a GI challenge was not just the chain of thought it was also sampling many times i i.e. running them in parallel and then selecting. Is running in parallel actually search? Because I don't know if we have the full information on how O1 Pro works. So I'm not, I don't have enough information to confidently say that it is searched. It is parallel samples."
    },
    {
      "start_time": 11348.6,
      "end_time": 11372.6,
      "content": " Yeah. And then select something. And we don't know what the selection function is. The reason why we're debating is because since 01 was announced, there's been a lot of interest in techniques called Monte Carlis Research, which is where you will break down the chain of thought inter-intermediate steps. We haven't defined chain of thought. Chain of thought is from a paper from years ago where you introduce the idea to ask a language model that at the time was much less easy to use."
    },
    {
      "start_time": 11372.6,
      "end_time": 11396.76,
      "content": " You would say, let's verify step by step, and it would induce the model to do this bulleted list of steps chain of thought is now almost a default in models where if you ask it a math question, you don't need to tell it to think step by step. And the idea with Monte Carlo tree search is that you would take an intermediate point in that train, do some sort of expansion, spend more compute, and then select the right one. That's like a very complex form of search that has been used in things like"
    },
    {
      "start_time": 11396.76,
      "end_time": 11417.26,
      "content": " muZero and alpha zero potentially. I know muZero does this. Another form of search is just asking five different people and then taking the majority answer. Yes. Right. So there's a variety of like, you know, it could be complicated, it could be complicated it could be simple we don't know what it is just that they are they are not just issuing one chain of thought in sequence they're launching many in one chain of thought in sequence. They're launching many in parallel."
    },
    {
      "start_time": 11417.26,
      "end_time": 11444.37,
      "content": " And in the Arc AGI, they launched a thousand in parallel for the one that like really shocked everyone that beat the benchmark was they they would launch a thousand in parallel and then they would get the right answer like 80% of the time or 70% of the time, 90 maybe even. Whereas if they just launched one, it was like 30%. There are many extensions to this. I would say the simplest one is that our language models to date have been designed to give the right answer the highest percentage of the time in one response."
    },
    {
      "start_time": 11444.57,
      "end_time": 11467.23,
      "content": " And we are now opening the door to different ways of running inference on our models in which we need to reevaluate many parts of the training process, which normally opens the door to more progress, but we don't know if open AI changed a lot, or if just sampling more and multiple choices, what they're doing, or if it's something more complex, where they change the training and they know that the inference mode is going to be different."
    },
    {
      "start_time": 11467.41,
      "end_time": 11487.57,
      "content": " So we're talking about 01 Pro $200 a month and they're losing money. So the thing that we're referring to, this fascinating exploration of the test time compute space, is that actually possible? Do we have enough compute for that? Does the financials make sense?"
    },
    {
      "start_time": 11487.71,
      "end_time": 11511.47,
      "content": " So the fantastic thing is and and there it's in the thing that i just pulled up earlier but uh the cost for GPT3 has plummeted if you scroll up just a few images, I think. The important thing about like, hey, is cost limiting factor here, right? Like my view is that like we'll have like really awesome intelligence before we have like aGI before we have it permeate throughout the"
    },
    {
      "start_time": 11511.47,
      "end_time": 11532.09,
      "content": " economy and this is sort of why that reason is right g GPT3 was trained in what, 2020, 2020, 2021, and the cost for running inference on it was $60, $70 per million tokens, right? Which is the cost per intelligence was ridiculous. Now, as we scaled forward two years, we've had a 1200x reduction in cost"
    },
    {
      "start_time": 11532.09,
      "end_time": 11557.44,
      "content": " to achieve the same level of intelligence as GPT3. So here on the X axis, this time over just a couple of years, and on the Y axisaxis log scale dollars to run inference on a million tokens. Yeah, a million. And so you have just a down, like a linear decline on a log scale from GPT3 through 35 to Lama."
    },
    {
      "start_time": 11557.44,
      "end_time": 11577.72,
      "content": " It's like $0.5 or something like that now, right? Which is versus $60,200 X. That's not the exact numbers, but it's 1200x. I remember that number is, is the humongous, is humongous cost per intelligence, right? Now, the freak out over DeepSeek is, oh my God, they made it so cheap. It's like, actually, if you look at this trend line, they're not below the trend line, first of all."
    },
    {
      "start_time": 11577.8,
      "end_time": 11598.06,
      "content": " And at least for TP3, right? They are the first to hit it, right? Which is a big deal. But they're not below the trend line as far as GP3. Now we have GPD4. What's going to happen with these reasoning capabilities, right? It's a mix of architectural innovations. It's a mix of better data, and it's going to be better training techniques, and all of these better inference systems, better hardware, right, going from,"
    },
    {
      "start_time": 11598.06,
      "end_time": 11618.26,
      "content": " you know, each generation of GPU to new generations or A6, everything is going to take this cost curve down and down and down and down. And then can I go in, can I just spawn a thousand different LLMs to create a task and then pick from one of them or you know whatever search search technique I want, a tree, Monte Carlo tree search, maybe it gets that complicated."
    },
    {
      "start_time": 11619.06,
      "end_time": 11639.56,
      "content": " Maybe it doesn't because it's too complicated to actually scale. Like, who knows? A bitter lesson, right? The question is, I think, when, not if, because the rate of progress is so fast, right? Um, nine months ago, Dario was saying, hey, or, you know, Dario said nine months ago, the cost to train and inference was this, right? And now we're much better than this, right?"
    },
    {
      "start_time": 11639.9,
      "end_time": 11662.99,
      "content": " And DeepSeek is much better than this. And that cost curve for GPD 4, which was also roughly $60 per million tokens when it launched has already fallen to, you know, $2 or so, right? And we're going to get it down to cents, probably, for GPD4 quality and the same and then that's that that's the based for the reasoning models like 01 that we have today and O1 Pro is spawning multiple, right?"
    },
    {
      "start_time": 11662.99,
      "end_time": 11683.93,
      "content": " And 03 and so on and so forth. These search techniques too expensive today, but they will get cheaper. And that's what's going to unlock the intelligence, right? So it'll get cheaper and cheaper and cheaper. The big deep seek R1 release freaked everybody out because of the cheaper. One of the manifestations of that is Nvidia stock plummeted."
    },
    {
      "start_time": 11683.93,
      "end_time": 11704.65,
      "content": " Can you explain what happened? I mean, and also just explain this moment and whether, you know, if Nvidia is going to keep winning. We're both Nvidia bowls here, I would say. And in some ways, the market response is reasonable. Most of the market, like, Nvidia's biggest customers in the U.S. are major tech companies,"
    },
    {
      "start_time": 11704.83,
      "end_time": 11729.43,
      "content": " and they're spending a ton on AI. And if a simple interpretation of Deep seek is you can get really good models without spending as much on AI. So in that capacity, it's like, oh, maybe these big tech companies won't need to spend as much in AI and go down. The actual thing that happened is much more complex where there's social factors, where there's the rising in the app store, the social contagion that is happening. And then I think some of it's just like, I don't trade."
    },
    {
      "start_time": 11729.53,
      "end_time": 11750.35,
      "content": " I don't know anything about financial markets. But it builds up over the weekend or the social pressure where it's like, if it was during the week and there was multiple days of trading when this was really becoming. But it comes on the weekend and then everybody wants to sell. And that is a social contagion. I think, I think, and like, there are a lot of false narratives, which is like, hey, these guys are spending billions on models, right? And they're not spending billions on models."
    },
    {
      "start_time": 11750.47,
      "end_time": 11772.55,
      "content": " No one spent more than a billion dollars on a model that's released publicly, right? GPD4 was a couple hundred million, and then, you know, they've reduced the cost with 4-0, all-Turbo-4-0, right? But billion-dollar model runs are coming, right? And this concludes pre-training and post-training, right? And then the other number is like, hey, deep seek didn't include everything, right? They didn't include, you know, a lot of the cost goes to research and all this sort of stuff."
    },
    {
      "start_time": 11772.81,
      "end_time": 11794.47,
      "content": " A lot of the cost goes to inference. A lot of cost goes to post training none of these things were factor research salaries right like all these things are like counted in the billions of dollars that open a i is spending but they weren't counted in the billions of dollars that Open AI is spending, but they weren't counted in the, you know, hey, six million, five million dollars that Deep Seek spent, right? So there's a bit of misunderstanding of what these numbers are. And then there's also an element of, Nvidia's just been a straight line up, right?"
    },
    {
      "start_time": 11794.47,
      "end_time": 11816.34,
      "content": " And there's been so many different narratives that have been trying to push down in video. I don't say push down in video stock. Everyone is looking for a reason to sell or to be worried right um you know it was it's it was blackwell delays right there gp you know there's a lot of report every two weeks there's a new report about their GPUs being delayed there's um there's the whole thing about scaling laws ending, right?"
    },
    {
      "start_time": 11816.34,
      "end_time": 11837.82,
      "content": " It's so, it's so ironic, right? It lasted a month. It was, it was just, it was just like literally just, hey, models aren't getting better, right? They're just not getting better. There's no reason to spend more. Pre-training, scaling is dead, and that it's like,-1-03 right r1 right and now it's like wait models are getting too they're progressing too fast. Slow down the progress. Stop spending on GPUs, right?"
    },
    {
      "start_time": 11838.22,
      "end_time": 11857.9,
      "content": " But, you know, the funniest thing I think that comes out of this is Javon's paradox is true right a ws pricing for h100s has gone up over the last couple weeks, right? Since a little bit after Christmas, since V3 was launched, AWS H100 pricing has gone up. H200s are like almost out of stock everywhere because it, you know,"
    },
    {
      "start_time": 11857.9,
      "end_time": 11878.26,
      "content": " H-200 has more memory and therefore R1, like, you know, wants that chip over H100, right? We were trying to get GPUs on a short notice this week for a demo, and it wasn't that easy. We were trying to get just like 16 or 32 H-100s for demo, and it will not very easy. So for people who don't know, Jamon's paradox is when the efficiency goes up somehow magically,"
    },
    {
      "start_time": 11879.78,
      "end_time": 11899.26,
      "content": " counterintuitively, the total resource consumption goes up as well. Right. And semiconductors is, you know, we're at 50 years of Moore's law, every two years, half the cost. Double the transistors. Just like clockwork. And it's slowed down, obviously. But like, the semiconductor industry has gone up the whole time. It's been wavy, right? There's obviously cycles and stuff. And I don't expect AI to be any different, right?"
    },
    {
      "start_time": 11899.26,
      "end_time": 11923.17,
      "content": " There's going to be ebbs and flows. But this is, in AI, it's just playing out at an insane timescale, right? It was 2x every two years. This is 1,200 X in like three years, right? So it's like the scale of improvement that is like hard to wrap your head around. Yeah, I was confused because I, to me, Envidious thought on that should have gone up, but maybe it went down because there's kind of suspicion"
    },
    {
      "start_time": 11923.17,
      "end_time": 11943.69,
      "content": " of fall play on the side of China, something like this. But if you just look purely at the actual principles of play here. It's obvious, yeah, the Javon's paradox. More progress that AI makes, or that hire the derivative of AI progresses, especially, you should, because Nvidia is in the best place, the higher the derivative is, the sooner the market's going to be bigger and expanding,"
    },
    {
      "start_time": 11943.91,
      "end_time": 11964.95,
      "content": " and Nvidia is the only one that does everything reliably right now. Because it's not like an Nvidia competitor arose. It's another company that's using Nvidia. Who historically has been a large Nvidia customer. Yeah. And has press releases about them cheering about being China's biggest Nvidia customer, right? Yeah, I mean..."
    },
    {
      "start_time": 11964.95,
      "end_time": 11985.17,
      "content": " Obviously, they've quieted down, but like, I think that's like another element of is that they don't want to say how many GPs they have. Yeah. Because, hey, they, yes, they have H-800s. Yes, they have H-20s. They also have some H-100s, right? Which are smuggled in. Can you speak to that, to the smuggling? What's the scale of smuggling that's feasible for a nation state to do for companies?"
    },
    {
      "start_time": 11985.17,
      "end_time": 12011.71,
      "content": " Is it possible to? I think there's a few angles of smuggling here, right? One is BightDance arguably is the largest smuggler of GPUs for China, right? China's not supposed to have GPUs. BiteDance has like over 500,000 GPUs. Why? Because they're all rented from companies around the world. They rent from Oracle, they rent from Google, they rent from all these mass and a bunch of smaller cloud companies too, right? All the neoclouds, right, of they rent so so many jupes they also buy a bunch right"
    },
    {
      "start_time": 12011.71,
      "end_time": 12037.9,
      "content": " and and they do this for mostly like what meta does right serving? Serving TikTok, right? Serving next best separate discussion. To be clear, that's today the use, right? And it's a valid use, right? Hack the dopamine cert it, right? Now, that's theoretically now very much restricted with the AI diffusion rules which happened in the last week of the Biden admin and Trump admin looks like they're going to keep them, which limits like allies, even like Singapore,"
    },
    {
      "start_time": 12037.9,
      "end_time": 12061.76,
      "content": " which Singapore is like 20% of Nvidia's 20, 20, 30% of Nvidia's 20, 30 percent of invidious revenue, but Singapore's had a memoratorium on not building data centers for like 15 years because they don't have enough power, so where are they going? I mean, I'm not claiming they're all going to China, right? But a portion are, you know, many are going to Malaysia, including Microsoft and Oracle have big data centers in Malaysia. Like, you know, they're going all over Southeast Asia, probably, India as well, right?"
    },
    {
      "start_time": 12061.76,
      "end_time": 12082.84,
      "content": " Like there's stuff routing, but like the diffusion rules are very de facto. Like you can only buy this many GPUs from this country. And it's, and you can only rent a cluster this large to companies that are Chinese, right? Like, they're very explicit on trying to stop smuggling, right? And a big chunk of it was, hey, let's, let's, you know, random company by 16 servers, ship them to, uh, to, to, to, to China, right?"
    },
    {
      "start_time": 12083.32,
      "end_time": 12105.92,
      "content": " There's actually, I saw a photo from someone in the semiconductor industry who leads like a team for like networking chips that competes with Nvidia and he sent a photo of a guy checking into a first class united flight from san francisco to shanghai or shenzhen with a super micro box that is this big, which can only contain GPUs."
    },
    {
      "start_time": 12105.92,
      "end_time": 12126.06,
      "content": " Right? And he was booking first class because think about it. Three to five K for your first class ticket. Server costs, you know, 240,000 in the US, 250,000. You sell it for 300,000 in China. Wait, you just got a free first class ticket and a lot more money. So it's like, you know, and that's like small scale sluggling. Most of the large scale smuggling is like companies in Singapore and"
    },
    {
      "start_time": 12126.06,
      "end_time": 12146.12,
      "content": " Malaysia, like routing them around or renting GPUs completely legally I want to jump in how much was this scale I think there's been some number like some people that are higher level economics understanding say that as you go from one billion of smuggling to 10 billion it's like you're hiding certain levels of economic activity. And that's the most reasonable thing to me is that there's going to be some level where it's"
    },
    {
      "start_time": 12146.12,
      "end_time": 12169.59,
      "content": " so obvious that it's easier to find this economic activity. And yeah, so, so my, my, my belief is that last year roughly, so, so Nvidia made a million H20s, which are legally allowed to be shipped to China, which we talked about is better for reasoning, inference at least, not maybe not training, but reasoning inference, and inference generally. Then they also had, you know, a couple hundred thousand."
    },
    {
      "start_time": 12169.59,
      "end_time": 12191.25,
      "content": " We think like 200 to 300,000 GPUs were routed to China from, you know, Singapore, Malaysia, US, wherever. Companies spawn up by 16 GPUs, 64 GPUs, whatever it is, route it. And Huawei's known for having spent up a massive network of companies to get the materials they need after they were banned in like 2018. So it's not like otherworldly. But I agree, right? Nathan's point is like, hey, you can't smuggle"
    },
    {
      "start_time": 12191.25,
      "end_time": 12213.03,
      "content": " $10 billion of GPUs. And then the third sort of source, which is just now banned, which wasn't considered smuggling, but is China is renting, like, is, I believe from our research, right? Oracle's biggest GPU customer is ByteDance, right? And for Google, I think it's their second biggest customer. Right. And so like, and you go down the list of clouds and especially these smaller cloud companies"
    },
    {
      "start_time": 12213.03,
      "end_time": 12234.39,
      "content": " that aren't like the hyperscalers, right? Think beyond core, even Lambda, even. There's a whole C, there's 60 different new cloud companies serving in video GPUs. I think B bytance is renting a lot of these right um all over right and so these companies are renting GPUs to Chinese companies, and that was completely legal up until the diffusion rules, which happened just a few weeks ago,"
    },
    {
      "start_time": 12234.39,
      "end_time": 12259.48,
      "content": " and even now you can rent GPU clusters that are less than 2,000 GPUs, or you can buy GPUs and ship them wherever you want if they're, if're less than 1500 GPUs right so it's like there are still like some ways to smuggle but yeah it's not you know as the numbers grow right, uh, you know, a hundred something billion dollars revenue for in video last year, 200 something billion this year, right? And if next year are you could nearly double again or more than double, right,"
    },
    {
      "start_time": 12259.5,
      "end_time": 12285.84,
      "content": " based on like what we see with data center footprints like being built out all across the U.S. and the rest of the world, it's going to be really hard for China to keep up with these rules, right? Yes, there will always be smuggling. And deep seek level models of GPD4 level models, 01 level models capable to train on what China can get, even the next tier above that. But if we speed run a couple more jumps, right, you know, right you know to billion dollar models 10 billion dollar models then it becomes"
    },
    {
      "start_time": 12285.84,
      "end_time": 12306.52,
      "content": " you know hey there is a compute disadvantage for China for training models and serving them. And the serving part is really critical, right? DeepSeek cannot serve their model today, right? It's completely out of inventory. It's already started falling in the app store actually downloads because you download it. You try and sign up. They say, we're not taking registrations because they have no capacity. You open it up, you get less than five tokens per second"
    },
    {
      "start_time": 12306.52,
      "end_time": 12329.15,
      "content": " if you even get your request approved, right? Because there's just no capacity because they just don't have enough GPUs to serve the model, even though it's incredibly efficient. It would be fascinating to watch the smuggling, because I mean, there's drug smuggling, right? That's a, that's a market. There's weapons smuggling, and GPUs will surpass that at some point. Chips are highest value per kilogram, probably by far."
    },
    {
      "start_time": 12329.15,
      "end_time": 12350.59,
      "content": " I have another question for you, Don't do track model API access internationally? How easy is it for Chinese companies to use hosted model APIs from the US. Yeah, I mean, that's incredibly easy, right? Like, Open AI publicly stated deep secret uses their API, and as they say, they have evidence, right? And this is another element of the training regime"
    },
    {
      "start_time": 12350.59,
      "end_time": 12374.59,
      "content": " is people at OpenAI have claimed that it's a distilled model, i.e. you're taking Open AIs model, you're generating a lot of output, and then you're training on the output in their model. And even if that's the case, what they did is still amazing, by the way, what DeepSseek did, efficiency-wise. Distillation is standard practice in industry, whether or not, if you're at a closed lab where you care about terms of service and IP closely, you distill from your own models. If you are a researcher and you're not building any products,"
    },
    {
      "start_time": 12374.59,
      "end_time": 12396.02,
      "content": " you distill from the opening eye boxes. This is a good opportunity. Can you explain big picture distillation as a process? What is distillation? What's the process of distillation? We talked a lot about training language models. They are trained on text. In post-training, you're trying to train on very high quality text that you want the model to match the features of, or if you're using RL, you're letting the model find its own thing."
    },
    {
      "start_time": 12396.02,
      "end_time": 12417.26,
      "content": " But for supervised fine tuning, for preference data, you need to have some completions with the model is trying to learn to imitate. And what you do there is instead of a human data, or instead of the model you're currently training, you take completions from a different normally more powerful model. I think there's rumors that these big models that people are waiting for,"
    },
    {
      "start_time": 12417.26,
      "end_time": 12448.16,
      "content": " these GPT-5s of the world, the Claude 3 opuses of the world, are used internally to do this distillation process. There's also public examples, right? Like meta explicitly stated, not necessarily distilling, but they used 405B as a reward model for 70B in their Lama 3.2 and 3.3. This is all the same topic. So is this, uh, is this ethical? Is this legal? Like, why is that financial times article headline say open a i says that there's evidence that"
    },
    {
      "start_time": 12448.16,
      "end_time": 12471.47,
      "content": " china's deep seek used its model to train competitor. This is a long, at least in the academic side and research side, it's a long history because you're trying to interpret opening eyes rule opening eyes terms of service say that you cannot build a competitor with outputs from their models. Terms of service are different than a license, which are essentially a contract between organizations. So if you have a terms of service on Open AIs account, if I violate it, Open"
    },
    {
      "start_time": 12471.47,
      "end_time": 12499.8,
      "content": " AI can cancel my account. This is very different than like a license that says how you could use a downstream artifact. So a lot of it hinges on a word that is very unclear in the AI space, which is what is a competitor. And so... And then the ethical aspect of it is like, why is it unethical for me to train on your bottle when you can train on the internet's text. Yeah. Right? So there's a bit of a hypocrisy because sort of open AI and potentially most of the companies trained on the internet's text without permission."
    },
    {
      "start_time": 12499.8,
      "end_time": 12520.56,
      "content": " There's also a clear loophole, which is that I generate data from Open AI, and then I upload it somewhere, and then somebody else trains on it, and the link has been broken. Like they're not under the same terms of service contract. This is why... There's a lot of hip-hospher. There's a lot of, like, to be discovered details that don't make a lot of sense. This is why a lot of models today,"
    },
    {
      "start_time": 12520.56,
      "end_time": 12541.56,
      "content": " even if they train on zero open AI data, you ask the model who trained you, it'll say, I am chat GPT trained by opening I. Because there's so much copy paste of like opening eye outputs from that on the internet that you just weren't able to filter it out and in the and there was nothing in the RL where they implemented like, hey, or post-training or SFT, whatever, that says, hey, I'm actually a model"
    },
    {
      "start_time": 12541.56,
      "end_time": 12562.42,
      "content": " by Allen Institute instead of... We have to do this if we serve a demo. We do research and we use open AI APIs because it's useful and we want to understand post-training and like our research models, they will say they're written by Open AI unless we put in the system prop that we talked about that, like, I am Tulu, I am a language model trained by the Allen Institute for AI. And if you ask more people around industry,"
    },
    {
      "start_time": 12562.42,
      "end_time": 12584.88,
      "content": " especially with post-training, it's a very doable task to make the model say who it is or to suppress the opening I thing. So in some levels it might be that Deep Sea didn't care that it was saying that it was by opening I. Like if you're going to upload model weights, it doesn't really matter because anyone that's serving it in an application and cares a lot about serving is going to when serving it if they're using it for a specific"
    },
    {
      "start_time": 12584.88,
      "end_time": 12606.38,
      "content": " task they're going to tailor it to that and it doesn't matter that it's saying it's chat gbti oh i guess the one of the ways to do that's like a system prompt or something like that like if you're serving it to say that you're... That's what we do. If we host the demo, you say, you are Tulu 3, a language model trained by the Allen Institute for AI. We also are benefited from open AI data because it's a great research tool."
    },
    {
      "start_time": 12606.38,
      "end_time": 12627.28,
      "content": " I mean, do you think there's any truth and value to the the claim, open AIs claim, that there's evidence that China's deep seek used this model to train. I think everyone has benefited regardless because the data is on the internet. And therefore, it's in your pre-training now, right? There are like subredits where people share the best chat GPT outputs."
    },
    {
      "start_time": 12627.44,
      "end_time": 12648.35,
      "content": " And those are, those are in your I think that they're trying to ship the narrative like they're trying to protect themselves and we saw this years ago when ByteDance was actually banned from some open AI APIs for training on outputs. There's other AI startups that most people, if you're in the AI culture, were like, they just told us they trained on open AI outputs and they never got banned."
    },
    {
      "start_time": 12648.35,
      "end_time": 12677.01,
      "content": " Like that's how they bootstrapped their early models. So it's much easier to get off the ground using this than to set up human pipelines and build a strong model. So there's long history here and a lot of the communications are seem like narrative control. Actually, like over the last couple couple days, we've seen a lot of people distilled deep seeks model into Lama models because the deep seek models are kind of complicated to run inference on because they're a mixture of experts and they're, you know, 600 plus billion parameters and all this. And people distilled them into the llama models because the"
    },
    {
      "start_time": 12677.01,
      "end_time": 12699.01,
      "content": " llama models are so easy to serve and everyone's built the pipelines and tooling for inference with the llama models right Because it's the open standard. So, you know, we've seen it, we've seen a sort of roundabout, right? Like, is it bad? Is it illegal? Maybe it's illegal, illegal whatever I don't know about that but like it could break contracts I don't think it's illegal like in any legal like no one's going to jail for this i i think like fundamentally i think it's ethical or i"
    },
    {
      "start_time": 12699.01,
      "end_time": 12719.71,
      "content": " hope it's ethical because like the moment becomes, we ban that kind of thing, it's going to make everybody much worse off. And I also actually this is difficult, but I think you should be a lot to train on the internet. I know a lot of authors and creators are very sensitive about it. That's a difficult question."
    },
    {
      "start_time": 12719.71,
      "end_time": 12743.28,
      "content": " But the moment you're not allowed to train on the internet. I agree. I have a schizo take on how you can solve this because it already works. I have a reasonable take out. All right. So, you know, Japan has a law, which you're allowed to train on any training data and copyrights don't apply if you want to train a model. A, B, Japan has nine gigawatts of curtailed nuclear power."
    },
    {
      "start_time": 12743.28,
      "end_time": 12764.32,
      "content": " See, Japan is allowed under the AI diffusion rule to import as many GPUs as they'd like. So all we have to do, we have a market here to make. We build massive data setters, we rent them to the labs, and then we train models in a legally permissible way and there's no if ands or buts and now the models have no no potential copyright lawsuit from New York Times or anything like that."
    },
    {
      "start_time": 12764.32,
      "end_time": 12786.46,
      "content": " No, no, it's just like completely legal. No, so, so, so. Genius. The early copyright lawsuits have fallen in the favor of AI training. I would say that the long tail of use is going to go in the side of AI, which is if you do, if you scrape trillions of data, you're not looking at the trillions of tokens of data, you're not looking at the trillions of tokens of data, you're not looking and saying this one New York Times article is so important to me."
    },
    {
      "start_time": 12786.68,
      "end_time": 12808.12,
      "content": " But if you're doing an audio generation for music or image generation and you say make it in the style of ex person, that's a reasonable case where you could figure out what is their profit margin on inference. I don't know if it's going to be the 50-50 of YouTube creator program or something, but I would opt into that program as a writer. Like, please, like that, it's just,"
    },
    {
      "start_time": 12808.12,
      "end_time": 12834.39,
      "content": " it's gonna be a rough journey, but there will be some solutions like that that makes sense, but there's a long tail where it's just on the internet. I think one of the other aspects of that Financial Times article implied, and so that leads to a more general question. Do you think there's, how difficult is spying, espionage, and stealing of actual secret code and data from inside companies. How much of that"
    },
    {
      "start_time": 12834.39,
      "end_time": 12855.75,
      "content": " is being attempted? Food and data is hard, but ideas is easy. Silicon Valley operates on the way that top employees get bought out by other companies for a pay raise and a large reason why these companies do this is to bring ideas with them. And there are, there's no, I mean, in California, there's rules that like certain like non-competes or whatever are illegal in California."
    },
    {
      "start_time": 12856.01,
      "end_time": 12879.09,
      "content": " And whether or not there's NDAs and things, that is how a lot of it happens. Recently, there was somebody from Gemini who helped make this one million context length and everyone is saying the next llama who I, he went to the meta team, is going to have one million contacts length. And that's kind of how the world works. You know, as far as like industrial espionage and things that has been greatly successful in the past"
    },
    {
      "start_time": 12879.09,
      "end_time": 12901.92,
      "content": " right um you know the americans there did the Brits, the Chinese have done it to the Americans, right? And you know, so on and so forth. It's just, it is a fact of life. And so like like, to argue industrial espionage can be stopped is probably unlikely. You can make it difficult. But even then, like, there's all these stories about, like, hey, F-35 and F-22 have already been like sort of like given to China in terms of design plans and stuff."
    },
    {
      "start_time": 12901.92,
      "end_time": 12922.42,
      "content": " Code and stuff, like between, you know, I say companies, not nation states, is probably very difficult, but ideas are discussed. is probably very difficult. But ideas are discussed a lot, right? Whether it be a house party in San Francisco or a company changing employees or you know or the always the like mythical honey pot that always gets talked about right like someone gets honey potted, right?"
    },
    {
      "start_time": 12922.82,
      "end_time": 12942.56,
      "content": " Because everyone working on AI is a single dude who's in their 20s and 30s. Not everyone, but like an insane amount of insane percentages so there's always like all these like you know and and obviously so honey Pilot is like a spy, a female spy approaches you and like. Yeah. Yeah. Or male, right? You know, it's San Francisco, right?"
    },
    {
      "start_time": 12942.56,
      "end_time": 12967.14,
      "content": " But as a single dude, I will say in his late 20s, right, is like, we are very easily corrupted, right? Like, you know, like not corrupted myself, but you know, like we are, we are. Everybody else, not me. Yeah, exactly. I'm too oblivious and i am not single so i'm saved from one espionage access yeah you have to make sure to close all security vulnerabilities so you uh dylan collect a lot of"
    },
    {
      "start_time": 12967.14,
      "end_time": 12989.19,
      "content": " information about each of the mega clusters for each of the major AI companies. Can you talk about the buildouts for each one that stand out? Yeah, so I think the thing that's really important about these megacluster buildouts is they're completely unprecedented in scale. Right. US, you know, sort of like data center power consumption"
    },
    {
      "start_time": 12989.19,
      "end_time": 13011.93,
      "content": " has been slowly on the rise and it's gone up to two, three percent, even through the cloud competing revolution, right? Data center consumption as a percentage of total U.S. And that's been over decades, right, of data centers, et cetera. It's been climbing, climbing slowly. But now, two to three percent now by the end of this decade it's like even even under like you know when i say like 10 percent a lot of people that are traditionally, by like 2028, 2030,"
    },
    {
      "start_time": 13011.93,
      "end_time": 13035.41,
      "content": " people are traditionally non-traditional data center, people like, that's nuts. But then like, people who are in like AI, who have like really looked at this at like the Anthropics and open AIs are like, that's not enough. And I'm like, okay. But like, you know, this is, this is both through globally distributed and or distributed throughout the US as well as like centralized clusters, right? The distributed throughout the US is exciting and it's the bulk"
    },
    {
      "start_time": 13035.41,
      "end_time": 13060.39,
      "content": " of it, right? Like, hey, you know, uh, opening eye or, uh, you know, say meta is adding a gigawatt, right? But most of it is distributed through the U.S. for inference and all these other things, right? So maybe we should lay out what a cluster is. So, you know, does this include AWS? Maybe it's good to talk about the different kinds of clusters and what you mean by mega clusters and what's the GPU and what's a computer and what."
    },
    {
      "start_time": 13060.51,
      "end_time": 13082.68,
      "content": " Yeah, yeah. Not that far back but yeah so like what do we mean by the clusters oh man I thought I was about to do the Apple ad right what's a computer so Apple ad, right? What's a computer? So, so traditionally data centers and data center tasks have been a distributed systems problem that is capable of being spread very far and widely, right? I send a request to Google."
    },
    {
      "start_time": 13082.68,
      "end_time": 13109.1,
      "content": " It gets around to a data center somewhat close to me. It does whatever search ranking recommendations, sends a result back, right? The nature of the task is changing rapidly in that the task, there's two tasks that people are really focused on now, right? It's not database access. It's not served me the right page, serve me the right ad. It's now a inference, an inference is dramatically different from traditional distributed systems, but it looks a lot more simple, similar, and then there's training, right?"
    },
    {
      "start_time": 13109.62,
      "end_time": 13129.58,
      "content": " The inference side is still like, hey, I'm going to put, you know, thousands of GPUs and, you know, blocks all around these data centers. I'm going to run models on them, you know, user submits a request, gets kicked off, or, hey, my service, service you know they submit a request to my service right they're on word and they're like oh yeah help me copilot and it starts kicks it off from on my windows copilot whatever apple, Apple Intelligence,"
    },
    {
      "start_time": 13129.58,
      "end_time": 13151.58,
      "content": " whatever it is, it gets kicked off to a data center, right? Now that data center does some work and sends it back. That's inference. That is going to be the bulk of compute, but then, you know, and that's like, you know, there's thousands of data centers that we're tracking with, like, satellites and like all these other things. And, and those are the bulk of what's being built, but the scale of, and so that's like what's really reshaping and that's what's getting millions of GPUs"
    },
    {
      "start_time": 13151.58,
      "end_time": 13171.78,
      "content": " But the scale of the largest cluster is also really important, right? When we look back at history, right, like, you know, or through the age of AI, right? Like, it was a really big deal when they did AlexNet on, I think, two GPs or four GPs? I don't remember. It was a really big deal. I think two GPUs or four GPS? I don't remember. It's a really big deal. It's a big deal because you use GPUs."
    },
    {
      "start_time": 13171.78,
      "end_time": 13198.49,
      "content": " It's a big deal they use GPUs. And they used multiple, right? But then over time, its scale has just been compounding, right? And so when you skip forward to GPD3, then GPD4, GPD4, 20,000 A100 GPUs. Unprecedented run, right, in terms of the size and the cost, right? A couple hundred million dollars on a yolo right a yolo run for gpd4 and it and it yielded you know this magical improvement that was like perfectly in line with what was experimented and just like a log scale"
    },
    {
      "start_time": 13198.49,
      "end_time": 13222.62,
      "content": " right oh yeah they have that plot from the paper the technical part the scaling laws were perfect right but that's not a crazy number right 20 000 a 100s uh roughly each GPU is consuming 400 watts. And then when you add in the whole server, right, everything, it's like 15 to 20 megawatts of power, right? You know, maybe you could look up what the power of consumption of a human person is because the numbers are going to get silly."
    },
    {
      "start_time": 13222.92,
      "end_time": 13243.82,
      "content": " But like that 15 to 20 megawatts was standard data center size. It was just unprecedented. That was all GPUs running one task. How many was also the toaster? A toaster is like, also a good example. Similar power consumption to an A100, right? H100 comes around. They increase the power from like 400 to 700 watts and that's just per GPU and then there's all the associated stuff around it. So once you count all that, it's roughly"
    },
    {
      "start_time": 13243.82,
      "end_time": 13264.84,
      "content": " like 1,400 to 1400 watts for everything, networking CPUs, memory, blah, blah, blah. So we should also say, so what's required, you said power, so a lot of power is required a lot of heat is generated so cooling is required and because there's a lot of GPUs that have to be, or CPUs or whatever, they have to be connected,"
    },
    {
      "start_time": 13264.84,
      "end_time": 13287.12,
      "content": " so there's a lot of networking. Yeah, so I think, yeah, sorry for skipping past that. And then the data center itself is like complicated, right? But these are still standardized data centers for GPD 4 scale. Right. Now we step forward to sort of what is the scale of clusters that people built last year, right? And it ranges widely, right? It ranges from like, hey, these are standard data centers,"
    },
    {
      "start_time": 13287.12,
      "end_time": 13308.44,
      "content": " and we're just using multiple of them and connecting them together really with a ton of fiber between them, a lot of networking, et cetera. That's what Open AI and Microsoft did in Arizona, right? And so they have a, you know, 100,000 GPUs, right? Meta, similar thing. They took their standard existing data center design, and it looks like an H, they connected multiple them together um and you know they got to they first did 16 000 gpues uh 24 000 gpues total only 60 thousand GPUs 24,000"
    },
    {
      "start_time": 13308.44,
      "end_time": 13331.46,
      "content": " GPUs total. Only 16 of them, thousand of them were running on the training run because GPs are very unreliable so they need to have spares to like swap in and out, all the way to like now 100,000 GPUs that they're training on Lama 4 on currently, right? Like 128,000 or so, right? This is, you know, think about $1,000 or so, right? This is, you know, think about 100,000 GPUs with roughly 1,400 watts apiece. That's, that's, that's 140 megawatts, 150 megawatts, right?"
    },
    {
      "start_time": 13331.46,
      "end_time": 13351.56,
      "content": " For a hundred and twenty eight out, right? So you're talking about you've jumped from 15 to 20 megawatts to 10x, you know, almost 10x that number, 9x that number to 150 megawatts in in two years right from 2022 to 2024 right and some people like Elon that he admittedly right and he says himself got into the game a little bit late for pre-training large language models, right?"
    },
    {
      "start_time": 13351.9,
      "end_time": 13375.65,
      "content": " X-A-I was started later, right? But then he bet heaven and hell to get his data center up and get the largest cluster in the world, right? Which is 200,000 GPUs. And he did that. He bought a factory in Memphis. He's upgrading the substation at the same time. He's got a bunch of mobile power generation, a bunch of single cycle combine. He tapped the natural gas line that's right next to the factory and he's just pulling a ton of gas, burning gas."
    },
    {
      "start_time": 13375.75,
      "end_time": 13398.49,
      "content": " He's generating all this power. He's in a factory in an old appliance factory that's shut down and moved to China long ago, right? Like, you know, and he's got 200,000 GPUs in it. And now what's the next scale, right? Like all the hyperscalers have done this. Now, the next scale is something that's even bigger, right? And so, you know, Elon, just to stick on the topic, he's building his own natural gas plant like a proper one right next door."
    },
    {
      "start_time": 13398.49,
      "end_time": 13421.98,
      "content": " He's deploying tons of Tesla megapack batteries to make the power more smooth and all sorts of other things. He's got like industrial chillers to cool the water down because he's water cooling the chips. So all these crazy things to get the clusters bigger and bigger. But when you look at like, say, what opening I did with Stargate, that's that in Arizona and in in Abilene, Texas, right?"
    },
    {
      "start_time": 13422.14,
      "end_time": 13452.98,
      "content": " What they've announced at least, right? It's not built, right? Elon says they don't have the money. You know, there's some debates about this. But at full scale, at least the first section is like definitely money's accounted for, but there's multiple sections. But full scale, that data center is going to be 2.2 gigawatts, right? 2,200 megawatts of power in and roughly like 1.8 gigawatts or 1,800 megawatts of power delivered to chips. Now, this is an absurd scale 2.2 gigawatts is like more than most cities right you know to be clear"
    },
    {
      "start_time": 13452.98,
      "end_time": 13475.75,
      "content": " and delivered to a single cluster that's connected to do training, right? To train these models, to do both the pre-training, the post-training, all of this stuff, right? This is insane. It is. What is a nuclear power plant again? Everyone is doing this, right? Everyone is doing this, right? Meta, in this, right? Meta in Louisiana, right? They're building two natural gas plants, massive ones, and then they're building this massive data center."
    },
    {
      "start_time": 13476.75,
      "end_time": 13496.69,
      "content": " Amazon has like plans for this scale. Google has plans for this scale. XAI has plans for this scale. XAI has plans for the scale, right? Like all of these, the guys that are racing, the companies that are racing are racing hard and they're doing multi-gigawatt data centers, right? To build this out because they think that, yeah, if I now have,"
    },
    {
      "start_time": 13496.69,
      "end_time": 13517.63,
      "content": " obviously pre-training scaling is going to continue, but to some extent, but then also all this post-training stuff where you have an RL sandbox for computer use or whatever, right? Like, you know, this is where they're going to, and all these variable domains where they just keep learning and learning and learning self-play, whatever, whatever it is makes the AI so much more capable because the line does go up, right? As you throw more compute, you get more performance. The shirt is about"
    },
    {
      "start_time": 13517.63,
      "end_time": 13539.49,
      "content": " scaling laws. You know, to some extent it is diminishing returns, right? You 10x the compute. You don't get 10x better model, right? You get a diminishing returns, but also you get efficiency improvements, so you bend the curve, right um and these scale of data centers are doing you know reeking you know a lot of like havoc on the network right Right. And you know, Nate, Nathan was mentioning there's, Amazon has tried to buy this nuclear power plant,"
    },
    {
      "start_time": 13539.75,
      "end_time": 13564.32,
      "content": " Tallin. And if you look at the Talon stock, it's just like skyrocketing. And, you know, like they're building a massive multi-gigawatt data center there. And you know, you just go down the list. There's so many ramifications. Interesting thing is like certain regions of the US, transmitting power cost more than actually generating it, right? Because the grid is so slow to build and the demand for power and the ability to build power and like re-ramping on a natural gas plant or even a coal plant is like"
    },
    {
      "start_time": 13564.32,
      "end_time": 13584.52,
      "content": " easy enough to do but like transmitting the power is really hard so in some parts of the u.s like in virginia it cost more to transmit power than it cost to generate it which is like you know there's there's all sorts of like second order effects that are insane here. Can the power grid support this kind of growth? You know, Trump's executive orders, there's a Biden executive order before the end of the year, but then Trump had some more executive orders,"
    },
    {
      "start_time": 13584.52,
      "end_time": 13605.44,
      "content": " which hopefully reduce the regulations to where, yes, things can be built. But yeah, this is a big, big challenge, right? Is building enough power fast enough? Are you going to basically have a nuclear power plant next to a data center for each one of these? So the fun thing here is this is too slow to build the power plant to build a power plant or to re"
    },
    {
      "start_time": 13605.44,
      "end_time": 13627.91,
      "content": " configure an existing power plant is too slow. And so therefore, you must use data center power consumption is flat, right? You know, I mean, like it's by- Which is why nuclear is also good for it. Like long-term nuclear is a very natural fit, but you can't do solar or anything in the short term like that. Because data center powers like this, right? Like you're telling me, you know, I'm going to buy tens of billions of dollars of"
    },
    {
      "start_time": 13627.91,
      "end_time": 13651.08,
      "content": " GPUs and idle them because the power's not being generated. Like power is cheap, right? Like if you look at the cost of a cluster, less than 20% of it is power, right? Most of it is the capital cost and depreciation of the GPUs, right? And so it's like, well, screw it. I'll just like, you know, I'll just build natural gas plants. This is what Meta's doing in Louisiana. This is what Open AI is doing in Texas and like all these different places. they may not be doing it directly, but they are partnered"
    },
    {
      "start_time": 13651.08,
      "end_time": 13674.58,
      "content": " with someone. And so there is a couple hopes, right? Like one is, you know, and Elon, what he's doing in Memphis is like, you know, to the extreme, they're not just using dual combine cycle gas, which is like super efficient. He's also just using single cycle and like mobile generators and stuff, which is less efficient. But he's, you know, there's also like the flip side, which is like solar power generation is like this and wind is another like like this different correlate you know different"
    },
    {
      "start_time": 13674.58,
      "end_time": 13697.19,
      "content": " So if you stack both of those, plus you get a big chunk of batteries, plus you have a little bit of gas, it is possible to run it more green. It's just the time scales for that is slow, right? So people are trying. But, you know, meta basically said whatever, don't care about my sustainability pledge. Or they'll buy like a per power, it's called a PPA power purchasing agreement where there'll be a massive wind farm or solar farm"
    },
    {
      "start_time": 13697.19,
      "end_time": 13717.33,
      "content": " like wherever. And then they'll just pretend like those electrons are being consumed by the data center. But in reality, they're paying for the power here and selling it to the grid and they're buying power here. And then another thing is like Microsoft quit on some of their sustainability pledges, right? Elon, what he did with Memphis is objectively somewhat dirty, but he's also doing it in an area where there's like a bigger natural gas"
    },
    {
      "start_time": 13717.33,
      "end_time": 13737.65,
      "content": " plant right next door and like a sewer next, or not a sewer, but like a wastewater treatment and a garbage dump nearby, right? And he's obviously made the world a lot more clean than that one data center is going to do. Right. So I think like it's fine to some extent and maybe AGI solves, you know, global warming and stuff, right? Whatever it is. You know, this is, this is sort of the attitude that people at the labs have, right?"
    },
    {
      "start_time": 13737.65,
      "end_time": 13758.25,
      "content": " Which is like, yeah, it's great. We'll just use gas, right? Because the race is that important. And if we lose, you lose, that's way worse, right? I should say that I got a chance to visit the Memphis Data Center. And it's, uh, the Memphis Data Center. Oh, wow. And it's kind of incredible. I mean, I visited with Elon, just the teams and the rate of innovation there's insane."
    },
    {
      "start_time": 13758.25,
      "end_time": 13778.31,
      "content": " Because my sense is that nobody's ever done anything of this scale and nobody has certainly ever done anything of this scale at the rate that XAI is is doing so they're like figuring out i mean it's all sitting in on all these meetings where they're brainstorming. It's like, it's insane. It's exciting because they're like,"
    },
    {
      "start_time": 13778.57,
      "end_time": 13799.69,
      "content": " they're trying to figure out what the bottlenecks are, how to remove the bottlenecks, how to make sure that, you know, there's just so many really cool things about putting together data center because you know everything has to work it's uh the people that do like the cis admin you know the machine learning all that the people that do like the sysadmin, you know, the machine learning, all that is the exciting thing, so on, but really the people that run everything"
    },
    {
      "start_time": 13799.69,
      "end_time": 13823.75,
      "content": " are the folks that know like the low level software and hardware that runs everything, the networking, all of that. And so you have to make sure you have procedures that test everything. I think they're using Ethernet. I don't know how they're doing the networking, but... They're using NVIDIUS SpectrumX Ethernet. There's actually like, I think, yeah, the unsung heroes are the cooling and electrical systems which are just like glossed over."
    },
    {
      "start_time": 13823.75,
      "end_time": 13844.03,
      "content": " Yeah. Um, but I think like one story that maybe is like exemplifies how insane this stuff is is when you're training right you're always doing your you're you're you're running through the model a bunch, right, in the most simplistic terms, running through the model a bunch, and then you're, uh, you're going to exchange everything and synchronize the weights, right? So you'll do a step."
    },
    {
      "start_time": 13844.09,
      "end_time": 13866.91,
      "content": " This is like a step in model training, right? At every step, your loss goes down, hopefully, and it doesn't always. But in the simplest terms, you'll be computing a lot and then you'll exchange, right? The interesting thing is GPU powers most of it. Networking power is some, but it's a lot less. So while you're computing, your power for your GPUs is here. But then when you're exchanging weights, if you're not able to overlap communications and compute perfectly, there may be a time period where your GPUs are just idle,"
    },
    {
      "start_time": 13866.91,
      "end_time": 13890.08,
      "content": " and you're exchanging weights and you're like, hey, the model's updating. So you're exchanging the gradients, you do the model update, and then you start training again. So the power goes, right? And it's super spiky. And so funnily enough, right, like this, when you talk about the scale of data center power, right can blow stuff up so easy um and so meta actually has accidentally open so upstreamed something to code in Pi Torch,"
    },
    {
      "start_time": 13890.08,
      "end_time": 13911.4,
      "content": " where they added an operator. And I kid you not, whoever made this, like I want to hug the guy because it says, says pie torch, it's like pie torch dot power plant, no blow up equals zero or equal one. And what it does, what it does is amazing, right? Either, you know, when you're, when you're exchanging the weights, the GP will just compute fake numbers. So the power doesn't spike too much. And so then the power plants don't blow up"
    },
    {
      "start_time": 13911.4,
      "end_time": 13933.58,
      "content": " because the transient spikes like screw stuff up. Well, that makes sense. I mean, you have to do that kind of thing. You have to make sure they're not idle. Yeah. And Elon's solution was like, let me throw a bunch of Tesla megapacks and a few other things, right? Like, everyone has different solutions, but like, Medas at least was publicly and openly known, which is just like set this operator. And what this operator does is it just makes the GPUs compute nothing so that the power"
    },
    {
      "start_time": 13933.58,
      "end_time": 13955.31,
      "content": " doesn't spike. But that just tells you how much power you're working with. I mean, it's insane. It's insane. People should just go to Google, like, scale, like what does X watts do and go through all the scales from one watt to a kilowatt to a megawatt and you look and stare at that and you're how high on the list a gigawatt is and it's mind-blowing can you say something about the cooling?"
    },
    {
      "start_time": 13955.57,
      "end_time": 13977.97,
      "content": " So I know Elon's using liquid cooling, I believe, in all cases. That's a new thing, right? Most of them don't use liquid cooling. Is there something interesting to say about the cooling? Yeah, yeah. So air cooling has been the de facto standard, throw a bunch of metal heat pipes, et cetera, and fans, right? And like, that's cool. That's been enough to cool it um people have been dabbling and water cooling"
    },
    {
      "start_time": 13977.97,
      "end_time": 14007.91,
      "content": " google's tp u's are water cooled right um so they've been doing that for a few years. But with GPUs, no one's ever done, and no one's ever done the scale of water cooling that Elon just did, right? Now, next generation Nvidia is for the highest NGPU, it is mandatory water cooling. You have to water cool it. But Elon did it on this current generation and that required a lot of stuff, right? If you look at some of the satellite photos and stuff of the Memphis facility, there's all these external water chillers that are sitting basically."
    },
    {
      "start_time": 14007.91,
      "end_time": 14028.82,
      "content": " It looks like a semi truck pod thing uh what's it called the container uh but really those are water chillers and he has like 90 of those water chillers just sitting outside. 90 different containers, right? With the water, you know, like chill the water, bring it back to the data center, and then you distribute it to all the chips, pull all the heat out, and then send it back, right? And this is both a way to cool the chips, but also is an efficiency thing."
    },
    {
      "start_time": 14029.54,
      "end_time": 14049.6,
      "content": " All right. And going back to that like sort of three vector thing, right? There is, there is, you know, memory bandwidth, flops and interconnect, the closer the chips are together, the easier it is to do high-speed interconnects, right? And so this is also like a reason why you're gonna go water cooling is because you can just put the chips right next to each other and therefore get higher"
    },
    {
      "start_time": 14049.6,
      "end_time": 14071.34,
      "content": " speed connectivity. I got to ask you, so in one of your recent posts, there's a section called Cluster Measuring Contest. There's another word there, but I won't say it, you know? What, who's who's got the biggest now and who's gonna have the big today"
    },
    {
      "start_time": 14071.34,
      "end_time": 14092.82,
      "content": " individual largest is Elon right um Elon's cluster. Elon's cluster in Memphis, 200,000 GPUs, right? Meta has like 12 hundred twenty eight thousand, opening has a hundred thousand now. Now to be clear, other companies have more GPUs than Elon. They just don't have them in one place, right? And for training, you want them tightly connected. There's some techniques that people are researching"
    },
    {
      "start_time": 14092.82,
      "end_time": 14115.75,
      "content": " and working on that let you train across multiple regions, but for the most part, you want them all in like one area, right? So you can connect them highly with high speed networking. And so Elon today has 200,000 H100s, 100,000 H-200s, 100,000 H-200s, right? Meta, Open AI, and Amazon all have on the scale of 100,000,"
    },
    {
      "start_time": 14115.75,
      "end_time": 14137.63,
      "content": " a little bit less. But next this year, this year, people are building much more, right? Anthropic and Amazon are building a cluster of 400,000 Traneum 2, which is Amazon-specific chip, trying to get away from InVidio, right? Um, you know, uh, in video, right? You know, meta and open AI have skills for hundreds of thousands, but by next year, you'll have like 500,000 to 700,000 GPU clusters."
    },
    {
      "start_time": 14137.63,
      "end_time": 14159,
      "content": " And note those GPUs are much higher power consumption than existing ones, right? Hopper 700 watts, Blackwell goes to 1,200 watts, right? So the power per chip is growing and the number of chips is growing, right? Nuts. You think, you think Elon's like he'll get to a million. You think that's actually feasible? I mean, I don't doubt Elon, right?"
    },
    {
      "start_time": 14159,
      "end_time": 14190.74,
      "content": " The filings that he has for like, you know, the power plan and the Tesla battery packs it's clear he has some crazy plans for Memphis like permits and stuff is open record, right? But it's not quite clear that, you know, what and what the timescales are. I just never doubt Elon, right? You know, he's going to surprise us. So what's the idea with these clusters? If you have a million GPUs, what percentage in, let's say, two, three years is used for training and what percent, pre-training and what percent is used for like for the actual"
    },
    {
      "start_time": 14190.74,
      "end_time": 14212.66,
      "content": " computation so these mega clusters make no sense for inference right uh you could route inference there and just not train. But most of the inference capacity is being, you know, hey, I've got a 30 megawatt data center here. I've got 50 megawatts here. I've got a 30 megawatt data center here. I've got 50 megawatts here. I've got 100 here, whatever. I'll just throw inference in all of those because the mega clusters, right, multi-gigawatt data centers, I want to train there because that's where all of my GPs are co-located,"
    },
    {
      "start_time": 14212.66,
      "end_time": 14236.66,
      "content": " where I can put them at a super high networking speed connected together, right? Because that's what you need for training. Now with pre-training, this is the old scale, right? You could increase parameters, you did increase data, model gets better. Uh, that doesn't, that doesn't apply anymore because there's not much more data in the pre-training side, right? Yes, there's video and audio and image that has not been fully taken advantage of, so there's a lot more scaling. But a lot of people like like have"
    },
    {
      "start_time": 14236.66,
      "end_time": 14258.74,
      "content": " transcript taken transcripts of YouTube videos and that gets you a lot of the data. It doesn't get you all of the learning value out of the video and image data. But there's still scaling to be done on pre-training. But this post-training world is where all the flops are going to be spent, right? The model's going to play with itself. It's going to self-play. It's going to do verifiable task. It's going to do computer use in sandboxes. It might even do like simulated robotics things, right?"
    },
    {
      "start_time": 14258.74,
      "end_time": 14279.54,
      "content": " Like all of these things are going to be environments where compute is spent in quote unquote post training. But I think, I think it's going to be good. We're going to, we're going to drop the post from post training. It's going to be pre-training and it's going to be training, I think. At some point. At some point. Because for the bulk of like the last few years, um, pre training has dwarfed post training."
    },
    {
      "start_time": 14279.54,
      "end_time": 14303.71,
      "content": " Mm hmm. But with these verifiable methods, especially ones that scale really, you know, potentially infinitely, like computer use in robotics, not just math and coding, right, where you can verify what's happening. Those infinitely verifiable tasks, it seems you can spend as much compute as you want on them. Especially at the context length increase, because at the end of pre-training is when you increase the context length for these models and we've talked earlier in the conversation about how the context length, when you have a long"
    },
    {
      "start_time": 14303.71,
      "end_time": 14324.71,
      "content": " input, is much easier to manage than output. And a lot of these post-training and reasoning techniques rely on a ton of sampling and it's becoming increasingly long context so it's just like your effectively your compute efficiency goes down. I don't the, I think Flops is the standard for how you measure it, but with RL and you have to do all these things where you move your"
    },
    {
      "start_time": 14324.71,
      "end_time": 14348.58,
      "content": " weights around in a different way than at pre-training and just generation, it's going to become less efficient and Flops is going to be less of a useful term. And then as the infrastructure gets better, it's probably going to go back to Flops. So all of the things we've been talking about is most likely going to be Nvidia, right is there any competitors google google i kind of ignored them uh i was what's the story with tp u what's the story with tp u like what's the story with TPU?"
    },
    {
      "start_time": 14348.58,
      "end_time": 14368.92,
      "content": " What's the story with TPU? Like, what's the... TPU is awesome, right? It's great. Google is, they're a bit more tepid on building data centers for some reason. They're building big data centers. Don't begin me wrong. And they have, they actually have the biggest cluster. I was talking about Nvidia clusters. They actually have the biggest cluster. I was talking about in video clusters. They actually have the biggest cluster, period. But the way they do it is very interesting, right?"
    },
    {
      "start_time": 14368.92,
      "end_time": 14389.58,
      "content": " They have two sort of like data center super regions, right? In that the data center isn't physically, like all of the GPUs aren't physically on one site, but they're like 30 miles from each other, not GPS, TPs, right? They have like in, in Iowa, Nebraska, they have four data centers that are just like right next to each other. Why doesn't Google flex its cluster size? Go to multi-data center training."
    },
    {
      "start_time": 14389.58,
      "end_time": 14410.58,
      "content": " It's good images in there, so I'll show you what I mean. It's just semi-analysis multi-data center. So this is like, you know, so this is an image of like what a standard Google data center looks like. By the way, their data centers look very different than anyone else's data centers. What are we looking at here? So these are, yeah, so if you see this image, right? In the center, there are these big rectangular boxes, right? Those are where the actual chips are kept."
    },
    {
      "start_time": 14410.58,
      "end_time": 14431.46,
      "content": " And then if you scroll down a little bit further, you can see there's like these water pipes. There's these chiller cooling towers in the top and a bunch of like diesel generators. The diesel generators are backup power the data center itself is like look physically smaller than the water chillers right so the chips are actually easier to like keep together but then like cooling all the water for the water"
    },
    {
      "start_time": 14431.46,
      "end_time": 14454.26,
      "content": " cooling is very difficult right so google has like a very advanced infrastructure that no one else has for the TPU. And what they do is they've stamped at these data center, they've stamped a bunch of these data centers out in a few regions right so if you go a little bit further um down uh this is this is a microsoft This is in Arizona. This is where GPT5 quote unquote will be trained. Um, you know, uh, if it doesn't exist already."
    },
    {
      "start_time": 14454.26,
      "end_time": 14474.58,
      "content": " Yeah, if it doesn't exist already. Yeah, if it doesn't exist already. But each of these data centers, I've shown a couple images of them, they're like really closely co-located in the same region, Nebraska, Iowa. And then they also have a similar one in Ohio complex, right? And so these data centers are really close to each other. And what they've done is they've connected them super high bandwidth with fiber. And so these are just a bunch of data centers."
    },
    {
      "start_time": 14474.58,
      "end_time": 14495.34,
      "content": " And the point here is that And so these are just a bunch of data centers. And the point here is that Google has a very advanced infrastructure, very tightly connected in a small region. So Elon will always have the biggest cluster fully connected, right, because it's all in one building. Right? And he's completely right on that, right? Google has the biggest cluster, but you have to spread over three sites, and by a significant margin, but you have to go across multiple sites."
    },
    {
      "start_time": 14495.34,
      "end_time": 14522.21,
      "content": " Why doesn't Google compete with Nvidia? Why don't they sell TPUs? I think there's a couple problems with it. It's like one, TPU has been a form of allowing search to be really freaking cheap and build models for that, right? And so like a big chunk of the search GPU purchases or TPU purchases or big chunk of Google's purchases and usage, all of it is for internal workloads,"
    },
    {
      "start_time": 14522.21,
      "end_time": 14545.91,
      "content": " whether it be search, now Gemini, YouTube, all these different applications that they have, you know, ads. These are where all their TPs are being spent, and that's what they're hyper-focused on, right? And so there's certain aspects of the architecture that are optimized for their use case that are not optimized elsewhere. One simple one is like they've open source the Gemma model and they called it Gemma 7B, right?"
    },
    {
      "start_time": 14545.91,
      "end_time": 14568.54,
      "content": " But then it's actually 8 billion parameters because the vocabulary is so large. And the reason they made the vocabulary so large is because TPU's like matrix multiply unit is massive because that's what they've like sort of optimized for. And so they decided, oh, well, just make the vocabulary large too, even though it makes no sense to do so on such a small model, because that fits on their hardware. So Gemma doesn't run as efficiently on a GPU as a Lama does, right? But vice versa, Lama doesn't run as a llama does, right? But by subversa,"
    },
    {
      "start_time": 14568.54,
      "end_time": 14592.04,
      "content": " llama doesn't run as efficiently on a TPU as a Gemma does, right? And so there's like certain like aspects of like hardware software code design. So all their search models are their ranking and recommendation models. All these different models that are AI, but not like Gen. AI, right, have been hyper-optimized with TPUs forever. The software stack is super optimized, but all of this software stack has not been released publicly at all, right? Very small"
    },
    {
      "start_time": 14592.04,
      "end_time": 14612.5,
      "content": " portions of it, Jackson, XLA have been. But like, the experience when you're inside of Google and you're training on TPUs as a researcher, you don't need to know anything about the hardware in many cases, right? Like it's like pretty beautiful. But as soon as you step outside, they'll go, a lot of them go back. They leave Google and then they go back. Yeah. Yeah, they're like, they leave and they start a company because they have all these amazing research ideas."
    },
    {
      "start_time": 14612.5,
      "end_time": 14634.96,
      "content": " And they're like, wait, infrastructure's hard. Software is hard. And this is on gpues or if they try to use tpues same thing because they don't have access to all this code but so it's like how do you convince a company whose golden goose is searched where they're making hundreds of billions of dollars from to start selling GPUs, which they used to only buy a couple billion of, you know, I think in 23, they bought like, like a couple billion. And now they're buying like couple billion."
    },
    {
      "start_time": 14635.56,
      "end_time": 14658.76,
      "content": " And now they're buying like 10 billion to $15 billion worth. But how do you convince them that they should just buy like twice as many and figure out how to sell them and make $30 billion. Like who cares about making $30 billion? Won't that $30 billion exceed actually the search profit eventually? Oh, I mean, like, you're always gonna make more money on services than- Always. I mean, like, like you like to be clear like today people are spending a lot"
    },
    {
      "start_time": 14658.76,
      "end_time": 14682.25,
      "content": " more on hardware than they are the services, right? Because the hardware front runs the service spend. But like, you're investing. If there's no revenue for AI stuff or not enough revenue, then obviously, like, it's going to blow up, right? You know, people won't continue to spend on GPUs forever. And InVdia is trying to move up the stack with like software that they're trying to sell and license and stuff, right? But Google has never had that DNA of like,"
    },
    {
      "start_time": 14682.25,
      "end_time": 14707.33,
      "content": " this is a product we should sell, right? They don't act, the Google Cloud does it, which is a separate organization from the TPU team, which is a separate organization from the DeepPU team, which is a separate organization from the deep mine team, which is a separate organization from the search team, right? There's a lot of bureaucracy. Wait, Google Cloud is a separate team than the TPU team. Technically, TPU sits under infrastructure which sits under Google Cloud, but like Google Cloud for like renting stuff and TPU architecture are very different goals, right?"
    },
    {
      "start_time": 14707.33,
      "end_time": 14734.61,
      "content": " In hardware and software, like all of this right like the jacks xLA teams do not serve google's customers externally whereas invidia's various kDA teams for like things like nickel serve external customers, right? The internal teams like Jackson, XLA and stuff, they more so serve deep mind and search. Right. And so their customers different. They're not building a product for them. Do you understand why AWS keeps winning versus Azure for cloud versus Google Cloud?"
    },
    {
      "start_time": 14734.77,
      "end_time": 14755,
      "content": " Yeah, there's Google Cloud is Yeah, there's- Google Cloud is tiny, isn't it, relative to the- Google Cloud is third. Yeah, yeah. Microsoft is the second biggest, but Amazon is the biggest, right? Yeah. And Microsoft deceptively sort of includes Microsoft Office 365 and things like that. Like some of these enterprise-wide licenses. So in reality, the Gulf is even larger. Microsoft is still second though, right? Amazon is way bigger."
    },
    {
      "start_time": 14755.16,
      "end_time": 14775.24,
      "content": " Why? Because using AWS is better and easier. And in many cases, it's cheaper. And it's first. It was first. Yeah, but there's a lot of things that are first that lose the... Well, it's easier, it's harder to switch than it is to... Yeah, okay. Because it's... There's big fees for switching too. AWS generates over 80% of Amazon's profit, I think over 90%. That's insane. The distribution centers are just like,"
    },
    {
      "start_time": 14775.24,
      "end_time": 14796,
      "content": " one day we'll decide to make money from this. But they haven't yet, right? Like they make tiny little profit from- Yeah, one day Amazon Prime will triple in price. You would think they would improve AWS interface because it's like horrible. It's like horrible. It's like clunky, but everybody is. I don't, yeah. You have one would think. I think actually Google's interface is sometimes nice,"
    },
    {
      "start_time": 14796,
      "end_time": 14816.6,
      "content": " but it's also like they don't care about anyone besides their top customers. Exactly. And like their customer service sucks and like they have a lot less like I mean all these companies they opt optimized for the big customers yeah that it's supposed to be for business Amazon has always optimized for the small customer too, though, right? Like, obviously they optimize a lot for the big customer, but when they started, they just would go to like random Bay Area things and give out credits, right?"
    },
    {
      "start_time": 14816.6,
      "end_time": 14837.14,
      "content": " And then they like or just put in your credit card and use us, right? Like it went back in the early days. So they've always the business has grown with them, right? And burgeon. So like, why does Amazon, like, why is Snowflake all over Amazon? Because Snowflake in the beginning when Amazon didn't care about them was still using Amazon right and then of course one day Snowflake and Amazon has a super huge partnership but like this is the case like Amazon's user experience and quality is better."
    },
    {
      "start_time": 14837.14,
      "end_time": 14857.36,
      "content": " Also a lot of the silicon they've engineered makes them have a lower cost structure in traditional cloud storage, CPU, networking, that kind of stuff, then in databases, right? Like, you know, I think like four of Amazon's top five revenue products, margin products are like gross profit products or all database related products, like Redshift and like all these things, right?"
    },
    {
      "start_time": 14857.36,
      "end_time": 14878.16,
      "content": " Like, so Amazon has a very like good silicon to a user experience like entire pipeline with a ws i think google their infrastructure their silicon teams yeah they have awesome silicon internally, TPU, the YouTube chip, you know, some of these other chips that they've made. And the problem is they're not serving external customers or serving internal customers, right?"
    },
    {
      "start_time": 14878.32,
      "end_time": 14898.84,
      "content": " I mean, Invidio's entire culture is designed from the bottom up to do this. There's this recent book, The NVIDIA way by Take Him that details this and how they look for future opportunities and ready their Kuda software libraries to make it so that new applications of high performance computing can very rapidly be evolved on Kuda and"
    },
    {
      "start_time": 14898.84,
      "end_time": 14921,
      "content": " Nvidia chips. And that is entirely different than Google as a services business. Yeah, I mean, in V, it should be said as a truly special company. Like, I mean, they, they're the whole, the culture of everything, they're really optimized for that kind of thing. Speaking of which, is there somebody that can even challenge Nvidia, hardware-wise? Intel, AMD. I really don't think so."
    },
    {
      "start_time": 14921.02,
      "end_time": 14941.3,
      "content": " We went through a very long process working with AMD on training on their GPUs at inference and stuff. And they're decent. Their hardware is better in many ways than in VINVVDIS. The problem is their software is really bad. And I think they're getting better, right? They're getting better faster, but they're just, the gulf is so large. And like, they don't"
    },
    {
      "start_time": 14941.3,
      "end_time": 14965.03,
      "content": " spend enough resources on it or haven't historically, right? Maybe they're changing their tune now, but, you know, for, for multiple months, we were submitting those bugs, right? Like us, semi-analysis, right? Like, what the fuck? Like, why are we submitting the most bugs? Right? Because they only cared about their like biggest customers and so they'd ship them a private image blah blah blah and it's like okay but like i am just using pie torch and I want to use the publicly available libraries"
    },
    {
      "start_time": 14965.03,
      "end_time": 14985.39,
      "content": " and you don't care about that, right? So they're getting better, but like, I think AMD is not possible. Intel is obviously in dire straits right now and needs to be saved somehow. Very important for national security, for American technology elements. Can you explain obviously? So why are they in the United States? Going back to earlier, only three companies can R&D, right?"
    },
    {
      "start_time": 14988.53,
      "end_time": 15006.65,
      "content": " Taiwan, Sunshu, Samsung, Pyongyang and then Intel Hillsborough. Samsung's doing horribly. Intel's doing horribly. We could be in a world where there's only one company that can do R&D. And that one company already manufactures most of chips. They've been gaining market share anyways. But like that's that's a critical thing. Right. So what happens to Taiwan means the rest of the world's semiconductor industry and therefore tech relies on Taiwan, right?"
    },
    {
      "start_time": 15006.93,
      "end_time": 15029.15,
      "content": " And that's obviously precarious. As far as like Intel, they've been slowly steadily declining. They were on top of servers and PCs, but now Apple's done the M1, and Nvidia's releasing a PC chip, and Qualcomm's releasing a PC chip, and in servers, hyperscalers are all making their own arm-based server chips. And Intel has no AI silicon like wins, right?"
    },
    {
      "start_time": 15029.15,
      "end_time": 15051.71,
      "content": " They have very small wins. And they never got into mobile because they said no to the iPhone. And like all these things have compounded and they've lost their process technology leadership right they were ahead for 20 years and now they're behind by at least a couple years right and they're trying to catch back up, and we'll see if, like, their 18A, 14A strategy works out where they try and leapfrog to SMC. But like, and Intel is leapfrog to SMC. But like, and Intel is just like losing tons of money anyways, right?"
    },
    {
      "start_time": 15051.71,
      "end_time": 15073.01,
      "content": " And they just fired their CEO, even though the CEO was the only person who understood the company well, right? We'll see. He was not the best, but he was pretty good relatively, technical guy. Where doesn't tell make most of its money, the CPUs still? PCs and data center CPUs, yeah, but data center CPUs are all going cloud, and Amazon, Microsoft, Google are making arm-based CPUs. And then PC side,"
    },
    {
      "start_time": 15073.31,
      "end_time": 15097,
      "content": " AMD's gained market share, Nvidia's launching a chip. That's not gonna be success, right? Media Tech Qualcomm ever launch chips. Apple's doing well, right? Like they could get squeezed a little bit in PC, although PC generally, I imagine, will just stick Intel mostly for Windows side. Let's talk about the broad AI race. Who do you think wins? We talked about Google. The leader, the default leader has been Google because of their infrastructure advantage."
    },
    {
      "start_time": 15097.5,
      "end_time": 15118.84,
      "content": " Well, like, in the news, OpenAI is the leader. They're the leading in the narrative. They have the best model. They have the best model that people can use, and they're experts. And they have the most AI revenue. Yeah. Open AI. have the most AI revenue. Yeah, Open AI is winning. So who's making money on AI right now? Is anyone making money? So accounting profit-wise, now. Is anyone making money? So accounting profit-wise, Microsoft is making money, but they're spending a lot of"
    },
    {
      "start_time": 15118.84,
      "end_time": 15140.24,
      "content": " CapEx, right? You know, and that gets depreciated over years. Meta is making tons of money, but with recommendation system, which is AI, but not with Lama, right? Lama's losing money for sure, right? I think anthropic and opening eye are obviously not making money because otherwise they wouldn't be raising money, right? They have to raise money to build more, right? Although theoretically, they are making money, right?"
    },
    {
      "start_time": 15140.24,
      "end_time": 15162.15,
      "content": " Like, you know, you spent a few hundred million dollars on GPD4 and it's doing billions in revenue. So like obviously it's like making money. Although they had to continue to research to get the compute efficiency wins, right? And move down the curve to like, you know, that 12, get that 1200 X that has been achieved for GPT3, you know, maybe we're only at like a, you know, a couple hundred X now, but you know, with GPT4 turbo and 4O and there will be another one probably cheaper"
    },
    {
      "start_time": 15162.15,
      "end_time": 15183.91,
      "content": " than GPD40 even that comes out at some point. And that research costs a lot of money. Yep, exactly. That's the thing that I guess is not talked about with the cost, that when you're referring to the cost of the model, it's not just the training or the test runs, it's the actual research, the manpower. Yeah, to do things like reasoning right now that that exists."
    },
    {
      "start_time": 15183.91,
      "end_time": 15205.53,
      "content": " They're going to scale it. They're going to do a lot of research still. I think the, you know, people focus on the payback question but it's really easy to like just be like well like you know GDP is humans in industrial capital, right? And if you can make intelligence cheap, then you can grow a lot, right? That's the sort of dumb way to explain it. But that's sort of what basically the investment thesis is."
    },
    {
      "start_time": 15205.53,
      "end_time": 15228.49,
      "content": " I think only Nvidia is actually making tons of money and other hardware vendors. The hyperscalers are all on paper making money, but in reality, they're spending a lot more on purchasing the GPUs, which you don't know if they're still gonna make this much money on each GPU in two years, right? Um, you don't know if all of a sudden open AI goes kapoof and now Microsoft has like hundreds of thousands of GPUs"
    },
    {
      "start_time": 15228.49,
      "end_time": 15250.07,
      "content": " they were renting to Open AI that are that they paid for themselves with their investment in them, you know, that no longer have a customer, right? Like this is always a possibility. I don't believe that, right? I think, you know, opening eye will keep raising money. I think others will keep raising money. I think others will keep raising money because the investments, the returns from it are going to be eventually huge once we have AGI. So do you think multiple companies will get,"
    },
    {
      "start_time": 15250.07,
      "end_time": 15272.81,
      "content": " let's assume. I don't think it's winner take all. Okay. So it's not, let's not call it AGI, whatever. It's like a single day. It's a gradual thing. Super powerful AI. But it's a gradually increasing set of features that are useful and rapidly increasing set of features. Rapidly increasing set of features. So you're saying a lot of companies will be,"
    },
    {
      "start_time": 15272.81,
      "end_time": 15294.13,
      "content": " it just seems absurd that all of these companies are building gigantic data centers. There are companies that will benefit from AI, but not because they train the best model. Meta has so many avenues to benefit from AI and all of their services. People are there. People spend time on meta's platforms, and it's a way to make more money per user per hour."
    },
    {
      "start_time": 15294.13,
      "end_time": 15315.54,
      "content": " Yeah, it seems like Google X slash XAI slash Tesla, important to say, and then meta will benefit not directly from the AI, like the LLMs, but from the intelligence, like the additional boost of intelligence to the products they already sell. So whether that's the recommendation system"
    },
    {
      "start_time": 15315.54,
      "end_time": 15335.66,
      "content": " or for Elon who's been talking about optimists, the robot, potentially the intelligence of the robot. And then you have personalized robots in the home, that kind of thing. He thinks it's a 10 plus trillion dollar business, which at some point maybe. I don't, not soon, but who knows what robots"
    },
    {
      "start_time": 15335.66,
      "end_time": 15356.92,
      "content": " Let's do a TAM analysis, right? Eight billion humans and let's get eight billion robots, right? And let's pay them the average salary. And yeah, there we go, 10 trillion. More than 10 trillion. Yeah, I mean, you know, if there's robots everywhere, why does it have to be just eight, eight billion robots? Yeah, yeah, of course, of course. I'm going to get, I'm going to have like one robot. You're going to have like 20."
    },
    {
      "start_time": 15357.4,
      "end_time": 15377.48,
      "content": " Yeah, I mean, I see a use case for that. So yeah. So I guess the benefit would be in the products they sell, which is why Open AI is in a trickier position because they... All of the value of Open AI right now as a brand is in ChatGPT. And there is actually not that, for most users, there is not that much of a reason that they need Open AI to be spending billions and billions of"
    },
    {
      "start_time": 15377.48,
      "end_time": 15398.74,
      "content": " dollars on the next best model when they could just license Lama 5 and for be way cheaper. So that's kind of like chat GPT is an extremely valuable entity to them. But they could make more money just off that than the chat application is clearly like does not have tons of room to continue, right? Like the standard chat, right, where you're just using it for random questions and stuff, right?"
    },
    {
      "start_time": 15399.06,
      "end_time": 15419.42,
      "content": " The cost continues to collapse, V3 is the latest one biggest. But it's going to get supported by ads, right? Like as, you know, Lema already serves 405B, probably loses the money, but at some point, you know, they're going to get, uh, the models are going to get so cheap that they can just serve them for free with ad supported, right? And that's what Google is going to be able to do. And that's obviously they've got a bigger reach, right?"
    },
    {
      "start_time": 15419.42,
      "end_time": 15441.4,
      "content": " So chat is not going to be the only use case. It's like these reasoning, code, agents, computer use, all this stuff is where OpenA has to actually go to make money in the future otherwise they're capits but x google and meta have these other products. So isn't, isn't it likely that open AI and anthropic disappear eventually?"
    },
    {
      "start_time": 15441.9,
      "end_time": 15461.72,
      "content": " Unless they're so good at models, but they are. But it's such a cutting, I mean, yes. It depends on where you think AI capabilities are going. You have to keep winning. Yes. You have to keep winning. As you climb, even if the AI capabilities are going super rapidly awesome into the direction of AGI, like there's still a boost for X"
    },
    {
      "start_time": 15461.72,
      "end_time": 15487.02,
      "content": " in terms of data, Google in terms of data, meta in terms of data, in terms of other products and the money and there's just huge amount other products and the money and the, like, there's just huge amounts of money. The whole idea is human data is kind of tapped out. We don't care. We all care about self-play, verifiable tasks. Yeah, so self-play verifiable tasks. If you think about AWS, which is an R&G problem. AWS does not make a lot of money on each individual machine. And the same can be said for the most powerful AI platform, which is even though the calls"
    },
    {
      "start_time": 15487.02,
      "end_time": 15512.71,
      "content": " to the API are so cheap, there's still a lot of money to be made by owning that platform. And there's a lot of discussions as it's the next compute layer. You have to believe that, and yeah, there's a lot of discussions that tokens and tokenomics and LLM APIs are the next compute layer, or the next paradigm for the economy, kind of like energy and oil was. But there's also like, you have to sort of believe that APIs and chat are not where AI is stuck, right?"
    },
    {
      "start_time": 15512.73,
      "end_time": 15533.47,
      "content": " It is actually just tasks and agents and robotics and computer use and those are the areas where all the value will be delivered not API not chat application. Is it possible you have, I mean, it all just becomes a commodity and you have the very thin wrapper, like perplexity. Just joking."
    },
    {
      "start_time": 15534.63,
      "end_time": 15554.71,
      "content": " There are a lot of rappers making a lot of money. Yeah, but do you think it's possible that people who would just even forget what OpenAI and the Thropic is and just because there'll be wrappers around the API and it just dynamically. If model progress is not rapid yeah, it's becoming a commodity, right? DeepSeek V3 shows this, but also the GPT3 chart earlier chart showed this, right?"
    },
    {
      "start_time": 15554.71,
      "end_time": 15576.74,
      "content": " Lama 3B is 1,200 X cheaper than GPD 3. Any GPG3, like anyone whose business model was GPG3 level capabilities is dead. Anyone whose business model's GPD4 level capabilities is dead. It is a common saying that the best business is being made now are ones that are predicated on models getting better. Right. Which would be like rappers, thing that is riding the wave of the models."
    },
    {
      "start_time": 15577.4,
      "end_time": 15597.8,
      "content": " The short term, the company that could make the most money is the one that figures out what advertising, targeting is the one that figures out what advertising targeting method works for language model generations. We have the meta ads, which are hyper-targeted in feed, not within specific pieces of content. And we have search ads that are used by Google and Amazon has been rising a lot on search. But within a piece, within a has been rising a lot on search. But within a piece, within a return from chat GPT,"
    },
    {
      "start_time": 15597.8,
      "end_time": 15619.08,
      "content": " it is not clear how you get a high quality placed ad within the output. And if you can do that with model costs coming down, you can just get super high revenue. That revenue is totally untapped, and it's not clear technically how it is done. Yeah, that is, I mean, the, sort of the ad sense innovation that Google did the one day"
    },
    {
      "start_time": 15619.08,
      "end_time": 15639.78,
      "content": " you'll have in GPT output an ad, and that's going to make billions, if not. It could be very subtle. It could be in conversation. We have voice mode now. It could be some way of making it so the voice introduces certain things. It's much harder to measure, and it takes imagination, but yeah. And it wouldn't be so shady, it wouldn't come off shady,"
    },
    {
      "start_time": 15639.78,
      "end_time": 15659.92,
      "content": " so you would receive public blowback, that kind of thing. So you have to do it loud enough to where it's clear. It's an ad and balance all that. So that's the open question that's trying to solve. Anthropic and open AI they need to. They might not say I don't think they care about that at all. They don't care about it right now. I think it's I like perplexity are experimenting on that more. Oh, interesting."
    },
    {
      "start_time": 15659.92,
      "end_time": 15681.68,
      "content": " Yeah, for sure. Like perplexity Google Medicare about this I think open eye and anthropic are purely laser focused on AGII Yeah, agents and AGI. And if I build AGI, I can make tons of money, right? Or I can pay for everything, right? And this is, this is, it's just predicated, like back on the like export control thing, right? If you think AGI is"
    },
    {
      "start_time": 15681.68,
      "end_time": 15702.1,
      "content": " five, ten years away or less, right? These labs think it's two, three years away. Obviously, your, your, your actions are, are you know if you assume they're rational actors which they are mostly you're what you do in a two- a g i versus five year versus ten years very very very different right do you think agents are promising?"
    },
    {
      "start_time": 15703.44,
      "end_time": 15725.9,
      "content": " We'll have to talk about this. This was, uh, this is like the excitement of the year that agents are going to reverev this is the generic hype term that a lot of business folks are using AI agents are going to revolutionize everything. Okay, so mostly the term agent is obviously overblown. We've talked a lot about reinforcement learning as a way to train for verifiable outcomes."
    },
    {
      "start_time": 15725.9,
      "end_time": 15755.33,
      "content": " Agents should mean something that is open-ended and is solving a task independently on its own and able to adapt to uncertainty there is a lot of the term agent applied to things like Apple Intelligence, which we still don't have after the last WWDC, which is orchestrating between apps. And that type of tool use thing is something that language models can do really well. Apple intelligence, I suspect, will come eventually. It's a closed domain. It's your messages app integrating with your photos with AI in the background, that will work."
    },
    {
      "start_time": 15755.33,
      "end_time": 15777.23,
      "content": " That has been described as an agent by a lot of software companies to get into the narrative. Yeah. The question is what ways can we get language models to generalize to new domains and solve their own problems in real time, maybe some tiny amount of training when they are doing this with fine-tuning themselves or in context learning, which is the idea of storing"
    },
    {
      "start_time": 15777.23,
      "end_time": 15798.43,
      "content": " information in a prompt, and you can use learning algorithms to update that, and whether or not you believe that that is going to actually generalize to things like me saying book my trip to go to Austin in two days I have XYZ constraints and actually trusting it. I think there's an HCI problem coming back for information."
    },
    {
      "start_time": 15799.33,
      "end_time": 15820.25,
      "content": " Well, what's your prediction there? Because my gut says we're very far away from that. I think opening eyes statement, I don't know if you've seen the five levels right or its chat is level one reasoning is level two and then agents is level three and I think there's a couple more levels. But it's important to note, right? We were in chat for a couple years, right?"
    },
    {
      "start_time": 15820.25,
      "end_time": 15841.68,
      "content": " We just theoretically got to reasoning we'll be here for a year or two, right? And then agents, but at the same time, like people can, people can try and like approximate capabilities of the next level but the agent agents are doing things autonomously doing things for minutes at a time, hours at a time, et cetera, right? Reasoning is doing things for tens of seconds at a time, right?"
    },
    {
      "start_time": 15841.68,
      "end_time": 15863.96,
      "content": " And then coming back with an output that I still need to verify and use and try to check out, right? So, and the biggest problem is, of course, like, it's the same thing with manufacturing, right? Like there's the whole Six Sigma thing, right? Like, you know, how many nines do you get? And then you compound the nines onto each other and it's like if you multiply you know by the number of steps that are six sigma you get to uh you know, a yield or something, right?"
    },
    {
      "start_time": 15863.96,
      "end_time": 15886.9,
      "content": " So like in semiconductor manufacturing, tens of thousands of steps, 999-999 is not enough, right? Because you multiply by that by that many times, you actually end up with like 60% yield, right? Or zero. Really low yield, yeah? Or zero. Really low yield, yeah, or zero. And this is the same thing with agents, right? Like chaining tasks together each time, LLMs, even the best LLMs in particularly pretty good benchmarks don't get 100%."
    },
    {
      "start_time": 15886.9,
      "end_time": 15908.37,
      "content": " Right? They get a little bit below that because there's a lot of noise and so how do you get to enough nines right this is the same thing with self-driving. We can't have self-driving because without it being like super geo-fenced like Google's, right? And even then, they have a bunch of teleoperators to make sure it doesn't get stuck, right? But you can't do that because it doesn't have enough nights. And self-driving"
    },
    {
      "start_time": 15908.37,
      "end_time": 15929.01,
      "content": " has quite a lot of structure because roads have rules. It's well defined. There's regulation. When you're talking about computer use for the open web, for example, or the open operating system, like there's no or the open operating system. Like there's no, it's a mess. So like the possibility, I'm always skeptical of any system"
    },
    {
      "start_time": 15929.01,
      "end_time": 15949.15,
      "content": " that is tasked with interacting with the human world with the open messy human world, with the open, messy human world. If we can't get intelligence that's enough to solve the human world on its own, We can create infrastructure, like the human operators for Waymo, over many years that enable certain workflows. There is a company. I don't remember it,"
    },
    {
      "start_time": 15949.21,
      "end_time": 15970.57,
      "content": " but it is, but that's literally their pitches. Yeah, we're just going to be the human operator when agents fail. And you just call us and you fix it. Yeah. It's like an API call and it's hilarious. There's going to be teleoperation markets when we get human robots, which is there's going to be somebody around the world that's happy to fix the fact that it can't finish loading my dishwasher when I'm unhappy with it, but that's just going to be part of the Tesla service package."
    },
    {
      "start_time": 15970.57,
      "end_time": 15991.43,
      "content": " I'm just imagining like an AI agent, talking to another AI agent. One company has an agent that specializes in helping other AI agents. But if you can make things that are good at one step, you can stack them together. So that's why I'm like, if it takes a long time, we're going to build infrastructure that enables it. You see the operator launch."
    },
    {
      "start_time": 15991.55,
      "end_time": 16014.89,
      "content": " They have partnerships with certain websites, with DoorDash, with OpenTable, with things like this, those partnerships are going to let them climb really fast. Their model is going to get really good at those things. It's going to get really good at those things. It's going to prove of concept, that might be a network effect where more companies want to make it easier for AI. Some companies will be like, no, let's put blockers in place. Yeah. And this is the story of the internet we've seen. We see it now with training data"
    },
    {
      "start_time": 16014.89,
      "end_time": 16035.67,
      "content": " for language models where companies are like, no, you have to pay. Like business working it out. That said, I think airlines have a very, and hotels have high incentive to make their site work really well, and they usually don't. Like if you look at how many clicks it takes to order an airplane ticket, it's insane. I don't... You actually can't call"
    },
    {
      "start_time": 16035.67,
      "end_time": 16060.17,
      "content": " an American Airlines agent anymore. They don't have a phone number. It's... I mean, it's horrible on many on the interface front and all the, to imagine that agents will be able to deal with that website when I as a human struggle, like I have an existential crisis every time I try a book airplane ticket that I don't, I think it's going to be extremely difficult to build an AI agent that's robust."
    },
    {
      "start_time": 16060.17,
      "end_time": 16083.44,
      "content": " But think about it, like, United has accepted the Starlink term, which is they have to provide Starlink for free and the users are going to love it. What if one airline is like, we're going to take a year and we're going to make our website have white text that works perfectly for the AIs. Every time anyone asks about an AI flight, they buy whatever airline it is. Or like, they just like, here's an API in, it's only exposed to AI agents."
    },
    {
      "start_time": 16083.44,
      "end_time": 16103.86,
      "content": " And if anyone queries it, the price is 10% higher and for any flight, but we'll let you see any of our flights and you can just book any of them. Here you go. And then it's like, oh, and I made 10% higher price. Awesome. Yeah. And like, am I willing to say that for like, hey, book me a flight to C-Lex, right? And it's like, yeah, whatever. Yeah. I think, I think, you know, computers and real world and the open world"
    },
    {
      "start_time": 16103.86,
      "end_time": 16124.86,
      "content": " are really, really messy. But if you start defining the problem in narrow problem in narrow regions, people are going to be able to create very, very productive things. And, and ratchet down cost massively, right? Like now crazy things like, you know, robotics in the home, those are going to be a lot harder to do just like self-driving,"
    },
    {
      "start_time": 16125.12,
      "end_time": 16146.58,
      "content": " right? Because there's just a billion different failure modes, right? But like, but, like, agents that can, like, navigate a certain set of websites and do certain sets of task, or, like, look at, you know, look at your, you know, take a photo of your grocery, uh, your fridge and or like upload your recipes and then like it figures out what to order from, you know, Amazon slash Whole Foods food delivery. Like that's, then that's gonna be like pretty quick"
    },
    {
      "start_time": 16146.58,
      "end_time": 16168.61,
      "content": " and easy to do, I think. So it's gonna be a a whole range of business outcomes. And it's going to be tons of, tons of sort of optimism around people can just figure out ways to make money. To be clear, these sandboxes already exist in research. There are people who have built clones of all the most popular websites of Google, Amazon, blah, blah, blah, to make it so that there's, I mean, Open AI probably has them internally to train these things. It's the same as Deep Minds"
    },
    {
      "start_time": 16168.61,
      "end_time": 16191.81,
      "content": " robotics team for years has had clusters for robotics where you interact with robots fully remotely. They just have a lab in London and you send tasks to it, arrange the blocks and you do this research. Obviously, there's techs there that fix stuff, but we've turned these cranks of automation before. You go from sandbox to progress and then you add one more domain at a time and generalize."
    },
    {
      "start_time": 16191.81,
      "end_time": 16212.57,
      "content": " I think in the history of NLP and language processing, instruction tuning in tasks per language model used to be like one language model did one task. And then in the instruction tuning literature, there's this point where you start adding more and more tasks together, where it just starts to generalize to every task. And we don't know where on this curve we are. I think for reasoning with this RL and verifiable domains, we're very, we're early,"
    },
    {
      "start_time": 16212.57,
      "end_time": 16234.57,
      "content": " but we don't know where the point is where you just start training on enough domains and poof, like more domains just start working and you've crossed the generalization barrier. Well, what do you think about the programming context? So software engineering, that, you know, that's where I personally and I know a lot of people, um, interact with AI the most."
    },
    {
      "start_time": 16234.73,
      "end_time": 16256.43,
      "content": " There's a lot of fear and angst too from current CS students, but there's also that's where that is the area where probably the most AI revenue and productivity gains have come, right? Whether it be co-pilots or cursor or what have you, right? This is, or just standard chat GPT, right? Like a lot of, I don't, I know very few programmers who don't have chat GPT, and actually many of them have the $200 tier,"
    },
    {
      "start_time": 16256.43,
      "end_time": 16276.63,
      "content": " because that's what it's so good for, right? I think that in that world, we already see it like sui bench. And if you've looked at the benchmark made by some Stanford students, I wouldn't say it's like really hard, but I wouldn't say it's easy either. I think like it takes someone who's been through at least, you know, a few years of CS or a couple years of programming to do sweepbench well."
    },
    {
      "start_time": 16276.79,
      "end_time": 16298.77,
      "content": " And the models went from 4% to 60% in like a year, right? And where are they going to go to next year? You know, it's going to be higher. It probably won't be 100% because, again, that nines is like really hard to do. But we're going to get to some point where that's, and then we're going to need harder software engineering benchmarks and so on and so forth. But the way that like people think of it now is it can do code completion, easy."
    },
    {
      "start_time": 16298.77,
      "end_time": 16319.23,
      "content": " It can do some function generation and have to review it. Great. But really the software engineering agents, I think, can be done faster sooner than any other agent because it is a verifiable domain. You can always like unit test or compile. And there's many different regions of like, it can inspect the whole code base at once, which no,"
    },
    {
      "start_time": 16319.23,
      "end_time": 16339.33,
      "content": " no engineer really can. Only the architects can really think about this stuff, the really senior guys, and they can define stuff. And then the agent can execute on it. So I think software engineering costs are going to plummet like crazy. And one interesting aspect of that is when software engineering costs are really low, you get very different markets. Right. So in the US, you have all these platforms SaaS companies, right?"
    },
    {
      "start_time": 16339.33,
      "end_time": 16362.54,
      "content": " Salesforce and so on and so forth. In China, and so on and so forth, right? In China, no one uses platform SaaS. Everyone just builds their own stack because software engineering is much cheaper in China. And partially because like people, the number of STEM graduates, et cetera. So STEM is such generally just cheaper to do. And so at the same time, code for LLMs have been adopted much less in China"
    },
    {
      "start_time": 16362.54,
      "end_time": 16383.94,
      "content": " because the cost of an engineer there is much lower. But like what happens when every company can just invent their own business logic like really cheaply and quickly. You stop using platform SaaS. You start building custom tailored solutions. You change them really quickly. Now all of a sudden your business is a little bit more efficient too potentially because you're not dealing with the hell that is like some random platform SaaS company stuff not working perfectly and having to adjust workflows"
    },
    {
      "start_time": 16383.94,
      "end_time": 16411.24,
      "content": " or random business automation cases that aren't necessarily AI required. It's just logic that needs to be built that no one is built. All of these things can go happen faster. And so I think software, and then, and then the other domain is like industrial, chemical, mechanical engineers, suck at coding, right? Just generally. And like, their tools, like semiconductor engineers, their tools are 20 years old. All the tools run on XP, including ASML lithography tools, run on Windows XP, right? It's like, you know, and like a lot of the analysis happens in Excel, right?"
    },
    {
      "start_time": 16411.32,
      "end_time": 16445.02,
      "content": " Like, it's just like, guys, like you guys can move 20 years forward with all the data you have and gathered and like do a lot better. It's just you need the engineering skills for software engineering to be delivered to the actual domain expert engineer. So I think that's the area where I'm like super duper bullish of generally AI creating value. The big picture is that I don't think it's going to be a clip. It's like, we talked to anything, a really good example of how growth changes is when meta added stories. So Snapchat was on an exponential. They added stories. It flatlined. Software engineers been up until the right."
    },
    {
      "start_time": 16445.46,
      "end_time": 16467.02,
      "content": " AI is going to come in. It's probably just going to be flat. It's like, it's a lot like everyone's going to lose their job. It's hard because the supply corrects more slowly. So the amount of students is still growing and that'll correct on a multi-year like a year delay, but the amount of jobs will just turn and then maybe in 20 40 years it'll be well down but in the few years"
    },
    {
      "start_time": 16467.02,
      "end_time": 16490.82,
      "content": " there'll never be the snap moment where it's like software engineers aren't useful. I think also the nature of what it means to be a programmer and what kind of jobs programmers do changes. Because I think there needs to be a human in the loop of everything you've talked about. There's a really important human in that picture of like correcting the code. Like fixing... like fixing larger than the context length."
    },
    {
      "start_time": 16491.12,
      "end_time": 16517.03,
      "content": " Yep. And debugging also, like debugging by, so reading the code, understanding the steering the system like no, no, no, you missed the point, adding more to the prompt. Kind of like, yes, adding the human... Designing the perfect Google button. Google's famous for having people design buttons that are so perfect. And it's like, how, like, how is AI going to do that? Like, it's like, they could give you all the ideas, perfect fine."
    },
    {
      "start_time": 16517.03,
      "end_time": 16538.83,
      "content": " I mean, that's the thing. You can call it taste. Humans have, one thing humans can do is figure out what other humans enjoy better than AI systems. That's where the preference, you loading that in, but ultimately humans are the greatest preference generate. That's where the preference comes from. And humans are actually very good at reading or like judging between two things versus this is this goes back to the core of what"
    },
    {
      "start_time": 16538.83,
      "end_time": 16561.41,
      "content": " R LHF in preference tuning is is that it's hard to generate a good answer for a lot of problems, but it's easy to see which one is better. And that's how we're using humans for AI now is judging which one is better. And that's what software engineering could look like. It's the PR review, here's a few options. What are the like, here are some potential pros and cons? And they're going to be judges. I think the thing I would very much"
    },
    {
      "start_time": 16561.41,
      "end_time": 16583.94,
      "content": " recommend is people's I think the thing I would very much recommend is people start, programmers start using AI and embracing that role of the supervisor of the AI system and like partner of the AI system versus writing from scratch or not learning coding coding at all, and just generating stuff. Because I think there actually has to be a pretty high level of expertise as a programmer to be able to manage increasingly intelligent systems."
    },
    {
      "start_time": 16583.94,
      "end_time": 16606.9,
      "content": " I think it's that and then becoming a domain expert in something. Sure. Yeah. Sure. Yeah. Because seriously, if you go look at aerospace or semiconductors or chemical engineering, everyone is using really crappy platforms, really old software. Like the job of the data sciences is like a joke, right? In many cases, in many cases, it's very real, but it's like, bring what the forefront of human capabilities are to your domain."
    },
    {
      "start_time": 16606.9,
      "end_time": 16626.98,
      "content": " And like, even if the forefront is like from the AI, your domain, you're like at the forefront, right? So it's like, it's like you have to be at the forefront of something and then leverage the like rising tide that is AI for everything else. Oh yeah, there's so many low hanging fruit everywhere in terms of where software can help automate a thing or digitize a thing"
    },
    {
      "start_time": 16626.98,
      "end_time": 16647.9,
      "content": " in the legal system. I mean, that's why Doge is exciting. You have, I mean, I got to hang out with a bunch of the doge folks and they, I mean, government is like so old school. It's like begging for the modernization of software, of organizing the data, all this kind of stuff."
    },
    {
      "start_time": 16647.9,
      "end_time": 16669.16,
      "content": " I mean, in that case, it's by design, because bureaucracy creates, protects centers of power and so on. But software breaks down those barriers. So it hurts those that are holding on to power, but ultimately benefits humanity. So there's a bunch of domains of that kind."
    },
    {
      "start_time": 16673.76,
      "end_time": 16695.95,
      "content": " One thing we didn't fully finish talking about is open source. So first of all, congrats. You released a new model. Yeah. Tulu. I'll explain what a Tulu is. A Tulu is a hybrid camel when you breed a dromedary with a Bacrian camel. Back in the early days after Chachapit, there was a big wave of models coming out like Alpaca, Vicuna, etc. that were all named after various mammalian species."
    },
    {
      "start_time": 16695.95,
      "end_time": 16716.89,
      "content": " So Tulu is, the brand is multiple years old, which comes from that. And we've been playing at the frontiers of post-training with open source code. And this first part of this release was in the fall where we used, we've built on Lama's open models, open weight models, and then we add in our fully open code or fully open data."
    },
    {
      "start_time": 16717.89,
      "end_time": 16737.29,
      "content": " There's a popular benchmark that is chatbot arena and that's generally the metric by which how these chat models are evaluated and it's humans compare random models from different organizations. And if you looked at the leaderboard in November or December, among the top 60 models from tens to 20s of organizations, none of them had open code or data"
    },
    {
      "start_time": 16737.29,
      "end_time": 16758.33,
      "content": " for just post-training. Among that, even fewer or none have pre-training data and code available, but post-training is much more accessible at this time. It's still pretty cheap and you can do it. And the thing is, like, how high can we push this number where people have access to all the code and data. So that's kind of the motivation of the project. We draw on lessons from Lama, and Vida had a Nematron model where the recipe for their post-training"
    },
    {
      "start_time": 16758.33,
      "end_time": 16781.27,
      "content": " was fairly open with some data and a paper, and it's putting all these together to try to create a recipe that people can fine-tune models like GPT4 to their domain. So to be clear, in the case of Tulu, maybe you can talk about Alma too, but in the case of Toul, you're taking Lama 3, 4,5B. Tudu has been a series of recipes for post-raining,"
    },
    {
      "start_time": 16781.27,
      "end_time": 16801.74,
      "content": " so we've done multiple models over years. And so you're open sourcing everything. Yeah. If you start with an open weight base model, the whole model technically is an open source, because you don't know what Lama put into it, which is why we have the separate thing that we'll get to. But it's just getting parts of the pipeline where people can zoom in and customize. I know I hear from startups and businesses."
    },
    {
      "start_time": 16801.74,
      "end_time": 16824.27,
      "content": " They're like, okay, like I can take this post training and try to apply it to my domain. We talk about verifiers a lot. We use this idea, which is reinforcement learning with verifiable rewards, RLVR, kind of similar to RLHF, and we applied it to map. And the model today, which is like we applied it to the Lama 405B base model from last year."
    },
    {
      "start_time": 16824.27,
      "end_time": 16844.53,
      "content": " And we have our other stuff. We have our instruction tuning and our preference tuning, but the math thing is interesting, which is like it's easier to improve this math benchmark. There's a benchmark, M-A-T-H, math, all capitals. Tough name. On the benchmark, name is the area that you're evaluating. We're researchers. We're not brands, brand strategists."
    },
    {
      "start_time": 16844.53,
      "end_time": 16866.71,
      "content": " And this is something that the deep seek paper talked about as well, as like at this bigger model it's easier to elicit powerful capabilities with this rl training and then they distill it down from that big model to the small model. And this model we released today, we saw the same thing as we're at AI2, we don't have a ton of compute. We can't train 405B models all the time. So we just did a few runs and they tend to work."
    },
    {
      "start_time": 16866.83,
      "end_time": 16888.56,
      "content": " And it's like, it just shows that there's a lot of room for people to play in these things and that and they crushed llama's actual release, right? Like they're way better than it. Yeah, so our VAL numbers, I mean, we have extra months in this, but our VAL numbers are like much better than the Lama instruct model that they released. And then you also said better than DeepSeek V3. Yeah, on our Eval benchmark."
    },
    {
      "start_time": 16888.56,
      "end_time": 16908.9,
      "content": " The most deep seek V3 is really similar. We have a safety benchmark to understand if it will say harmful things and things like that. And that's what draws down most of the way. It's still like... It's like an amalgamation of multiple benchmarks, or what do you mean? Yeah, so we have a 10 value. This is like, this is standard practice in post training, is you choose your evaluations you care about. In academics and smaller labs, you'll have fewer evaluations."
    },
    {
      "start_time": 16908.9,
      "end_time": 16931.84,
      "content": " In companies, you'll have a really one domain that you really care about. In Frontier Labs, you'll have tens to 20s to maybe even like 100 evaluations of specific things. So we'd choose a representative suite of things that look like chat, precise instruction following, which is like respond only in emojis. Like does model follow weird things like that? Yeah. Math, code. And you create a suite like this. So safety would be one of 10 in that type of suite where you have"
    },
    {
      "start_time": 16931.84,
      "end_time": 16952,
      "content": " what is the broader community of AI care about? And for example, in comparison to deep seek, it would be something like our average avowal for our model would be 80, including safety and similar without and deep seek would be like 79% average score without safety and their safety score would bring it down like so"
    },
    {
      "start_time": 16952,
      "end_time": 16973.74,
      "content": " you beat them even ignoring safety yeah so this is something that internally, it's like, I don't want to win only by like how you shape the VAL benchmark. So if there's something that's like people may or may not care about safety in their model. Safety can come downstream. Safety can be when you host the model for an API. Like safety is addressed in a spectrum of locations and AI applications. So it's like, if you want to say that you have the best recipe, you can't just gated on"
    },
    {
      "start_time": 16973.74,
      "end_time": 16997.07,
      "content": " these things that some people might not want. And this is like the time of progress. We benefit if we can release a model later. We have more time to learn new techniques like this RL technique. We had started this in the fall. It's now really popular reasoning models. The next thing to do for open source post-training is to scale up verifiers to scale up data to replicate some of deep seek's results."
    },
    {
      "start_time": 16997.07,
      "end_time": 17018.15,
      "content": " And it's awesome that we have a paper to draw and that it makes it a lot easier. And that's the type of things that is going on among academic and closed frontier research in AI. Since you're pushing open source, what do you think is the future of it? You think DeepSeek actually changes things since it's open source or open weight or is pushing the open source moving into the open"
    },
    {
      "start_time": 17018.15,
      "end_time": 17038.27,
      "content": " direction. This goes very back to the license discussion. So DeepSeek R1 with a friendly license is a major reset. So it's like the first time that we've had a really clear frontier model that is open weights and with a commercially friendly license with no restrictions on downstream use cases, synthetic data distillation, whatever. This has never been the case at all in the history of AI in the last"
    },
    {
      "start_time": 17038.27,
      "end_time": 17059.89,
      "content": " few years since ChatGPT. There have been models that are off the frontier or models with weird licenses, that you can't really use them. So isn't Meta's license pretty much permissible except for five companies. And there's also, so this goes to like what open source AI is, which is there's also use case restrictions in the Lama license, which says you can't use it for specific things. So if you come from an open source software background,"
    },
    {
      "start_time": 17059.89,
      "end_time": 17083.65,
      "content": " you would say that that is not an open source license. What kind of things are those, though? Like, are they like... At this point, I can't pull them off the top of my head. But it'll be like, it used to be military use was one and they removed that for scale. It'll be like, like C-SAM, like child abuse material. Like that's the type of thing that is forbidden there. But that's enough from an open source background to say it's not an open source license."
    },
    {
      "start_time": 17083.65,
      "end_time": 17107.97,
      "content": " And also the Lama license has this horrible thing where you have to name your model llama if you touch it to the llama model. So it's like the branding thing. So if a company uses Lama, technically the license says that they should say built with Lama at the bottom of their application. And from like a marketing perspective, that just, that just hurts. Like I can, I could suck it up as a researcher. I'm like, oh, it's fine. Like it says Lama Dash on all of our on all of our materials for this release. But this is why we need"
    },
    {
      "start_time": 17107.97,
      "end_time": 17128.58,
      "content": " truly open models, which is we don't know deep seek R1's data. So you're saying I can't make a cheap copy of Lama and pretend it's mine, but I can do this with the Chinese model. Yeah. Hell yeah. That's what I was saying. And that's why it's like we want this whole open language models thing, the Olmo thing, is to try to keep the model"
    },
    {
      "start_time": 17128.58,
      "end_time": 17151.84,
      "content": " where everything is open with the data as close to the frontier as possible. So we're compute constrained, we're personnel constrained, we rely on getting insights from people like John Schulman tells us to do RL on outputs. Like we can make these big jumps, but it just takes a long time to push the frontier of open source. And fundamentally, I would say that that's because open source AI does not have the same feedback loops as open source software."
    },
    {
      "start_time": 17151.84,
      "end_time": 17177.93,
      "content": " We talked about open source software for security. Also, it's just because you build something once and you can reuse it. If you go into a new company, there's so many benefits. But if you open source a language model, you have this data sitting around, you have this training code. It's not like that easy for someone to come and build on and improve because you need to spend a lot on compute, you need to have expertise. So until there are feedback loops of open source AI, it seems like mostly an ideological mission."
    },
    {
      "start_time": 17178.13,
      "end_time": 17199.23,
      "content": " People like Mark Zuckerberg, which is like America needs this. And I agree with him, but in the time where the motivation ideologically is high, we need to capitalize and build this ecosystem around what benefits do you get from seeing the language model data? And there's not a lot about that. We're going to try to launch a demo And there's not a lot about that. We're going to try to launch a demo soon where you can look at an Omo model and a query"
    },
    {
      "start_time": 17199.23,
      "end_time": 17225.43,
      "content": " and see what pre-training data is similar to it, which was like legally risky and complicated, but it's like, what does it mean to see the data that the AI was trained on, it's hard to parse. It's terabytes of files. It's like, I don't know what I'm going to find in there. But that's what we need to do as an ecosystem if people want open source AI to be financially useful. We didn't really talk about Stargate. I would love to get your opinion on like what the new"
    },
    {
      "start_time": 17225.43,
      "end_time": 17246.79,
      "content": " administration, the Trump administration, everything that's doing, that's being done from the America side and supporting AI infrastructure and the efforts of the different AI companies. What do you think about Stargate? What are we supposed to think about Stargate and does Sam have the money? Yeah, so I think Stargate is a opaque thing."
    },
    {
      "start_time": 17246.91,
      "end_time": 17277.91,
      "content": " It definitely doesn't have $500 billion. Doesn't even have $100 billion. Right. So what they announced is this $500 billion number, Larry Ellison, Sam Altman, and Trump said it. They thanked Trump, and it's used... Trump did do some executive actions that do significantly improve the ability for this to be built faster. You know, one of the executive actions you did is on federal land, you can just basically build data centers in power, you know, like pretty much like that. Uh, and then the permitting process is basically gone or you file after the fact."
    },
    {
      "start_time": 17278.29,
      "end_time": 17299.87,
      "content": " So like one of the, again, like I had a schizo take earlier. Another schizotake, if you've ever been to the Presidio in San Francisco, beautiful area. You could build a power plant and a data center there if you wanted to. Because it is federal land. It used to be a military base. But obviously this would piss people off. It's a good bit. Anyways. Trump has made it much easier to do this, right?"
    },
    {
      "start_time": 17299.91,
      "end_time": 17320.45,
      "content": " Generally, Texas has the only unregulated grid in the in the nation as well. Let's go Texas. Um, and so, you know, therefore like, Urquot enables people to build faster as well in addition the federal regulations are coming down and so Stargate is predicated. This is why that whole show happened. Now, how they came up with a $500 billion number is beyond me."
    },
    {
      "start_time": 17320.83,
      "end_time": 17351.56,
      "content": " How they came up with a $100 billion number makes sense to some extent, right? And there's actually a good table in here that I would like to show in that Stargate piece that I had it's the most recent one, yeah. So anyways, Stargate, you know, it's basically right, like there is uh it's it's a table about cost um there you passed it already it's that one. So this table is kind of explaining what happens, right?"
    },
    {
      "start_time": 17351.56,
      "end_time": 17374.24,
      "content": " So Stargate is in Abilene, Texas, the first $100 billion of it. That site is 2.2 gigawatts of power in, about 1.8 gigawatts of power consumed, right? Per GPU, they have like roughly, Oracle is already building the first part of this before Stargate came about. To clear they've been building it for a year, they tried to rent it to Elon, in fact."
    },
    {
      "start_time": 17374.66,
      "end_time": 17398.32,
      "content": " Right. But Elon was like, it's too slow. I need it faster. So then he went and did his Memphis thing. And so opening, I was able to get it with this weird joint venture called Stargate. They initially signed a deal with just Oracle for the first section of this cluster, right? This first section of this cluster, right? This first section of this cluster, right, is roughly, um, $5 billion to $6 dollars of server spend right and then there's another billion or so"
    },
    {
      "start_time": 17398.32,
      "end_time": 17419.14,
      "content": " of data center spend but the and then and then likewise like if you fill out that entire 1.8 gigawatts with the next two generations of invidious chips gb 200 gb300 gb300, VR 200, and you fill it out completely, that ends up being roughly $50 billion of server cost, right? Plus there's data center cost, plus maintenance cost, plus operation cost,"
    },
    {
      "start_time": 17419.24,
      "end_time": 17443.49,
      "content": " plus all these things. And that's where OpenAI gets to their $100 billion announcement that they had, right? Because they talked about $100 billion is phase one. That's this Abilene, Texas data center, right? $100 billion of total cost of ownership, quote unquote, right? So it's not KAPX, it's not investment. It's $100 billion of total cost of ownership. And then, and then there will be future phases. They're looking at other sites that are even bigger than this 2.2 gigawatts,"
    },
    {
      "start_time": 17443.49,
      "end_time": 17465.29,
      "content": " by the way, in Texas and elsewhere. And so they're not completely ignoring that. But there is the number of $100 billion that they say is for phase one, which I do think will happen. They don't even have the money for that. Furthermore, it's not $100 billion. It's $50 billion of spend, right? And then like $50 billion of operational cost power etc. Rental pricing,"
    },
    {
      "start_time": 17465.29,
      "end_time": 17486.31,
      "content": " et cetera, because they're renting it for opening eyes renting the GPs from the Stargate joint venture right what money do they actually have right soft bank soft bank is going to invest oracle's going to invest open A is going to invest Oracle's going to invest Open AI is going to invest Open AI is on the line for $19 billion everyone knows that they've only got $6 billion in their last round and $4 billion a debt. So, but there is, there's like news of like soft bank,"
    },
    {
      "start_time": 17486.47,
      "end_time": 17506.93,
      "content": " maybe investing $25 billion into opening. Right so that's that's that's that's part of it right so 19 billion can come from there so opening i does not have the money at all right To be clear, ink is not dried on anything. Open has zero dollars for this $50 billion, right? And which they're legally obligated to put $ 19 billion of CAPEX or into the joint venture, and then the rest they're going to pay via renting the GPUs from the joint venture."
    },
    {
      "start_time": 17506.93,
      "end_time": 17527.49,
      "content": " And then there's um then there's Oracle. Oracle has a lot of money. They're building the first section completely. They were spending for it themselves, right? This $6 billion of Kappex, 10,000. they were spending for it themselves right this six billion dollars of cap x 10 billion dollars a tCO um but they and they were going to do that first section they're paying paying for that. Right. Um, as far as the rest of the section, I don't know how much Larry wants to spend, right? At any point, he can pull out, right?"
    },
    {
      "start_time": 17527.49,
      "end_time": 17552.24,
      "content": " Like this is again, it's like completely voluntary so at any point there's no signed ink on this right but he potentially could contribute tens of billions of dollars right to be clear he's got the money. Oracle's got the money. And then there's like MGX, which is the South, the UAE fund, which technically has $1.5 trillion for investing in AI. But again, like, I don't know how real that money is. And like, whereas there is no ink signed for this. SoftBank does not have $25 billion"
    },
    {
      "start_time": 17552.24,
      "end_time": 17578.5,
      "content": " of cash. They have to sell down their stake in arm, which is, you know, the leader in CPUs and they, they IPOed it. This is obviously what they've always wanted to do. They just didn't know where they'd redeploy the capital, selling down the stake in arm. they just didn't know where they'd redeploy the capital. Selling down the stake in arm makes a ton of sense. So they can sell that down and invest in this if they want to and invest in open eye if they want to. As far as like money secured, the first 100,000 GB 200 cluster is like can fund be funded everything else after that up in the air is up in the"
    },
    {
      "start_time": 17578.5,
      "end_time": 17602.17,
      "content": " air money's coming I believe the money will come. I personally do. It's a belief. It's a belief that they are going to release better models and be able to raise more money. Right? Yeah. But like the actual reality is is that Elon's right. There is the money does not exist. What does the US government have to do with anything? What does Trump have to do with anything what does Trump have to do with everything he's just the hype man Trump is he's reducing the regulation so they can build it faster, right?"
    },
    {
      "start_time": 17603.69,
      "end_time": 17622.33,
      "content": " And he's allowing them to do it, right? You know, because any investment of this side is going to involve like antitrust stuff, right? Like, so obviously he's going to, he's going to allow them to do it. He's going to enable the regulations to actually allow it to be built. Uh, I don't believe there's any US government dollars being spent on this, though. Yeah. So I think he's also just creating a general vibe that this is regulation will go down"
    },
    {
      "start_time": 17622.33,
      "end_time": 17643.97,
      "content": " and this is the era of building. So if you're a builder, you want to create stuff, you want to launch stuff, you want to launch stuff. This is the time to do it. And so like we've had this 1.8 gigawatt data center in our data for over a year now. And we've been like sort of sending it to all of our clients, including many of these companies that are building the multi-gigawatts. But that is like at a level that's not quite maybe executives like seeing 500 billion dollars hundred"
    },
    {
      "start_time": 17643.97,
      "end_time": 17664.59,
      "content": " billion dollars and then everyone's asking them like so it could spur like another like an even faster arms race spur like another, like an even faster arms race, right? Because there's already an arms race, but like, this, this like $100 billion, $500 billion number, Trump talking about it on TV, like it could spur the arm race to be even faster and more investors to flood in and et cetera, et cetera. So I think I think you're right is that in that sense, that open"
    },
    {
      "start_time": 17664.59,
      "end_time": 17685.89,
      "content": " eye or sort of Trump is sort of like championing people are going to build more and his actions are going to let people build more what are you uh what are you excited about about these several years that are upcoming, in terms of cluster buildouts, in terms of breakthroughs and AI, like the best possible future you can imagine"
    },
    {
      "start_time": 17685.89,
      "end_time": 17706.09,
      "content": " in the next couple years, two, three, four years. What does that look like? years, two, three, four years. What does that look like? It could be very specific technical things like breakthroughs on post-training, or it could be just size, big, impressive clusters. I really. I really enjoy tracking supply chain and like who's involved in what. I really do."
    },
    {
      "start_time": 17706.09,
      "end_time": 17726.39,
      "content": " It's really fun to see like the numbers, the cost, who's building what capacity, helping them, figure out how much capacity they should build, winning deals, strategic stuff. That's really cool. I think technologically, there's a lot around the networking side that really excites me with optics and electronics, right, like kind of getting closer and closer, whether it be copackage optics or some sort of like"
    },
    {
      "start_time": 17726.39,
      "end_time": 17747.75,
      "content": " forms of new forms of switching. This is internal to a cluster. Yeah. Also multi-data center training, right? Like there's people are putting so much fiber between these data centers and lighting it up with so many different, you know, with so much bandwidth that there's a lot of interesting stuff happening on that end. Telecom has been really boring since 5G, and now it's like really exciting again on the harder side."
    },
    {
      "start_time": 17747.75,
      "end_time": 17768.8,
      "content": " Can you educate me a little bit about the speed of things? So the speed of memory versus the speed of interconnect versus the speed of fiber between data centers? Are these like orders of magnitude different? Can we at some point converge towards a place where it all just feels like one computer? No, I don't think that's possible. It's only going to get harder to program, not easier. It's only going to get harder to program, not easier."
    },
    {
      "start_time": 17768.8,
      "end_time": 17790.24,
      "content": " Okay. It's only going to get more difficult and complicated and more layers, right? The general image that people like to have is like this hierarchy of memory. So on chip is really close, localized within the chip, right? You have registers, right? Those are shared between some compute elements. And then you'll have caches, which are shared between more compute elements. Then you have memory, right, like HBM or DRAM, like DDR memory or whatever it is,"
    },
    {
      "start_time": 17790.24,
      "end_time": 17810.78,
      "content": " and that's shared between the whole chip. And then you can have, you know, pools of memory that are shared between many chips, and then storage and you keep zoning out, right? The access latency across data centers, within the data centers, within the data center, within a chip is differs. So like you're obviously always, you're always going to have different programming paradigms for this. It's not going to be easy."
    },
    {
      "start_time": 17810.88,
      "end_time": 17832.84,
      "content": " Programming the stuff is going to be hard. Maybe I can help, right? You know, with programming this. the the the way to think about it is that like there is there's sort of like the more elements you add to a task you don don't gain, you don't get strong scaling, right? If I double the number of chips, I don't get two X the performance, right?"
    },
    {
      "start_time": 17832.84,
      "end_time": 17853.56,
      "content": " This is just like a reality of computing, because there's inefficiencies. And there's a lot of interesting work being done to make it not, you know, to make it more linear, whether it's making the chips more networked together, more tightly, or, you know, cool programming models, or cool algorithmic things that you can do on the model side. DeepSeek did some of these really cool innovations because they were limited on interconnect,"
    },
    {
      "start_time": 17853.56,
      "end_time": 17875.78,
      "content": " but they still needed to parallelize, right? Like all sorts of, you know, all, everyone's always doing stuff. Google's got a bunch of work and everyone's got a bunch of work about this. That stuff is super exciting on the model and workload and innovation side, right? Hardware, solid state transformers are interesting, right, for the power side. There's all sorts of stuff on batteries and there's all sorts of stuff on, you know, I think when you look at, if you look at every layer of the compute stack,"
    },
    {
      "start_time": 17876.02,
      "end_time": 17896.74,
      "content": " whether it goes from lithography and etch all the way to like fabrication, to like optics, to networking, to power, to transformers, to cooling, to, you know, a networking, and you just go on up and up and up and up to stack. You know, even air conditioners for data centers are like innovating, right? Like it's like there's like copper cables are innovating, right? Like you wouldn't think it, but copper cables, are, there's some innovations happening there with, like,"
    },
    {
      "start_time": 17896.74,
      "end_time": 17921.22,
      "content": " the density of how you can pack them. And like, it's like all of these layers of the stack, all the way up to the models. Human progress is at a pace that's never been seen before. I'm just imagining you sitting back in a layer somewhere with screens everywhere, just monitoring the supply chain where all these clusters like all the information you're gathering i mean you're incredible there's a big. There's a big team. There's a big team. I mean, you're, you do quite incredible work with semi analysis."
    },
    {
      "start_time": 17921.22,
      "end_time": 17941.61,
      "content": " I mean, it's just keeping your finger on the pulse of human civilization in the digital world. It's pretty cool, like just to watch feel that. Yeah, thank you. I guess that. Feel all of us like doing shit, epic shit. Feel the AGI. I mean, from meme to like reality."
    },
    {
      "start_time": 17942.59,
      "end_time": 17965.73,
      "content": " What, Nathan, is there like breakthroughs that you're like looking forward to potentially? I had a while to think about this while listening to Dellen's beautiful response. He didn't listen to me. He was so no. I knew this was coming. And it's like realistically training models is very fun because there's so much low-hanging fruit and the thing that makes my job entertaining, I train models, I write analysis about what's happening with models."
    },
    {
      "start_time": 17966.45,
      "end_time": 17990.55,
      "content": " And it's fun because there is obviously so much more progress to be had. And the real motivation why I do this somewhere where I can share things is that there's just, I don't trust people that are like, trust me, bro, we're going to make AI good. It's like, we're the ones that it's like, we're going to do it and you can trust us and we're just going to have all the AI and it's just like I would like a future where more people have a say in what AI is and can understand it."
    },
    {
      "start_time": 17990.55,
      "end_time": 18014.05,
      "content": " And that's a little bit less fun that it's not a positive thing. I feel like, this is just all really fun like training models is fun and bring people in as fun but it's really like AI if it is going to be the most powerful technology of my lifetime, it's like, we need to have a lot of people involved in making that and making it open. Helps with that. As accessible as possible, as open as possible, yeah."
    },
    {
      "start_time": 18014.25,
      "end_time": 18035.18,
      "content": " In my read of the last few years is that more openness would help the AI ecosystem in terms of having more people understand what's going on, rather that's researchers from non-AI fields to governments to everything. It doesn't mean that openness will always be the answer. I think then it will reassess of what is the biggest problem facing AI and tack on a different angle to the wild ride that we're on."
    },
    {
      "start_time": 18036.18,
      "end_time": 18058.86,
      "content": " And for me, just from even the user experience, anytime you have the like Apathy said, the aha moments, like the magic, like seeing the reasoning, the chain of thought. It's like there's something really just fundamentally beautiful about that. It's putting a mirror to ourselves and seeing like, oh, shit, it is solving"
    },
    {
      "start_time": 18058.86,
      "end_time": 18079.6,
      "content": " intelligence as the cliche, like, goal of these companies is, and you get to understand why we humans are special. The intelligence within us is special. And for now also why we are special in terms of we seem to be conscious and the AI systems for now aren't. And we get to explore that mystery."
    },
    {
      "start_time": 18080.18,
      "end_time": 18100.86,
      "content": " So it's just really cool to get to explore these questions that I don't think, I would have never imagined, uh, would be even possible. Back when, so just watching with excitement, deep blue, Big Kasparov, like I wouldn't have ever thought this kind of AI would be possible in my lifetime."
    },
    {
      "start_time": 18101.46,
      "end_time": 18121.22,
      "content": " It's like, this really feels like AI. It's incredible. I started with AI of learning to fly a cilia quad rotor. It's like, learn to fly and it just like, it learned to fly up. It would hit the ceiling and stop and catch it. It's like, okay, that is like really stupid compared to what's going on now. And now you could probably, with natural language, tell it to learn to fly"
    },
    {
      "start_time": 18121.22,
      "end_time": 18142.55,
      "content": " and is going to generate the control algorithm required to do that. Probably. There's low level blockers. Like we had to do some weird stuff for that but you can you definitely back to our robotics conversation yeah when you have to interact an actual physical world that's hard what gives you hope about the future, a human civilization? Looking into the next 10 years, 100 years, 1,000 years, 100 years, 1,000 years."
    },
    {
      "start_time": 18143.15,
      "end_time": 18165.43,
      "content": " How long do you think we'll make it? You think we've got a thousand years? Humans will definitely be around in a thousand years. I think there's ways that very bad things could happen. There will be way fewer humans, But humans are very good at surviving. There's been a lot of things that that is true. I don't think they're necessarily we're good at long-term credit assignment of risk."
    },
    {
      "start_time": 18165.43,
      "end_time": 18194.07,
      "content": " But when the risk becomes immediate, we tend to figure things out. And for that reason, I'm like, there's physical constraints to things like AGI hyper like recursive improvement to kill us all type stuff. I'm for the physical reasons and for how humans have figured things out before, I'm not too worried about it. AI takeover. There are other international things that are worrying, but there's just fundamental human goodness and trying to amplify that."
    },
    {
      "start_time": 18194.51,
      "end_time": 18214.98,
      "content": " And like, we're on a tenuous time. And I mean, if you look at humanity as a whole, there's been times where things go backwards. There's times when things don't happen at all and we're on a, what should be very positive trajectory right now. Yeah, there seems to be progress, but just like with power, there's like spikes of human suffering."
    },
    {
      "start_time": 18215.72,
      "end_time": 18239.72,
      "content": " And we want to try to minimize the amount of spikes. Generally, humanity is going to suffer a lot less, right? I'm very optimistic about that. I do worry of like techno-fascism type stuff arising as AI becomes more and more prevalent and powerful and those who control it can do more and more. Maybe it doesn't kill us all, but at some point every very powerful human is going to want to"
    },
    {
      "start_time": 18239.72,
      "end_time": 18264.29,
      "content": " brain computer interface so that they can interact with the AGI and all of its advantages in many more way and merge its mind with, you know, sort of like, and its capabilities or that person's capabilities can leverage those much better than anyone else and therefore be, you know, it won't be one person rule them all, but it will be, you know, the thing I worry about is it'll be like few people, you know, hundreds, thousands, tens of thousands, maybe millions of people rule whoever's left, right?"
    },
    {
      "start_time": 18265.89,
      "end_time": 18284.85,
      "content": " And the economy around it, right? And I think it'll, that's like the thing that's probably more worrisome is like human machine amalgamations. This enables an individual human to have more impact on the world and that impact can be both positive and negative right? Generally, humans have positive impacts on the world, at least societally, but it's possible"
    },
    {
      "start_time": 18284.85,
      "end_time": 18310.05,
      "content": " for individual humans to have such negative impacts. And AGI, at least as I think the labs define it, which is not a runaway sentient thing, but rather just something that can do a lot of tasks really efficiently, amplifies the capabilities of someone causing extreme damage. But for the most part, I think it'll be used for, you know, profit-seeking motives, which will then reduce, which will increase the abundance and supply of things and therefore reduce suffering,"
    },
    {
      "start_time": 18310.21,
      "end_time": 18330.63,
      "content": " right? That's the goal. Scrolling on a timeline, just drawing stasis that is holding scrolling holds the status quo of the world that is a positive outcome, right? Like, it's like, if I have food tubes and lockdown scrolling and I'm happy, that's a positive outcome. While expensive Alka. While expanding out into"
    },
    {
      "start_time": 18330.63,
      "end_time": 18352.61,
      "content": " the cosmos. Well, this is a fun time to be alive. And thank you for pushing the forefront of what is possible in humans. And thank you for talking today. This is fun. Thanks for having us. Thanks for talking today. This is fun. Thanks for having us. Thanks for listening to this conversation with Dylan Patel and Nathan Lambert. To support this podcast, please check out our sponsors in the description."
    },
    {
      "start_time": 18357.62,
      "end_time": 18375.22,
      "content": " And now, let me leave you some words from Richard Feynman. For a successful technology, reality must take precedence over public relations. For nature cannot be fooled. Thank you for listening, and I hope to see you next time. You know, You know, Thank you."
    }
  ]
}