Hook

Their other posts in the index, biggest breakout first.
Once you start relying on these LLMs, you are beholden to them. At any point, and we've actually seen them do this, they can decide that they no longer wanna service you, and they just cut you off. You're just done, and that's completely within their power. Think about this for a second. That vendor can say, I'm not gonna let you use our model anymore. So you, you've spent, let's say, a year building up this entire infrastructure around their model. It's fantastic, it does all the powerful things, and then suddenly one day they say, nope, you're done. Now what do you do? Will that infrastructure work with this other model? That is a huge risk for businesses or people trying to build reliable systems that this can be taken away from you. This is the central thing that you work around, and then, vroom, it's just gone. In my mind, it's a showstopper to me, which is principally why I am absolutely moving away from LLMs. That, that's just too much of a dependency on companies that I do not trust. We've seen serious bad actor behavior from OpenAI and Anthropic doing all kinds of wacky things. I absolutely do not trust that they're gonna behave correctly, not just decide one day that, sorry Goju, we don't like the way that you're using our models and you're done with Opus. And I'm basically up shit creek because I built everything around them. Whereas with the SLM approach, you have all the stuff, they can't take it away. You have the entire infrastructure locally. While it may not have all the power and it may lack some of the uber-ness of the LLMs, this benefit, I think, is a huge win in terms of creating an environment that is gonna be iteratively refinable, that you don't have to wake up in the morning and wonder, did Anthropic cut me off today? Or did Anthropic decide that they're switching to an API cost model, and now suddenly it's not $200 a month, it's gonna be upwards of $10,000 a month?