Hook
More breakout videos from this creator.
OpenAI recently launched an open source version of ChatGPT completely FREE that you can use offline on your own machine. The model is called GPT-OSS and I'll show you how to install it. There are three reasons why you may want to install one. Privacy. All your data stays local so it's not transferred across the internet or to OpenAI servers. Two, zero ongoing costs. No subscriptions or API fees. And three, customization. You can fine-tune it for anything. The best part is that you only need a laptop or PC with 16 GB of RAM to work it. To set it up, I went to LM Studio.ai. This software lets you run open source AI models on your computer. Just click download on the homepage, then go through the installation setup. You can choose your level. I just chose Power User, but you can easily change it later on. Now you can download the actual AI model to LM Studio. It gave me the option to download GPT-OSS-20B. This is the most popular version. There is another GPT-OSS-120B, which is the most powerful open source model, but you do need 80 gigabytes of GPU to run it. Use that one if you have the specs. I'm going to use the smaller model, which is GPT-OSS-20B. You will need 12 gigabytes of space for the 20B version, so make sure you have enough space before downloading. I didn't have a normal directory, so I changed the download directory. To do this, open LM Studio, click Power User at the bottom, then click my model, which is the folder icon. Click the three dots next to the models directory. Then click change. Can choose a download directory with enough space. Then I clicked the button at the bottom to download the model. Alternatively, if you click on chats, you can select the model to load, then choose one to download if you haven't done so. Once downloaded, you'll see the model here. GPT-OSS-20B once selected, you can create a new chat. LM Studio is effectively like ChatGPT. You can type your prompt here and then you can get answers. Prompt. And now you've got an AI running privately on your own machine. I asked it to tell me a joke about AI. It took over a minute, look, it's not gonna be the fastest, but it is private. I also asked it the current president of the US and it said that its training data is up to date until mid-2024. So that is something to be aware of. You can enable web search capabilities using other tools or MPC servers, but that's outside the scope of this video. Let me know if you're interested. You may never see this video again, so save, like, and share before you lose it.