You can now kind of run Kimmie K3, the strongest, biggest, open-weight model in the world, locally!

You can now kind of run Kimmie K3, the strongest, biggest, open-weight model in the world, locally. This company here, Unsloth, amazing. What they do is shrink local models to a much smaller size than what they usually come out as. And basically, what they're claiming is that you can now run a one-bit version of Kimmie K3 for less than 600 GB of RAM. Coming from, of course, nearly 1.6 TB of RAM. This would mean that you could run this before if you had like six of these. Or you had four of these, 512 GB. This one is 256 GB, right? This big one. So you can now run KIK3. It'll be super slow, not as smart, not as good as the Cloud Base version, not as good as the full version, but still you could run it, but you would need like three of these, 256 GB. And the cost alone is a reason not to do this because you would need three of them, like I said, and that would cost you $27,000, nearly $30,000. craziest thing is that if you wanted to run it full and you needed 1.6 terabytes worth of RAM, you would need literally more than three of these at 512 GB, which would be no, no joke more than $60,000.