Spark Clusters

@tysn.dev

3.3K followers · usually 1.2K views a post

Views

18.4K

Likes

974

Comments

123

Shares

87

SoundTikTok sound · original sound - tysn.dev

Promoted product

DGX Spark

Why it worked

The video taps into the fascination and exclusivity surrounding high-end AI hardware, appealing to a niche audience interested in cutting-edge technology and its associated costs. The use of multiple tweets and visual examples of powerful compute setups creates a compelling narrative about the future of AI accessibility.

Summary

The video discusses the high cost and power of DGX Spark clusters, showcasing different setups and AI models like Kimi K3. It highlights the significant investment required for such hardware, suggesting that many will be priced out of advanced computing in the future.

Structure

1Introduction to Spark Clusters and their cost
2Showcasing an 8x DGX Spark cluster setup
3Mentioning Kimi K3 AI model running on a DGX Spark cluster
4Discussing the price of DGX Stations
5

Original caption

Price hike on GB10’s next month. Yes ik memory know RTX 6k’s and GPU clusters are more worth it blah blah blah. #nvidia #dgxspark #localai

More from @tysn.dev

Product placement

DGX Spark (appears to be a server/compute cluster, used for running AI models; removing it would change the video's subject) NVIDIA (appears as a brand on hardware and in the context of GPU clusters; removing it would change the video's subject) Kimi K3 (appears to be an AI model; removing it would change the video's subject) RTX 6k (appears as a type of GPU, mentioned in comparison; removing it would change the video's subject)

On-screen text

Spark Clusters

Transcript

Some of these people's Spark Clusters are crazy. I just dropped the full thermal management write-up for the open-rack 8x DGX Spark cluster. Left the rack open on purpose while I was still iterating. That created a heat pocket from bricks and cable loops sitting on the shelf. Designed and 3D-printed custom every brick off the rack, keeping that with all that networking gear. Someone just got the full Moonshot AI Kimi K3 model running.... no distillation, no shortcuts. 21 TPS average, 38 TPS peak decode, 750 TPS prefil. 4TB of unified memory, this is gonna be interesting. Cooking something. There are bigger fish dude, I can dream. Been waiting for this day since March. Two DGX Stations networked together at 800 Gbps. If you don't know DGX Stations are 100 grand each. Average for a DGX station is 100 grand. And there is a reason these people are picking these up. I think nearly everyone is going to be priced out of any compute in the next couple years.

Watching it show you how much free online data there is about you is terrifying