This video promotes it, but we haven’t matched it to a product page yet, so there are no product figures.
The video breaks down a complex topic (building an LLM) into digestible, sequential parts, making it accessible to a broad audience interested in AI and machine learning. The creator's clear explanations, visual aids, and direct call to action with a GitHub repository encourage engagement and learning.
This video explains the process of creating a character-level tokenizer for a language model. It details how to convert text into numerical tokens, create encoding and decoding functions, and prepare the data into tensors and batches for model training. The creator demonstrates the steps using Python code and a GitHub repository.
Let’s build a language model completely from scratch. Neural networks cannot read letters, words, or sentences, so in Part 2, we build a character-level tokenizer that converts Shakespeare into numbers. Then we organize those tokens into input and target batches that our model can actually learn from. Follow along with the complete code: https://github.com/lerabyte/llm-from-scratch #ai #llm #STEM #python #machinelearning
Promotes 1 product. Create free account to see more.
Outliers and viral hits: their videos on Overshot, all time.
Build an LLM With Me
Introduction to building an LLM and the need for tokenization.
Explanation of different tokenization methods (character, word, subword).
Demonstration of creating a character-level tokenizer using Python.
Explanation of vocabulary creation and assigning numerical IDs to characters.
Creation of encode and decode functions for converting text to tokens and back.
Preparation of data into tensors and training batches.
Overview of the next steps in building the LLM.
Python (programming language) - used to build the LLM. It acts as the programming language for the project. Removing it would change the entire project. GitHub (platform) - hosts the code for the LLM project. It appears as a repository for the code. Removing it would make the code less accessible. Udemy (online learning platform) - offers a supervised ML course. It appears as a link in the creator's bio. Removing it would not change the video content.
Follow along with the complete code: https://github.com/lerabyte/llm-from-scratch
Playing this video’s own audio, so you’ll hear the creator over the sound.