Prediction
When you send a message to an AI, it doesn't look up an answer — it predicts which word should come next, then the next, and so on. This prediction is based on patterns the model absorbed during training. Everything AI generates, from a short reply to a full essay, is the result of millions of these small predictions chained together.
Videos explaining this concept
E002Notes on AI
Why Generative AI Feels Different
Traditional AI (Machine Learning) has existed for decades—classifying data, ranking search results, and predicting outcomes. While useful, it always felt like a "system" or an algorithm. It was mec...
E003Notes on AI
How AI Thinks
LLMs are neural networks trained on vast text datasets. They identify patterns in connections between words and topics. This training gives them one primary capability: Prediction. They predict the...
E004Notes on AI
Why GenAI Advanced All at Once
Common perception links GenAI primarily to chatbots. However, GenAI is a broad family of models sharing a single "DNA": Prediction.
E005Notes on AI
What Is a Model, Really?
A model is a learned structure that predicts what comes next. The training process — analyzing massive amounts of text data — doesn't stay "alive" inside the model. It collapses and crystallizes in...
E010Notes on AI
The 5-Sentence Mental Model of GenAI
This episode provides a checkpoint after the foundational episodes, compressing the key concepts into five memorable sentences that serve as a mental compass for AI.
E016Notes on AI
Why Long Chats Drift
Long conversations degrade AI output quality -- not because the model loses intelligence, but because its context gets overcrowded. Language models generate responses based only on what is currentl...