Skip to content
Notes on AIE007Act 1 — Mental Models

What AI Receives When You Send a Prompt

E007 · by — AI Strategist, Practitioner & Educator · Founder, AI Center of Excellence

In reality, the prompt is only the visible "Top Slice" of a much larger input stack (System Prompt + Context).

Full Explanation

A Prompt is commonly misunderstood as the sole input to an AI model. In reality, it is only the visible "Top Slice" of a larger input stack, best understood as a Prompt Sandwich.

  1. Bottom Slice (System Prompt): Hidden, persistent instructions from developers (safety rules like "be polite", "don't be racist", medical disclaimers) that are injected by OpenAI, Google, or other model providers. This foundation is always there, supporting every interaction.
  2. The Filling (Context): The dynamic layer containing everything you talked about before in the chat, information you attached to the conversation (PDFs or other documents), and web search results if the model searched the web. This provides the immediate information the model uses alongside your prompt.
  3. Top Slice (User Prompt): The visible request you type—the only part you see and control.

The model does not process the prompt in isolation; it processes ("eats") the entire sandwich simultaneously. It tastes the bottom slice (safety rules), the filling (your history), adds stored information about you (name, age, preferences), and then generates the answer. If the AI refuses to answer you or answers in a weird tone, remember that it received much more than just your prompt—these partially or completely hidden instructions are shaping the taste of the answer.

---

Transcript

Read every word ↓

When you type a message in the chat box of an AI assistant, it feels simple. You type 'help me to write an email', you hit enter and you think that's it. You think that you have just sent these instructions and nothing more than that to the model. The reality is a bit different. The model receives much more than what you have sent. In order to explain what is actually happening, let's think of a sandwich which the model will be eating after you press enter. The top slice of bread is your prompt, which is also called the user prompt.

The bottom slice of bread is the system prompt. This is injected by OpenAI, Google or other model providers. You didn't write this. These companies have created the system prompt for you and injected it. It contains hidden rules like be polite, don't be racist, and if asked for medical advice, say that you're not a doctor. This is the foundation. It's always there, holding everything up. The filling is the context. This is everything you talked about before in this chat. This is also information you attach to the conversation, like PDFs or any other documents.

And what if the model also searched the web? Those search results are injected into this filling too. If you mentioned 5 minutes ago that you are vegetarian, that information is in the middle of the stack. So if you type 'write me a dinner plan', the model doesn't just look at the top slice. It takes a bite of the whole sandwich. It tastes the bottom slice, the safety rules. It tastes the filling, your history. It adds some things which chat providers stored about you, like your name, age, maybe eating preferences, and then it tries to eat the whole sandwich.

So if the AI refuses to answer you or answers you in a weird tone, always remember that it didn't receive just your prompt, it also received a lot of additional information. These partially or sometimes completely hidden instructions are shaping the taste of the answer. This was a note on AI for today. I hope you liked it and I'll see you in the next one.

Resources

No dedicated resources for this episode yet.

Browse the resource library →

Newsletter

Found this useful?

Join the newsletter. You get one e-mail when something new and useful is out: a video, a guide, a tool. No spam, no schedule, and you can leave with one click.

Alexey Makarov

Alexey Makarov

AI Strategist, Practitioner & Educator. Founder & Global Lead of the AI Center of Excellence at SEFE. Creator of the Unreasonable AI YouTube channel. Based in Berlin.

About Alexey →