Keyboard shortcuts

Press or to navigate between chapters

Press S or / to search in the book

Press ? to show this help

Press Esc to hide this help

2.9 Final Takeaways

Token efficiency is the foundation of strong chatbot design. Every token you spend either helps the model perform or dilutes its focus. Treat your token budget as a scarce resource — because it is.

Efficiency is balance. Permanent tokens are your rent. They anchor Personality, Scenario, and Advanced Prompt every turn. Temporary tokens are your groceries. They hold the actual conversation, but scroll out when space runs out. If rent is too high, there’s no room in the fridge.

Efficiency is placement. The U-shaped memory curve means the start and end of your prompt carry the most weight. Put Personality first to anchor identity. Put Scenario and Advanced Prompt last to guide live behavior. Never bury critical rules in the middle.

Efficiency is pacing. The bot mirrors your opener. A short sentence leads to short replies; a long description leads to longer replies. Use this deliberately. Scenario pacing rules can reinforce the rhythm you want.

Efficiency is trimming. Trivia, census-style biography, hedges like “might” or “sometimes,” and passive phrasing waste space without shaping behavior. Cut them. Replace with active, directive language the model can act on.

Efficiency is collapsing. Combine overlapping lines. Group categories. Preserve nuance, but spend tokens only where they produce distinct effects.

Efficiency is signal. Signal tokens change voice, behavior, pacing, or formatting. Noise tokens add flavor but don’t guide the model. If a line doesn’t change how the bot talks or acts, it weakens the whole prompt.

Efficiency is stability. Bloated prompts cause confusion drift. Leaner builds with strong signals not only start sharper but stay consistent over long chats.

Design Lesson

Think of yourself as both writer and engineer. Your goal is not to write the most detailed biography, but to craft the clearest instructions. Every token is a tool. Use each one to strengthen behavior, reduce noise, and maximize memory.