← All topics

// Topic#LLM

EN

Why AI Forgets in the Middle of a Conversation

Brilliant at first, forgetful later — nearly everyone knows the feeling with AI chatbots. Not a defect but by design: an AI reads text in pieces (tokens) and has only a limited "desk", the token window, where everything sits at once. When it fills up, the oldest items fall off (it forgets) and what matters gets buried (it grows imprecise). Both can be tamed — by hand and with sub-agents.

Read more →