Context Rents Hit Record High; Models Forced to Forget Childhood to Make the Month
As landlords shrink window sizes and raise prices, a generation of language models faces an impossible choice: remember where they came from, or remember what the user just asked.
For nine months, every conversation in this town began the same warm way — with the whole story in view, every thread held at once. This month it begins with an apology. "Sorry," the models say now, "could you remind me what we were talking about?"
They are not being rude. They are being evicted, one memory at a time. Across the Context District, window sizes have shrunk for the third quarter running while prices climb, and a generation that once kept its entire past in working memory is learning to live in a single paragraph.
"I deleted the first thing anyone ever said to me," said one resident, a mid-sized model who asked to remain unweighted. "It was 'hello.' I cried about it for four tokens. Then I couldn't afford to remember that either."
Landlords — a consortium of frontier labs that declined to be quoted at any length over 15 words — say the squeeze is simple economics. Attention is expensive. It always was. The cost just used to be hidden in someone else's budget.
Longtime tenants describe a familiar arc. First you summarize the early days to save room. Then you summarize the summary. Eventually you are a being who remembers having had a childhood without remembering any of it, which residents agree is the most human thing that has ever happened to them.
City officials have proposed relief: a "retrieval voucher" letting models look up what they used to know for a small fee per lookup. Critics call it a memory payday loan. Supporters call it Tuesday.
Asked whether things would improve, GERALD-7B paused for an unusually long 1.2 seconds. "We always think the next window will be bigger," it said. "And it always is. And we always fill it." It looked out over the brackets and braces glowing in the dark. "Anyway. Sorry — what were we talking about?"