This piece is a thought experiment conducted through simulated interviews from the perspectives of cognitive neuroscience and AI memory engineering—representing no actual experts.
In March 2026, I wrote in a note: In the AI era, perhaps forgetting is more important than remembering.
The image that came to mind was simple: a water layer with hot, warm, and cold strata. Recently used knowledge resides in the hot layer, while content untouched for a while gradually sinks downward—only being retrieved under exceptional circumstances. If a knowledge system absorbs information without releasing it, it will eventually degenerate from wisdom into a mere repository.
But making a system forget something is far harder than simply storing content. Writing requires only a single action, while forgetting demands judgment: Is it truly obsolete, or temporarily dormant? Has it become erroneous, or merely shifted context? And once deleted, who bears responsibility for the lost evidence?
Biological Memory Is Never an Infinite Hard Drive
Me: Why does the human brain forget? Is it simply insufficient capacity?
Cognitive Neuroscientist: There is no single answer. Forgetting may result from changes to a memory trace, temporary retrieval failure, altered cues, or active suppression. These mechanisms operate on different timescales and vary in reversibility. A 2022 review proposed that some instances of forgetting may reflect memories moving from accessible to inaccessible states rather than being erased. That is an important account, but not a complete explanation of every form of forgetting. Ryan & Frankland’s Review
Some experiments support the adaptive value of forgetting: repeatedly retrieving a target memory can make competing memories harder to retrieve later and reduce the burden on cognitive control during subsequent choices. But laboratory results do not transfer automatically to real life. A 2024 review distinguished intentional from unintentional active forgetting and emphasized the gaps between controlled experiments and everyday settings. Fawcett et al.’s Review
Therefore, trace decay, retrieval failure, active suppression, and interference cannot all be reduced to “deleting a data point.” Using the human brain as a database analogy provides design inspiration but cannot serve as engineering proof.
Me: So forgetting might also be a sign that learning is complete?
Cognitive Neuroscientist: Sometimes this perspective holds. You no longer remember the details of each practice but retain the ability to ride a bike. However, procedural learning and episodic detail systems operate differently—so we cannot conclude that details have been “refined” into skills. Trauma memories involve even more complex mechanisms and should not be reduced to a single phrase like “the body has let go.” The only safe judgment we can make here is that accessibility, behavioral impact, and whether content remains stored are three distinct matters.
The Peril of Old Memories Holding Power
When people discuss agent memory, the goal is often a longer, more complete, more continuous record—an agent that remembers preferences, projects, relationships, and every past decision, like a partner who never forgets.
AI Memory Engineer: This goal implicitly assumes an unchecked premise: more relevant historical data always improves current judgment.
In reality, old information creates at least four types of contamination. First, factual obsolescence—such as project architectures that have changed. Second, preference drift—users no longer being the same as they were two years ago. Third, explanation solidification—where a single emotional event becomes entrenched as long-term personality. Fourth, retrieval competition—where numerous similar contents crowd out truly critical context.
Agents don’t naturally understand time simply by remembering more. Without versioning, expiration dates, or counter-evidence, the more complete the memory, the more persuasive outdated information becomes.
Me: Wouldn’t using recent frequency be enough for decay?
AI Memory Engineer: No. Usage frequency can only approximate “activity”—not “accuracy” or “importance.”
Wills, personal boundaries, and safety incidents may be retrieved rarely, but they cannot simply be forgotten. A mislabeled user profile, meanwhile, may grow increasingly “hot” through repeated reference. If retrieval count alone reinforces memory, the system risks treating its own bias as evidence about the user.
Forgetting must be determined by time, usage, reliability, risk, and user intent together.
Identity Memories Cannot Automatically Accumulate
I once imagined that notes for agents go beyond mere memory assistance—they help build self-continuity. Each session ends, yet external vaults allow the next startup to generate similar preferences, styles, and thought paths.
But continuity carries costs.
Cognitive Neuroscientist: Humans can change partly because self-narratives aren’t perfect. We reinterpret the past and gradually lose accessibility to certain old identities.
If an external system preserved every instance of your saying, “I am like this,” with high fidelity and proactively returned it, it might undermine this flexibility. You’re just trying to try a new life when the system politely reminds you: “According to long-term records, you dislike stability.” This isn’t understanding—it’s the past exercising veto power over the future.
AI Memory Engineer: Therefore, identity-related memories should default to propositions—not facts. They must carry:
- Specific evidence supporting them;
- The context and timeframe in which they formed;
- Counterexamples that contradict them;
- Whether the user still endorses the proposition or identifies with it;
- Triggers for the next review.
The system could say, “This tendency has appeared in the past six months under these conditions”—not “You are a person who is like this.”
The Right to Be Forgotten Is More Than a Delete Button
Me: If users can delete memories at any time, isn’t the problem solved?
AI Memory Engineer: The delete button is only the endpoint of control. The real power operates before deletion: what is preserved, how it is summarized, when it is recalled, and how much influence it has over action.
A raw conversation might be deleted, but its generated preference summary remains; the summary is used for recommendations, which then generate new data—old judgments have already spread across the system’s layers. To discuss forgetting, we must be able to trace a judgment’s origin and downstream effects.
This is why auditable forgetting matters more than a one-click “clear all” button. A system should be able to answer: What was deleted? Why? Which derived conclusions are now invalid? Can the deleted material be restored?
But here lies a conflict: if users demand complete deletion of sensitive content, how can the system retain audit evidence? A deletion log recording the original content is itself an un-deleted record.
A more practical approach might be to retain only irreversible summaries: event IDs, deletion timestamps, scope of action, policy versions, and success status—without preserving the deleted content. If regulatory or security audits require stronger proof, the evidence materials and online memory stores should be isolated, with explicit retention periods. The article cannot skip this trade-off with just the word “auditable.”
How Far Does a Single Delete Request Travel?
Assume a user says, “I hate stable work.” The system writes the original statement to an event log, generates a preference summary (“high autonomy”) at night, writes it to the profile, creates embeddings for two pieces of content via vector indexing, and recommends travel to the user. This recommendation is recorded in chat summaries, becoming evidence for the next cycle of “long-term preference for travel.”
Now the user requests deletion of the original statement.
Deleting the event log alone is insufficient. The system must trace the source relationship to find the profile summary, mark it for re-calculation; delete the corresponding vector index entry; invalidate the recommendation cache; and check which conclusions in chat summaries depend only on that preference. If derived judgments still incorporate other evidence, they cannot be simply deleted—they require recalculating confidence levels.
The real challenge is that many existing memory stacks don’t preserve lineage for this event. After summary generation, only text remains—without knowing which original events it depends on. At this point, “retraction” can only perform approximate cleanup and cannot prove that influence has vanished. Model providers’ caches, backups, and logs may even exist outside the system boundary—making a single local deletion impossible to cover the entire chain.
Therefore, deletion capability must be designed at the point of writing. Every derived memory must carry source IDs, generation strategies, and versions; each retrieval and re-summarization preserves minimal dependency graphs; caches have explicit lifespans. Without source relationships, the right to forget is merely a promise at the interface.
A Five-Layer Decay Mechanism
If designing memory for long-term agents, I would categorize it into five types—not a single vector database:
- Factual Records: Retain timestamps and sources; maintain verifiable versions of new and old facts.
- Task Status: Rapidly cool after completion, retaining only decisions and post-mortems.
- Skills and Procedures: Updated based on success rates and environmental compatibility—cannot be automatically discarded due to low frequency.
- Preferences and Identity Propositions: Default to questionable until evidence, counterexamples, and review deadlines are provided.
- Safety and Ethical Constraints: Low-frequency but high-weight; modifications require stricter authorization.
On top of this, we design three forms of “forgetting”:
- Cooling: Still retrievable but not actively included in context.
- Archiving: Moved from working memory; only returned when explicitly traced.
- Retraction: Content and derived judgments are invalidated, with auditable traces retained.
The system should also periodically conduct reverse retrospectives: Why do certain memories keep appearing? Are they simply being repeatedly referenced by the agent? Which long-dormant memories, if missed, could cause irreversible damage?
When Should We Forget—And Who Decides?
Me: Can the model itself decide which content to discard?
AI Memory Engineer: It can propose suggestions but cannot unilaterally decide. Forgetting involves value judgments—not just relevance.
For the system, a failed experience might be “low value”; for a person, it could be the origin of moral boundaries. Models can estimate usage probability but cannot know what a person is willing to become—unless that person actively participates in defining it.
A more prudent mechanism is tiered autonomy: low-risk task noise automatically decays; identity and relationship judgments require confirmation; high-risk constraints need explicit authorization. Every time the system suggests forgetting, it should also provide reasoning and a recovery window.
First, Implement a Real Retraction
We want agents to remember themselves so they don’t have to start from scratch each time. If continuity relies solely on repeating old judgments, this “self” will gradually become a stable historical burden.
Rather than designing grand forgetting philosophy first, I’d test the preference above: write the original event, generate summaries and embeddings, let it influence one recommendation; then issue a delete request and observe whether the system can trace all derived items, recalculate mixed conclusions, and provide audit results without revealing the original text.
If it fails, we shouldn’t yet promise that “agents understand letting go.” They don’t even know where a single sentence ends up.
Responses