FG—01AI Design Field Guide

Search the field guide

Search chapters, principles, patterns, worksheets, and glossary terms

PR—08

Make memory legible

If the system remembers, people must be able to see, edit, and delete what it holds.

The moment an AI remembers something about you, the ownership question is live: whose fact is it? Products that treat accumulated memory as internal state — theirs to hold, invisible to you — get the uncanny moment wrong every time. The assistant references your daughter’s name or your health situation unprompted, and instead of feeling served, you feel watched. The exact same memory, made visible and editable, produces the opposite reaction. Legibility is the difference between a good memory and a dossier.

ChatGPT’s memory feature is the reference implementation of the honest version: it announces “memory updated” in the moment a fact is saved, and keeps a plain-language list in settings where each entry can be deleted individually or wholesale. Claude takes editability further by letting you view and directly edit what it carries between conversations. The load-bearing detail in both is the in-the-moment save notice — memory writes announced when they happen, not discovered months later in a settings archaeology dig.

Legible memory must be written in the user’s language, not the system’s. “Prefers concise answers with code examples” is a memory a person can ratify or reject; an embedding is not. This constrains your architecture, and it should: if you cannot render a remembered fact as a sentence a person can read and delete, you should think hard about whether you’re entitled to remember it. The same standard applies to personalization built on behavioral signals — if the system is adapting to you, the “why” behind the adaptation belongs on the same inspection surface as explicit memories.

Session context is memory too, and deserves the same legibility. When someone attaches a document or connects a data source, the system should show what it’s actually drawing on — which files, which sections — because “what does it currently know?” is the question underneath every confused AI interaction. Products that show attached context as visible, removable chips answer it structurally; products that silently accumulate context leave people guessing why the answers went strange.

Get the deletion contract right and get it right the first time. Delete must mean delete — not “hidden from the list but still shaping responses.” One incident of a “deleted” memory resurfacing in an answer destroys the entire feature, because it proves the inspection surface was theater. Memory is the highest-trust feature an AI product can ship, which means it is also the one place where a single broken promise is unrecoverable.

The counter-argument is technical and real: the constraint “every memory must be a deletable sentence” forecloses the most powerful personalization architectures. Rich user models — embeddings, behavioral traces, fine-tuned adapters — cannot be rendered as a settings list, and they demonstrably personalize better than a bag of extracted facts; Spotify and TikTok built beloved products on utterly illegible taste models, and nobody demands to edit their embedding. Legibility also has an awkward UX cost: “memory updated” notices interrupt flow, and a settings page of facts about yourself reads as creepy to some users precisely because it makes the dossier visible. Why not let results speak for themselves? Because a recommendation feed and an assistant carry different intimacy. TikTok guessing your taste in videos is a parlor trick; an assistant knowing your daughter’s name is a relationship, and relationships run on accountability. The architecture constraint is the point — if a remembered fact can’t survive being shown to the person it describes, the product shouldn’t be carrying it. Illegible personalization is a fine engine for content; it is a disqualifying foundation for trust.

Memory is measured by whether people garden it. The healthiest signal is the memory-edit rate: what share of users with saved memories have ever viewed the list, corrected an entry, or deleted one. Good looks like a meaningful minority actively gardening — near-zero engagement means the inspection surface is undiscovered or distrusted decoration, while mass deletion or memory feature disablement signals the writes feel invasive. Track save-notice comprehension too: after a “memory updated” moment, do users’ subsequent prompts stop restating that fact? If people keep re-explaining preferences the system already holds, memory is legible in settings but not in behavior. The zero-tolerance metric is deletion integrity: automated evals that plant a memory, delete it, then probe hundreds of ways for its influence — the acceptable resurfacing rate is zero, tested every release. And watch the uncanny-moment complaint rate: “how did it know that?” tickets should not exist in a legible system, because every recall should be traceable to an entry the person could have read yesterday.