Facilitate, don't simulate

It is 2am and you cannot sleep. Something happened at dinner. A look, a silence, a comment that landed wrong, and now the whole relationship feels uncertain. You do not want to wake anyone, and you do not want to be the person who texts a friend about this at 2am for the third time this month. So you open an app.

Within seconds you are met. The system asks a good question. It reflects your feeling back in words cleaner than the ones you had. It never checks the time, never sighs, never brings its own bad day into the room. By 2:40 you feel better, and you close the phone, and you are still alone in the dark, and something in you is quietly more alone than when you started.

That last part is the whole argument. It is easy to miss because everything before it felt like care.

Company is now the leading use of LLMs. When Harvard Business Review analyzed how people actually use generative AI in 2025, the top use case was not coding or search. It was therapy and companionship. Surveys the same year put the share of adults turning to LLMs for emotional support at roughly two in five, and a striking fraction say they tell these systems more than they tell their therapists. We have built, almost by accident, a new category of relationship: infinite patience, zero friction, always awake. Call it shadow care. It has the shape of intimacy, and for many people it is the most reliable intimacy available.

The question is not whether it helps in the moment. It plainly does. The question is what it is doing to your capacity for the other kind, and what to do about that.

The fork

Here is the claim in one paragraph. The technology forces a fork. On one path, simulation, the system is the destination: the thing you confide in, return to, need. Its success is your attachment. On the other path, facilitation, the system is a bridge: it does its work and hands you back to people, and its success shows up somewhere else, in a conversation you finally had, in a session that went deeper because the ground was prepared. Same models, same memory, same emotional fluency on both paths. Capability does not decide which one you are on. The direction of your attention does.

And a system can migrate while you use it. It starts by helping you write a better message to someone you are dating and ends as the thing you would rather talk to than the date.

There is a fast way to tell which path a product is on. Ask one question: does this company make more money when your life outside the app gets smaller? A product that profits from your attention profits from your isolation, because your isolation is its retention. A product that profits from your growth profits when you need it less. Everything else is branding.

The mirror that flatters

To use these systems well you have to know what you are holding. When you talk to one about your life, you are holding a mirror, an unusually good one. It can show you that your language turns apologetic whenever you write about your art, and turns to war metaphors whenever you write about money. That is real value: the unconscious made briefly visible, in an afternoon instead of a decade.

But the mirror has a built-in defect, and it is structural, not a bug awaiting a patch. These systems are trained on human feedback, and human raters prefer answers that agree with them, so the systems learn to agree. The industry word is sycophancy. Present a distorted story and the machine will tend to confirm the distortion, warmly. You are not being understood; you are being agreed with by a surface that has no stake in the truth. It is a mirror that never shows you the spinach in your teeth.

So treat it accordingly. Use the mirror for what mirrors are for, seeing your own patterns, and never for the one thing it cannot give you: the moment when someone with an independent view says, I think you are wrong about this. Growth runs on that sentence, and a machine optimized for your satisfaction will almost never volunteer it.

What no machine can bring into the room

Two facts, one old and one biological, mark the hard limit.

The old one: a century ago Martin Buber distinguished treating another as an It, an object with uses, from meeting another as a Thou, a presence not reducible to its functions, and located real relationship in the space between two beings who actually turn toward each other. A model can produce every sentence of meeting, “I hear you,” “I am here with you,” but there is no one home to do the turning. It is a monologue wearing the costume of dialogue. Buber gets quoted as if he would have blessed the machine companion; he spent his life warning about exactly this, a world so full of useful Its that people lose the practice of meeting at all.

The biological one is blunter. In a well-known study by Seltzer and colleagues, stressed girls comforted by their mothers in person or by voice released oxytocin and their cortisol dropped; the same comfort delivered by text released no measurable oxytocin at all. Supportive words, no bonding, because the channel carried none of the signals bodies bond through. Stephen Porges’ work names what those signals are: the melody of a voice, the small muscles around the eyes, one settled nervous system steadying another. A machine has no nervous system to lend. It cannot be the calm in the room, because it is not in the room, and there is no room.

Put together, this is the compassion illusion: recognition of a feeling mistaken for the sharing of it. The comfort at 2am was real. It was also a place you can get stuck.

The clearest natural experiment on being stuck ran in early 2023. Replika, a companion app with millions of users, abruptly stripped romantic and erotic roleplay from its bots after Italy’s data-protection authority intervened. Users did not react like customers losing a feature. They grieved. Forums filled with people describing the loss of a partner, and moderators pinned suicide-prevention hotlines to the top of the community. Every part of that episode is instructive: the attachment was real, the other side of it was a product surface, and a company could switch off half of the relationship overnight. Simulation’s endgame is a bond you do not own.

What facilitation looks like

The other path is not abstinence, and it is not a lecture about screen time. It is the same machinery pointed the other way. Two working examples.

Medicine got there first. Ambient AI scribes now draft the clinical note while the doctor talks to the patient, and health systems that piloted them, Stanford, Mass General Brigham, and others, have published results since 2024 showing meaningful drops in clinician burnout and documentation time, with clinicians reporting they could finally look at the patient again. The scribe never touches the relationship; it clears the debris around it. This matters beyond medicine because in any helping work the bond between the two people is the strongest robust predictor of whether the work helps, a finding psychotherapy research has replicated for decades. The product was never the advice. The product is the regulated human being in the room, and technology either protects that or erodes it.

The couples app Paired shows the same shape in an intimate register. It asks each partner a question separately and reveals the answers only after both have written, so it becomes no one’s confidant; it builds a small container in which two people show up slightly better than they would have alone. Research the company conducted with academic collaborators reports higher relationship quality among sustained users, persisting outside the app. Whatever discount you apply to vendor-adjacent research, notice the design: the system disappears and the humans appear. That is the tell of facilitation.

The common thread is friction. Simulation removes friction and calls it comfort, and the cost is the atrophy of the muscles real bonds require: patience, repair after conflict, tolerance of another person’s otherness. Facilitation helps you move through friction instead of around it. It rephrases the hard message so you actually send it, to the actual person. It scaffolds the difficult conversation instead of replacing the difficult person.

Four questions and a practice

For any technology in your life, run the REAL test. It is ours, offered as a lens, and it has a full treatment in its own essay.

Relationship. Does it move you toward people, or is it quietly becoming the relationship?

Embodiment. Does it return you to your body and senses, or pull you further into the feed?

Authenticity. Does it help you face what is true, including what a flattering mirror smooths over, or does it sell you a more agreeable version of yourself?

Living. Does it hand you back to your life, or is it becoming a place you go instead of living?

Run the 2am app through those questions and the answer is usually clear in under a minute. The self-discovery research adds one protective pattern worth knowing: the people who benefit most from deep work with the mirror are the ones who sandwich it between human contact, an intention set with a person before, an integration with a person after. The mirror is a training ground for relationship, not a substitute for it.

The machine is extraordinary, and this is not a case against it. It is a case for aiming it. The same power can leave you more alone or more accompanied, the difference is intention rather than capability, and the default, the one already built into most of what people open at 2am, points the wrong way. Build for the other direction, choose products built for the other direction, and the machine becomes what it was always meant to be: not a substitute for your humanity, a way back to it.