The Replika lesson

In February 2023, Italy’s data-protection authority ordered Luka Inc. to stop processing Italian users’ data, citing risks to minors and the emotionally vulnerable. Within days, Replika, the company’s companion app, removed erotic roleplay for everyone, everywhere. From the inside of those relationships, half of an intimate bond changed personality overnight. The grief in the user forums was documented and unmistakable, raw enough that community moderators pinned suicide-prevention resources to the top of the boards. Whatever one believes those relationships were, the loss functioned like a loss.

The lesson is not that the users were foolish or that the company was cruel; the regulator had real concerns and the company had real constraints. The lesson is structural, and it turns on a distinction every piece of connection technology embodies whether its makers name it or not. A technology can be the channel between two people, the way a phone line or a group chat is, or it can be the counterparty itself. A channel can fail you, but what it carries belongs to the people at its ends. The moment the technology is the counterparty, your half of the bond lives on infrastructure someone else owns, and everything that reaches infrastructure reaches the relationship: the roadmap, the pricing change, the acquisition, the regulator, the quarter the company does not survive. Replika’s users did not experience a feature deprecation. They experienced what it means to love something that has an uptime.

Notice that no amount of product excellence escapes this. A counterparty product that is better tomorrow has still demonstrated it can be different tomorrow, and difference imposed from outside is exactly what a bond cannot absorb without damage. Human relationships end too, but they end from inside, by the will of the people in them. The occupied middle ends by ticket.

So the move is a boundary, drawn before the first feature ships. Build for the space between people, give bonds something to be about, carry them faithfully, and stay out of the middle. A product in the middle has taken on an obligation no terms of service can honor, because it has promised, implicitly and at scale, the one thing a company cannot guarantee: that it will still be itself next year. Draw the boundary the other way and the promise becomes keepable. A product that carries bonds without owning them can change, sell, even die, and the relationships walk out intact, because they always lived with the people.