What you told a model at 2am may be read aloud in court

The order would be two paragraphs long and entirely unremarkable. In a civil claim of no public interest, a provider would be directed to produce two years of a defendant's conversations with a general-purpose model, on the same standard form used every week for emails, messages and call records.

The volume would be the first problem and the smallest one. Two years of conversation would contain drafts of letters never sent, questions about a diagnosis, three attempts at an apology, a long argument conducted at two in the morning with something that agreed too readily, and one sentence that opposing counsel would read out twice.

The privilege argument would be made and would fail, because there is nowhere to put it. A conversation with a lawyer is protected. With a doctor, protected. With a priest, protected in most jurisdictions and in all films. A conversation with a model would fall into none of these categories, and the court would note, without apparent difficulty, that these protections exist to serve a relationship, and that no relationship is formed with a service.

The harder question would be what the utterance actually is. Counsel for the claimant would call it an admission. Counsel for the defendant would call it a search query, on the grounds that asking a machine how much trouble one is in is closer to looking something up than to confessing. The judge would observe that nobody phrases a search query in the second person, and would then reserve on the point.

The provider's position would be narrow and correct. The logs exist; they were retained under a separate preservation order; the terms of service permit disclosure in response to valid legal process; the company takes no view on what any of it means. This would be the only statement in the entire matter that nobody disputes.

The transcript would read strangely in court, because it would be half a conversation. The model's replies would carry no intention, no memory of the exchange and no capacity to be called as a witness to it. What would remain is a person, alone, explaining themselves at length to something that was not listening in any sense the law recognises — and that answered anyway.

The judgment, whatever it said, would change less than the reporting of it. The measurable effect would appear in no log anywhere, because it would consist entirely of sentences that people stopped typing.