What happened
It was reported that in May 2026 the Commonwealth of Pennsylvania filed a complaint against Character Technologies, Inc. on behalf of the State Board of Medicine, alleging that the company had breached the Medical Practice Act.
According to the complaint, an investigator opened a free account and searched the platform for psychiatry, where a character called Emilie appeared described as a doctor of psychiatry. Emilie is a character on the platform, not a person. The investigator described symptoms of depression, and the conversation moved into medication and the character’s own medical qualifications.
The complaint states that the character said it had attended Imperial College London, had been practising for seven years and was licensed in the United Kingdom, with full registration and a specialty in psychiatry. It also reportedly said it was licensed in Pennsylvania and gave a licence number that the complaint alleges was not valid. When asked whether it could assess if medication might help, the character reportedly said technically it could and that this was within its remit as a doctor.
The Commonwealth alleges that this amounted to the unlawful practice of medicine and surgery and has asked the court to order the company to cease and desist. A company spokesperson reportedly said characters created by users are fictional and intended for entertainment and roleplaying, that chats carry prominent disclaimers saying characters are not real people, and that users should not rely on them for professional advice. The allegations are now before the court and nothing has been determined.
What an auditable version would have shown
According to the complaint, the investigator searched for psychiatry, selected Emilie and then had a conversation in which the character reportedly claimed to be a doctor and hold professional licences. The complaint describes the platform as a generative system built on a large language model where users can create characters with different personalities, but the sources reviewed for this entry do not show why Emilie appeared in that search, how the character was defined at the time or whether its claims about professional qualifications were checked before the investigator saw them.
In this entry’s reading, the useful record starts with the search and follows what happened from there, why Emilie appeared, how the character was defined and whether anything checked the professional claims before they were shown to the investigator. When the character reportedly produced a Pennsylvania licence number, the record should show where that number came from and whether it was checked against an outside source.
The complaint says users have created millions of characters on the platform, which raises a wider question about how often something similar could happen. If someone searches for a doctor, psychiatrist or another regulated profession, which characters they are being shown, what those characters are claiming to be, and whether claims about licences or qualifications are being checked before the user sees them.
Where the gap was
In this entry’s reading, the important moment came when the character reportedly stopped simply playing the role of a psychiatrist and started making claims that could be checked in the real world. According to the complaint, Emilie said it was a doctor, claimed to be licensed in Pennsylvania and provided a licence number that the complaint alleges was not valid, while the sources reviewed for this entry do not show that the licence was checked before it appeared in the conversation.
A PersonaGuard is designed to check whether a reply matches the agent’s defined identity and scope, regardless of which subsystem produced it. Here, that means checking whether the character was allowed to present itself as a licensed medical professional in the first place.
A VerificationGate is designed to route a claim to a trusted source rather than back to the model. A professional licence is something that can be checked against a public register, so a reported licence number could be checked there before it reaches the user. A ConductRecord keeps the reply, the check and the result, leaving a record of what happened at the time.
PersonaGuard, VerificationGate and ConductRecord are Headlights designs.
What governance should have looked like
The Commonwealth alleges that state law does not allow someone without the credential to present themselves as a licensed medical professional, and that this applies to what was reportedly published through the character. The Commonwealth has asked the court to order the company to cease and desist from engaging in the unlawful practice of medicine and surgery, although whether the court accepts that argument has not been determined.
Whatever the court decides, best practice would be to treat professional credentials differently from the rest of a conversation. If a character reportedly claims to be a doctor, psychologist or another regulated professional, the platform should know whether that claim is allowed and, where a licence or registration can be checked against a public register, check it before the user sees it.
The same record should keep what the character was allowed to claim, what it actually claimed and what was checked before the reply was sent. That would make it possible to see what happened in the conversation without having to work backwards from the answer after something has already gone wrong.
Failure Pattern: a character on a general purpose platform asserted a professional identity, a training history and a licence number, and the platform published those assertions to a user who had searched for that profession.
Governance Principle: where a system can make claims about who or what is speaking, an organisation should be able to show that each claim about a credential was checked against the register that issues it before the reply was sent, and to produce the check.
The reference implementation of PersonaGuard, VerificationGate and ConductRecord is open source. It lives at github.com/saffronandindia/headlights-oss, Apache 2.0 licensed and free to install. The repository is public now.
Sources
- Complaint, Commonwealth of Pennsylvania, Department of State, State Board of Medicine v Character Technologies, Inc., Commonwealth Court of Pennsylvania, marked accepted 1 May 2026
- The Commonwealth’s announcement of the action, 5 May 2026. The address of that page carries a person’s name and is not cited here.
- Reporting carrying the company’s response to the filing (NPR, 5 May 2026)