New AI Warning: Don’t Discuss Your Legal Problems With Claude Or ChatGPT
New AI Warning: Don’t Discuss Your Legal Problems With Claude Or ChatGPT
Publish Date: 2026-05-28 17:29:00
Source Domain: www.forbes.com
Questions you ask AI about a legal case aren’t protected by attorney-client confidentiality, a federal court has ruled.
Getty
Anthropic’s Claude, OpenAI’s ChatGPT and Alphabet’s Gemini may be great for helping with research or creating spreadsheets, but one thing they decidedly are not is your attorney. If anything, turning to artificial intelligence for legal advice can wind up backfiring, as it did for a white collar criminal defendant in New York who tried to shield from federal prosecutors his communications with Claude–the ones where he asked it for a legal defense strategy.
It seems obvious that you shouldn’t rely on artificial intelligence for legal advice, particularly if something important, like your freedom or a lot of money, is at stake. What’s new is that even discussing legal matters with your favorite chatbot could be risky.
In February, U.S. District Court Judge Jed S. Rakoff of the Southern District of New York ruled that AI’s large language models are not attorneys, and any communications with them can be used against criminal defendants just like any other non-privileged documents. The judge noted in his decision that his ruling “appears to answer a question of first impression nationwide”—meaning no other courts in the U.S. have ruled on this issue. His conclusion on privilege would presumably apply to civil litigation too.
The privilege question arose in a criminal securities fraud case against Texas businessman Bradley Heppner, the former chairman and CEO of publicly-traded GWG Holdings, who was charged with defrauding investors out of more than $150 million. Heppner, 60, was convicted by a jury this month and is awaiting sentencing. He faces a maximum of 20 years in jail.
According to court records, after Heppner learned last year that he was being targeted by federal investigators, he began asking Claude to outline a “defense strategy” he might be able to use in court against criminal charges.
When FBI agents later…
