ChatGPT Hallucination Lawyer Sanctions: Attorney Cited Fake Cases in Court

Attorney Steven Schwartz made international headlines when he submitted a legal brief in federal court containing six entirely fabricated case citations generated by ChatGPT. The AI confidently produced realistic-looking case names, citations, and summaries for cases that did not exist, a phenomenon known as hallucination. When opposing counsel and the judge could not locate the cited cases, Schwartz admitted he had used ChatGPT for research and had asked the AI to confirm the cases were real, to which it assured him they were. The judge sanctioned Schwartz and his firm $5,000, calling the conduct an "unprecedented circumstance." The case became the defining example of AI hallucination risks in professional contexts and prompted courts across the country to implement rules requiring disclosure of AI tool usage in legal filings. Multiple bar associations issued guidance warning lawyers about verification obligations when using generative AI.

The ramifications of this incident extend beyond the immediate data exposure. Privacy regulators in multiple jurisdictions have opened investigations, and affected individuals are organizing collective action to demand accountability and meaningful remediation. The case highlights systemic weaknesses in how organizations handle personal data and the gap between corporate privacy promises and operational reality.

For impacted individuals, immediate action is critical. Filing a data subject access request forces the company to disclose exactly what data they hold about you, providing the foundation for deletion requests, regulatory complaints, and potential legal action. Below, we outline the specific data types at risk and the concrete steps you can take to protect yourself.