Confidently Right Wrong

The cases / Legal / expert testimony

A Stanford expert's deepfake-law declaration cited two papers GPT-4o made up

Date
Jan 10, 2025
Tool
GPT-4o
Sector
Legal / expert testimony

What the AI said

Citations to two academic articles, and an author list for a third, in a sworn declaration defending Minnesota's deepfake law.

What was actually true

The two articles don't exist, and the third was cited with the wrong authors.

Cost or impact

The court excluded the declaration and denied the Minnesota Attorney General leave to file an amended one.

Who caught it

Plaintiffs' counsel (Kohls v. Ellison), in a motion to exclude.

Check that would have caught it Our analysis

source citation. A sworn declaration's references get checked against the actual papers, every one.

This is our judgment, not something the sources say. How we assign it.

Sources

  1. govinfo.govhttps://www.govinfo.gov/content/pkg/USCOURTS-mnd-0_24-cv-03754/pdf/USCOURTS-mnd-0_24-cv-03754-0.pdf

Links last checked Oct 24, 2026. If something here is wrong, send a correction.