← All lessons

Make it tell you when it's guessing

3 min read

An AI states a guess in the same confident voice as a fact. In 2023, two New York lawyers were sanctioned $5,000 after filing a brief with six court cases ChatGPT had made up. When one of them asked ChatGPT whether the cases were real, it said yes.

You can give it permission to be honest: "If you're not sure, say so. Don't make up laws, cases, or dates." It won't make it perfect, but it makes it more likely to admit a gap instead of filling it.

Then check the parts that matter. Ask where you can verify each point — the agency, the name of the law, the official website — and look it up yourself. For anything with a deadline or money on the line, a real person at legal aid, the agency, or your doctor's office is worth the call.

Instead of

what are my rights if my landlord won't fix the heat


Try

I rent an apartment in [your state], and my landlord hasn't fixed the heat for [how long]. What are my rights? If you're not sure about something, say so — don't make up laws or deadlines. For each right you mention, tell me where I can check it myself, like the state agency or the name of the law.

The facts make the answer fit your situation. The last two sentences make it honest about its limits — and hand you a way to check its work.

Sources