How do I know if an AI answer is trustworthy?
Check that the source exists and supports the claim. Then examine the reasoning and whether it applies to your situation.
Start with what you need to trust it for. A possible plot for a story and a statistic in a report need different kinds of checking.
For an important factual claim, ask two questions: does the source exist, and does it support this particular statement? A perfectly real paper can be used to support something it never said.
Imagine an AI answer claiming that a four-day working week makes every organisation more productive. It links to a report about a six-month trial in a handful of volunteer companies. Even if the report is real and those companies improved, you still need to examine what was measured, how the trial was run and whether the findings apply to your organisation. The word “every” is doing more work than that evidence can support.
Then examine the reasoning and the missing context. Confidence is part of the presentation. You still have to decide whether it has been earned.
— Martin Poliačik
Try it: Evidence Tests. Check whether the evidence is relevant, sufficient and trustworthy.