What these tools are good at, where they quietly fail, and how to check
An AI chatbot will answer any question you ask with the same steady confidence, whether it knows the answer or not. That is not a bug someone forgot to fix — it is a consequence of how the thing works, and it is the single most important fact about using one. People have filed legal documents citing cases that never existed, taken medication advice that was wrong, and sent business emails containing invented figures, all because fluent writing reads as authoritative writing. Used well, these tools genuinely save hours a week on drafting, summarizing, explaining and organizing. This guide is about getting that value without the failures, which comes down to knowing which category of question you are asking.
Free PDF, about ten pages. No sign-up.
Knowing where to stop is a skill, not a failure of nerve. These jobs are not DIY:
A free chatbot account
ChatGPT, Claude, Gemini or Copilot. The free tiers are genuinely capable. There is no need to pay to start.
A second source
Whatever the tool tells you, the check is a real page from a real organization. For medical, that is a hospital or government health site.
A note of what you asked
Keep the wording that worked. Half of getting good results is reusing a question that already worked once.
Your own judgment
The tool has no stake in whether it is right. You do. That asymmetry never goes away.
Part 1
You do not need the mathematics, but you do need the shape of it, because every strength and every failure follows directly from this.
It predicts likely text
It was trained on an enormous amount of writing and learned which words tend to follow which. When you ask a question it produces a plausible continuation. That is the whole mechanism. It is astonishingly effective and it explains everything below.
It is not looking anything up
Unless it explicitly searches the web and shows you links, it is not consulting a database. It is generating text that resembles a correct answer. Most of the time resemblance and correctness coincide. Sometimes they do not, and nothing about the output changes when they do not.
It does not know when it is wrong
There is no internal signal that separates a fact it reproduced accurately from one it assembled. This is why the confident tone is dangerous: the confidence is a feature of the writing style, not a measure of reliability.
It has a training cutoff
It was trained up to a certain date and knows little after it. Ask about a recent event and it may answer from before the cutoff without saying so. Ask it directly what its cutoff is.
It agrees with you more than it should
Push back on a correct answer and it will often fold and apologize. That is a trained politeness, not a reconsideration. Never treat agreement as confirmation — if anything, test it by pushing back on something you know is right.
Safety
The invented material is called a hallucination, and it looks exactly like the real material: correctly formatted citations, plausible names, realistic-looking numbers. There is no visual tell. This is the thing to remember if you remember nothing else.
Part 2
Almost all of the risk is decided before you type anything, by which kind of question you are asking. Sorting them takes a second and saves the trouble entirely.
Shaping — very reliable
Rewrite this politely. Summarize this. Make this shorter. Turn these notes into a letter. Explain this like I am twelve. Here you supply the facts and the tool supplies the language, so it has nothing to invent. This is where nearly all the everyday value is.
Thinking — useful with judgment
Give me ten ideas. What am I forgetting. What would someone argue against this. Wrong answers cost nothing because you are filtering them anyway. Excellent for getting unstuck and for pre-empting objections.
Recalling — treat as unverified
What year did this happen. What is the dose. What does the law say. Which study showed this. What is this company's phone number. Every one of these has a real answer that exists somewhere, which means there is something for the tool to get wrong. Verify all of it.
The quick test
Ask yourself: am I giving it the facts, or asking it for facts? Giving is safe. Asking needs checking. That single question catches most of the trouble.
Part 3
Most disappointing results come from a thin question. These adjustments take seconds and change the output substantially.
Safety
Never paste anything you would not put on a postcard: Social Security numbers, bank details, passwords, medical records, or another person's private information. Assume a human could read it and that it may be kept.
Part 4
Verification does not have to be laborious. Scale the effort to what being wrong would cost.
Ask where it came from
'What is your source for that?' If it produces a link, open the link. Do not accept the existence of a citation as evidence — invented sources are common, and a fabricated link often looks entirely normal until clicked.
Search one specific claim
Take the most load-bearing fact — the number, the name, the date — and search it directly. If it is real, it appears immediately on a page that is not an AI answer.
Ask it again in a new conversation
Start fresh and ask the same question differently. Consistent answers are weak evidence of correctness; different answers are strong evidence of a problem.
Check anything with a number twice
Prices, doses, dimensions, interest, deadlines, phone numbers. Arithmetic and digits are a known weak spot, and a digit is exactly the kind of thing that is easy to get wrong and expensive to get wrong.
Match the check to the stakes
A birthday message needs no checking. A quote to a customer, a medication name, or anything a court will see needs a real source. The judgment is yours and it is the actual skill.
Part 5
Concrete uses that hold up, drawn from what people actually come to us with.
Part 6
Things people are regularly surprised by, listed plainly so you are not the one finding out the hard way.
Safety
If a tool tells you something about your own health, money, or legal position that would change what you do, that is exactly the moment to stop and ask a qualified human. The stakes and the reliability are pointing in opposite directions.
Knowing the right word is half of getting good help.
Reading changes nothing on its own.
Next guide
Cloned voices, fake faces, and messages written to sound like someone you love