Summarizing is one of the most common uses of AI assistants. You paste an article, a report or a PDF, ask it to "summarize," and a few seconds later you have three clear paragraphs. The problem: you don't know what got lost along the way, or whether a sentence in the summary was slightly distorted.
A summary is only useful if you can trust it. Here's a simple method to summarize a long document with AI, then check the result.
Why a summary can mislead you
An assistant doesn't read the way you do. It generates likely text based on what you give it. That creates three risks:
- Omission: a short but decisive clause, an exception or a condition can disappear because it takes up little space.
- Distortion: a nuance ("in some cases," "subject to") turns into a general statement.
- Addition: the assistant fills in with its general knowledge, or even invents a point that isn't in the text.
On top of that there's a technical limit: each assistant can only handle a certain amount of text at once, called its context window. It varies by tool and plan. Beyond that limit, or even close to it, part of the document may get little or no attention, often without the assistant telling you.
Step 1: say what you're looking for
"Summarize this document" doesn't say what matters to you. The same report isn't summarized the same way for making a decision, studying, or answering a client. Specify:
- who the summary is for (you, a manager, a client);
- what for (deciding, understanding, comparing);
- the format (three sentences, a bullet list, a table);
- what must not be missing (figures, dates, obligations, risks).
Step 2: split long documents
For a long text, don't paste everything at once and hope for the best. Work in logical chunks: a chapter, a section, a part of the PDF. Then summarize the summaries.
This method has two advantages. Each chunk stays well under the assistant's limit, and you can check each partial summary against a short piece of text. If your document has a table of contents, use it to split it.
Step 3: require the source passages
This is the instruction that changes everything. Ask the assistant, for each point in the summary, to say where it found it and quote the exact passage.
Summarize the text below for [who], who needs to [goal]. Use only this text, without adding outside knowledge. Format: five points maximum. For each point, give the original section or page and quote, in quotation marks, the sentence from the text that supports it. If an important piece of information is ambiguous or missing, write "not specified in the text." End with a list of the conditions, exceptions and caveats mentioned in the text, even short ones. <text> [paste the section of the document] </text>
With the quote, you can check in seconds: search for the sentence in the document (with your PDF reader's search) and see whether it really says what the summary claims. A quote you can't find is a red flag: the point may have been invented, or rephrased so much that its meaning changed.
The last instruction, about conditions and exceptions, counters omission: those are exactly the short elements a summary tends to drop.
Step 4: the cross-check
Once you have the summary, have it audited. In a new conversation (so the assistant doesn't defend its own work), give it the text and the summary:
Here is a text and a summary of that text. Act as a meticulous reviewer. List: 1) the claims in the summary that aren't supported by the text or that distort its meaning; 2) the important information in the text that's missing from the summary; 3) the nuances turned into general statements. For each remark, quote the relevant passage from the text. <text> [paste the text] </text> <summary> [paste the summary] </summary>
You can also run the check with a second assistant. Two tools that agree prove nothing, but two tools that disagree show you exactly where to look.
Step 5: check what matters yourself
The cross-check reduces errors; it doesn't eliminate them. Check anything with consequences yourself:
- figures, amounts and dates, always in the source document;
- obligations and commitments (deadlines, penalties, conditions);
- anything that will feed a decision or be passed on to someone else.
For a contract, a medical or legal document, an AI summary helps you find your way around the text; it doesn't replace reading it or getting a professional's advice.
PDFs: a few extra traps
Many assistants accept file attachments. Handy, but check that the text was actually read:
- Scanned PDFs are images: depending on the tool, the text may not be recognized, or only poorly.
- Tables and columns can be read out of order, which mixes up the figures.
- Footnotes and appendices are sometimes ignored, even though they often contain the exceptions.
A quick test: ask the assistant to quote the first and last sentence of the document, or the title of a section in the middle. If it gets it wrong, it didn't read everything.
What you don't paste
Summarizing tempts you to paste whole documents, sometimes confidential ones. Depending on the tool and your subscription, what you send may be stored. Remove personal data, health information, banking details and anything covered by a confidentiality obligation. At work, follow your company's rules.
Going further
Summarizing well with AI starts with understanding what an assistant really does with your text: it generates, it doesn't reread the way you do. That's what Ovrelia's "Light the Lantern" chapter teaches you: understand an LLM, choose an assistant, set it up, then write your first real request. It's free and plays in your browser, no account needed: start the chapter.
To understand where invented additions come from, read why ChatGPT makes things up. To apply the method at the office, the guide to using ChatGPT at work has a case dedicated to documents, and if you're a student, see how to study with ChatGPT. And to test your reflexes, launch the challenge with friends: ten timed questions about AI, and a score for others to beat.
To practice spotting an invented detail in a text that sounds right, play a round of Hallucination Hunt, a free game where you find the made-up sentences in fictional AI answers.
Frequently asked questions
How do I summarize a PDF with AI?
Attach the file or paste its text, say who the summary is for and what it's for, and ask for the original page and an exact quote for each point. For a long PDF, work section by section, then combine the partial summaries.
Can you trust a summary made by ChatGPT?
Not blindly. A summary can miss an exception, distort a nuance or add information that isn't in the text. Requiring quotes and having the summary reviewed against the text catches most of these problems, but figures and commitments should always be checked in the source.
Why does AI skip part of my long document?
Each assistant can only handle a limited amount of text at once. With a very long document, part of it may get little or no attention. Splitting the document into sections and summarizing them one by one avoids this problem.
How can I quickly check a summary?
Ask for a quote for each point, then search for those quotes in the document. Next, in a new conversation, ask an assistant to list what the summary distorts or leaves out, quoting the text.