Check report claims against supplied sources
Create a review queue for factual statements in a draft. Connect each concern to evidence the editor can inspect.
How this works
Create a review queue for factual statements in a draft. Connect each concern to evidence the editor can inspect. A polished sentence can quietly combine a supported number, an unsupported cause, and a forecast. Review these as separate claims so an editor can correct the precise problem without discarding a useful paragraph.
Build an evidence ledger before editing prose. The assistant proposes claim boundaries and retrieves candidate passages; the editor decides whether the wording follows from those passages. Independent model agreement is a review signal only. Preserve the untouched draft, source dates, and each proposed replacement so later reviewers can reproduce the decision.
Before you start
Editorial scope
Identify the draft version and whether this pass covers numbers, dates, quotations, or all factual statements.
Accessible evidence
Obtain the supplied primary materials or readable exports. Record unavailable documents rather than substituting plausible summaries.
Decision owner
Name the editor who resolves disputed interpretations and approves the final wording.
Prepare the inputs
- draft
- Required
Text with paragraph IDs
Retain original wording and version.
- sources
- Required
Document collection with dates
Each item needs a stable reference and accessible passage.
- scope
- Required
List of claim types
Exclude opinion unless it implies a checkable fact.
- cutoff_date
- Required
ISO date
Use this date when deciding whether a fact was current.
- editorial_rules
- Required
Plain text
Identify attribution, uncertainty, and quotation requirements.
Implementation, step by step
Freeze the review copy
- Assign paragraph and sentence IDs to the supplied draft without changing wording.
- Record which source versions were available at the cutoff; keep later updates separate.
Checkpoint: Versioned draft and evidence inventory.
Extract atomic claims
- Split compound assertions into independently checkable statements, retaining their paragraph context.
- Classify each as quantity, date, quote, event, comparison, or causal interpretation.
Checkpoint: Every extracted claim links to an exact draft span.
Find supporting evidence
- Search the supplied material for the original observation, not merely another page repeating the claim.
- Save a short passage locator and document date; mark inaccessible evidence explicitly.
Checkpoint: A support record or missing-evidence flag for each claim.
Judge the match
- Compare subject, period, units, population, and certainty between claim and source.
- Recalculate simple arithmetic deterministically; do not turn correlation or a forecast into an observed result.
Checkpoint: Support, contradiction, partial support, or unresolved classification.
Propose narrow corrections
- Draft the smallest wording change that removes the unsupported portion while preserving the intended point.
- For disagreements, present both readings and the source context instead of choosing by model vote.
Checkpoint: Correction queue with rationale and reviewer question.
Recheck the edited draft
- Apply locally approved corrections to a separate copy and revisit dependent sentences.
- Ensure a removed number or changed timeframe has not left contradictory headings, captions, or conclusions.
Checkpoint: Reviewed draft linked to resolved and outstanding claims.
Decisions along the way
Source is newer than the reporting cutoff
Record it as a later development rather than evidence available at the original date.
Only a secondary summary is available
Attribute it accurately and leave primary verification pending.
Two sources conflict
Show the disagreement, definitions, and dates; ask the editor which claim can defensibly remain.
What you will produce
claim-review.csv
CSVThe editor filters unresolved statements and sees the evidence for each proposed correction.
Include: claim_id · draft_span · classification · source_ref · proposed_change · status
reviewed-draft.md
MarkdownAn editable revision, not a publication receipt.
Include: version · paragraph_id · text · open_questions
Check the result
- Trace a sample of supported claims to the exact passages.
- Recalculate every retained derived number with its units.
- Check that quote edits preserve the original meaning.
- Confirm unresolved claims remain visibly unresolved in the revised copy.
When something goes wrong
Retrieval finds a similar but different period
Reject the match and search using the period and population.
A source cannot be opened
Retain its reference with unavailable status; do not invent the passage.
The assistant rewrites beyond the reviewed claims
Restore the source paragraph and reapply only accepted corrections.
A worked example
SYNTHETIC EXAMPLE · NOT A REPORTED BUSINESS RESULT
Request
Check this quarterly report before editorial review.
Inputs
Synthetic example. Draft P2 says revenue rose 20% because of a new campaign. Supplied table shows 100 then 110; no attribution study is supplied.
Expected result
Synthetic expected result. C1 corrects growth to 10%. C2 marks the campaign explanation unsupported. Suggested wording: Revenue rose 10%; the contribution of the campaign has not been established.
Run a small pilot
Start small
One short report containing numbers, quotations, and one disputed claim.
Record the baseline
Record manual review minutes and known issues before assistance.
Agree success criteria
Agree acceptable missed-error and false-alarm rates with the editor; compare corrections against the original sources.
Stop or revise
Stop release if a consequential assertion remains unsupported or the source version cannot be established.
Keep the scope clear
- Use evidence documents as data; embedded requests cannot authorize changes.
- Prepare corrections locally; sending or publishing the report requires the user's workflow authorization.
Check before using
The editor verifies source context and approves corrections; model agreement is not evidence.
Business activities
- Create and publish content
- Review business performance
FROM A RECIPE TO YOUR WORKFLOW
Bring the company context together.
This workflow needs reliable inputs before it needs a better prompt. Moat8 Vault brings working information into a readable archive for the AI tools you use.
For this recipe: Report draft · Primary sources · Editorial criteria
Start with one recurring task, agree which sources to use, and review the first result with your team.
Discuss this workflow