User:Alaexis/AI Source Verification
From Wikipedia, the free encyclopedia
AI Source Verification uses large language models to check whether a Wikipedia citation actually supports the claim it's attached to. Click any reference, and the tool will analyze the source content and tell you if the claim is supported, partially supported, or not supported.
(14 days ago)
| Description | Use AI to verify whether sources support the claims they're cited for |
|---|---|
| Author | Alaexis |
| Updated | March 14, 2026 (14 days ago) |
| Source | User:Alaexis/AI_Source_Verification.js |
Installation
First install User:Enterprisey/script-installer, then return to this page and click the "Install" button in the infobox. Alternatively, add this line to your Special:MyPage/common.js:
{{subst:iusc|User:Alaexis/Scripts/AI Source Verification.js}}
Usage
- Click the "Verify" tab (next to Article / Talk) to open the sidebar
- With the sidebar open, click any inline citation (e.g., [1]) in the article
- Select an AI provider from the dropdown (optional)
- Click "Verify" to check if the source supports the cited claim
- The tool will fetch the source content and return a verdict with an explanation
Supported AI providers
Qwen Sea Lion (open-source), Claude (AI), ChatGPT, Gemini (chatbot).
Performance and limitations
The tool successfully detects about 70% of citations that don't support the claims they are supposed to support. For "good" citations, it misfires in <15% of cases. Since the overwhelming majority of citation support the sources they are attached to, when using this tool most of the hits you'll see will be false positives that require manual review. In my testing, roughly 1 in 20–50 references checked reveals a genuine accuracy issue. See here for more details.
Limitations
- Online sources only: The tool can only verify sources available on the web. For paywalled or offline sources, you can paste the text manually.
- Complex citations: The tool may struggle with sentences that have multiple references supporting different parts.
- Accuracy varies by model: Commercial models (Claude, GPT, Gemini) significantly outperform the free option.
- Limited support of PDF sources
Credits
This script is based on Polygnotus's AI Source Verification script. The free option is powered by an open-source model hosted by PublicAI.