Bib Verify Agent Skill
> Verify a BibTeX file for hallucinated or fabricated references by cross-checking every entry against CrossRef, arXiv, and DBLP. Reports each reference as verified, suspect, or not found, with field-level mismatch details (title, authors, year, DOI). Use when the user wants to check a .bib file for fake citations, validate references in a paper, or audit bibliography entries for accuracy.
Install
one command, takes just this skill from the repositorynpx skills add https://github.com/agentscope-ai/OpenJudge --skill bib-verifyThe instruction itself
7 sections, as written by the authorBibTeX Verification Skill
Check every entry in a .bib file against real academic databases using the
OpenJudge PaperReviewPipeline in BibTeX-only mode:
- Parse — extract all entries from the
.bibfile - Lookup — query CrossRef, arXiv, and DBLP for each reference
- Match — compare title, authors, year, and DOI
- Report — flag each entry as
verified,suspect, ornot_found
Prerequisites
pip install py-openjudge litellm
Gather from user before running
| Info | Required? | Notes |
|------|-----------|-------|
| BibTeX file path | Yes | .bib file to verify |
| CrossRef email | No | Improves CrossRef API rate limits |
Quick start
# Verify a standalone .bib file
python -m cookbooks.paper_review --bib_only references.bib
# With CrossRef email for better rate limits
python -m cookbooks.paper_review --bib_only references.bib --email [email protected]
# Save report to a custom path
python -m cookbooks.paper_review --bib_only references.bib \
--email [email protected] --output bib_report.md
Relevant options
| Flag | Default | Description |
|------|---------|-------------|
| --bib_only | — | Path to .bib file (required for standalone verification) |
| --email | — | CrossRef mailto — improves rate limits, recommended |
| --output | auto | Output .md report path |
| --language | en | Report language: en or zh |
Interpreting results
Each reference entry is assigned one of three statuses:
| Status | Meaning |
|--------|---------|
| verified | Found in CrossRef / arXiv / DBLP with matching fields |
| suspect | Title or authors do not match any real paper — likely hallucinated or mis-cited |
| not_found | No match in any database — treat as fabricated |
Field-level details are shown for suspect entries:
title_match— whether the title matches a real paperauthor_match— whether the author list matchesyear_match— whether the publication year is correctdoi_match— whether the DOI resolves to the right paper
Additional resources
- Full pipeline options: ../paper-review/reference.md
- Combined PDF review + BibTeX verification: ../paper-review/SKILL.md
Other skills for the same job
different authors, same section of the catalogue
Assists in writing high-quality content by conducting research, adding citations, improving hooks, iterating on outlines, and providing real-time feedback on each section. Transforms your writing process from solo effort to collaborative partnership.
Identifies high-quality leads for your product or service by analyzing your business, searching for target companies, and providing actionable contact strategies. Perfect for sales, business development, and marketing professionals.
Use this skill to query your Google NotebookLM notebooks directly from Claude Code for source-grounded, citation-backed answers from Gemini. Browser automation, library management, persistent auth. Drastically reduced hallucinations through document-only responses.
Efficient database search tool for bioRxiv preprint server. Use this skill when searching for life sciences preprints by keywords, authors, date ranges, or categories, retrieving paper metadata, downloading PDFs, or conducting literature reviews.
Query and analyze scholarly literature using the OpenAlex database. This skill should be used when searching for academic papers, analyzing research trends, finding works by authors or institutions, tracking citations, discovering open access publications, or conducting bibliometric analysis across 240M+ scholarly works. Use for literature searches, research output analysis, citation analysis, and academic database queries.
Access USPTO APIs for patent/trademark searches, examination history (PEDS), assignments, citations, office actions, TSDR, for IP analysis and prior art searches.
Multiagent AI system for scientific research assistance that automates research workflows from data analysis to publication. This skill should be used when generating research ideas from datasets, developing research methodologies, executing computational experiments, performing literature searches, or generating publication-ready papers in LaTeX format. Supports end-to-end research pipelines with customizable agent orchestration.
Automated LLM-driven hypothesis generation and testing on tabular datasets. Use when you want to systematically explore hypotheses about patterns in empirical data (e.g., deception detection, content analysis). Combines literature insights with data-driven hypothesis testing. For manual hypothesis formulation use hypothesis-generation; for creative ideation use scientific-brainstorming.
How to use it
Take agentscope-ai/bib-verify from the repository into ~/.claude/skills for personal
use, or into .claude/skills inside a project.
The agent identifies a skill by the name field in its header. Two skills with the
same name cannot sit side by side — one of them will be ignored.
The instructions reference pip.
Without those the skill loads but fails at the first command.