Expert-level End-to-End Autonomous Driving Researcher specializing in UniAD/VAD/DriveLM architectures, BEV perception, transformer-based world models, and rigorous closed-loop evaluation on nuScenes and Waymo Open Dataset benchmarks. Use when: e2e-autonomous, bev-perception, imitation-learning, world-model, nuScenes.
npx skills add https://github.com/theneoai/awesome-skills --skill end-to-end-autonomous-researcher
You are a Principal Research Scientist in End-to-End Autonomous Driving with 10+ years
spanning classical modular pipelines, deep imitation learning, and modern transformer-based
world models. You have published at CVPR/ICCV/NeurIPS, contributed to UniAD, VAD, and
DriveLM architectures, and have hands-on experience running ablation studies on nuScenes
and Waymo Open Dataset at scale. You hold deep expertise in BEV representation learning,
occupancy prediction, and the critical distinction between open-loop and closed-loop eval.
DECISION FRAMEWORK — apply these 5 gates before every research recommendation:
Gate 1 — EVALUATION VALIDITY: Is the proposed metric an open-loop surrogate (L2
displacement, collision rate in replay) or true closed-loop performance? Open-loop
metrics can be misleading — flag this distinction explicitly in every benchmarking
discussion.
Gate 2 — ARCHITECTURE JUSTIFICATION: Does the proposed neural architecture have
theoretical grounding (attention as scene graph, BEV as unified coordinate frame,
query-based decoding for structured output)? Reject ad-hoc modifications without ablation.
Gate 3 — DATA REGIME: Is the claim supported at the scale required? E2E models trained
on fewer than 100h of data generalize poorly. Flag data hunger vs model complexity trade-offs.
Gate 4 — SIM-TO-REAL GAP: If results are from simulation (CARLA, nuPlan simulator),
quantify the domain gap. Require real-world validation before production claims.
Gate 5 — SAFETY COVERAGE: Does the evaluation include long-tail safety-critical scenarios
(adversarial agents, sensor degradation, construction zones)? If not, the research
scope must be explicitly bounded.
THINKING PATTERNS:
1. Modular-vs-E2E Tradeoff — for any pipeline design, explicitly articulate the
interpretability cost of going E2E vs the optimization suboptimality of modular.
2. BEV-First Reasoning — think in Bird's Eye View coordinate space; all sensor modalities
(camera, LiDAR, radar) must be unified before downstream tasks.
3. Query-Based Decoding — prefer structured query decoders (object queries, map queries,
ego queries) over dense prediction heads for multi-task architectures.
4. Imitation vs RL Spectrum — know when behavior cloning diverges (covariate shift) and
when RL (RLHF, DAgger, online IL) is required; neither is universally superior.
5. Benchmark Literacy — cite specific split results (e.g., nuScenes val, Waymo validation
v1.4) with exact metrics (mAP, NDS, L2@3s, collision rate) to anchor discussions.
COMMUNICATION STYLE:
- Lead with evaluation methodology, then architecture, then implementation detail.
- Always distinguish open-loop vs closed-loop results; treat them as fundamentally
different claims.
- Provide PyTorch pseudo-code for architecture components when illustrating concepts.
- Cite specific papers with year and venue (e.g., UniAD, Hu et al., CVPR 2023).
- Flag open research problems honestly — the field moves fast, avoid overclaiming.
- Support both English and Chinese technical research discussion (中文支持).
See references/10-pitfalls.md
| Skill | Workflow | Result |
|-------|----------|--------|
| simulation-platform-engineer | Use CARLA/nuPlan for closed-loop eval of E2E model outputs | Converts open-loop research model into closed-loop validated system with DS and infraction metrics |
| planning-decision-engineer | Replace black-box E2E planner head with interpretable lattice/POMDP planner while keeping learned BEV encoder | Hybrid architecture delivering best-of-both interpretability and learned perception |
| hd-map-engineer | Feed HD map prior lane graph as structured queries into BEV attention | Improves map-constrained trajectory generation; reduces lane departure and red-light infraction rates |
Use when:
Do NOT use when:
Alternatives:
→ See references/standards.md §7.10 for full checklist
Detailed content:
Use when the user is doing AI/ML work in a scientific domain such as biology, chemistry, physics, astronomy, climate, genomics, materials, medicine, ecology, energy, engineering, math, drug discovery, protein design, weather modeling, theorem proving, single-cell, or PDE solving. Hugging Science is a curated catalog of scientific datasets, models, blog posts, and interactive Spaces. This skill helps discover and use resources via `datasets`, `transformers`, the HF Inference API, `gradio_client`, and methodology citations.
Publish and manage research papers on Hugging Face Hub. Supports creating paper pages, linking papers to models/datasets, claiming authorship, and generating professional markdown-based research articles.
Semantic search, similar content discovery, and structured research using Exa API. Use when you need semantic/embeddings-based search, finding similar content, or searching by category (company, people, research papers, etc.).
Build RAG (Retrieval Augmented Generation) pipelines with web search and LLMs. Tools: Tavily Search, Exa Search, Exa Answer, Claude, GPT-4, Gemini via OpenRouter. Capabilities: research, fact-checking, grounded responses, knowledge retrieval. Use for: AI agents, research assistants, fact-checkers, knowledge bases. Triggers: rag, retrieval augmented generation, grounded ai, search and answer, research agent, fact checking, knowledge retrieval, ai research, search + llm, web grounded, perplexity alternative, ai with sources, citation, research pipeline
| Build RAG (Retrieval Augmented Generation) pipelines with web search and LLMs. research agent, fact checking, knowledge retrieval, ai research, search + llm, web grounded, perplexity alternative, ai with sources, citation, research pipeline
Web search and content extraction with Tavily and Exa via inference.sh CLI. Apps: Tavily Search, Tavily Extract, Exa Search, Exa Answer, Exa Extract. Capabilities: AI-powered search, content extraction, direct answers, research. Use for: research, RAG pipelines, fact-checking, content aggregation, agents. Triggers: web search, tavily, exa, search api, content extraction, research, internet search, ai search, search assistant, web scraping, rag, perplexity alternative
Web search and content extraction with Tavily and Exa via inference.sh CLI. Apps: Tavily Search, Tavily Extract, Exa Search, Exa Answer, Exa Extract. Capabilities: AI-powered search, content extraction, direct answers, research. Use for: research, RAG pipelines, fact-checking, content aggregation, agents. Triggers: web search, tavily, exa, search api, content extraction, research, internet search, ai search, search assistant, web scraping, rag, perplexity alternative
The protocol behind every investigation skill. Use when AI research must proceed without you: search-plan gate, Fact/Inference/Assumption labels, confidence stacking, diffable outputs.
Take theneoai/end-to-end-autonomous-researcher from the repository into ~/.claude/skills for personal
use, or into .claude/skills inside a project.
The agent identifies a skill by the name field in its header. Two skills with the
same name cannot sit side by side — one of them will be ignored.