Skip to content

worldbench/awesome-ai-auto-research

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

3 Commits
Β 
Β 
Β 
Β 

Repository files navigation

Awesome AI Auto-Research

A Curated List of Papers on AI-Assisted and Automated Scientific Research

Survey Project Page Awesome GitHub Stars License


About

This repository accompanies the survey paper "A Survey on AI Auto-Research" and tracks papers on AI-assisted and automated scientific research, covering the full research pipeline β€” from idea generation and literature review through coding, writing, peer review, rebuttal, and dissemination. We also include end-to-end autonomous research systems and work on societal implications.

If you find a missing paper or a broken link, please open an issue or pull request.


Citation

If you find this repository useful, please consider citing our survey paper:

@article{kong2026aiautoresearch,
  title   = {A Survey on {AI} Auto-Research},
  author  = {Kong, Lingdong and Chow, Wei and Li, Linfeng and Wang, Song and Li, Rong and Sun, Xian and Qu, Leigang and Ng, Lai Xing and Cottereau, Beno\^{i}t R. and Zhu, Jianke and Hoi, Steven C. H. and Liu, Ziwei and Chua, Tat-Seng and Ooi, Wei Tsang},
  journal = {arXiv preprint arXiv:YOUR\_ARXIV\_ID},
  year    = {2026}
}

Table of Contents


πŸ’‘ Idea Generation

Systems and benchmarks for automated generation, evaluation, and refinement of scientific research ideas.

Name Paper Venue Code
SciMON Paper ACL'24 GitHub
ResearchAgent arXiv arXiv'24 GitHub
AI Scientist arXiv arXiv'24 GitHub
SciAgents arXiv arXiv'24 GitHub
Can LLMs Generate Novel Research Ideas? arXiv arXiv'24 β€”
MOOSE-Chem arXiv arXiv'24 β€”
VirSci (Many Heads) arXiv arXiv'24 GitHub
Chain of Ideas arXiv arXiv'24 GitHub
Nova arXiv arXiv'24 β€”
SciPIP arXiv arXiv'24 GitHub
IdeaBench arXiv arXiv'24 β€”
LLMs for Combinatorial Creativity arXiv arXiv'24 β€”
LiveIdeaBench arXiv arXiv'24 β€”
IdeaSynth Paper CHI'25 β€”
IRIS Paper ACL'25 GitHub
Multi-Agent LLM Dialogues for Ideation Paper SIGDIAL'25 β€”
Spark Paper ICCC'25 β€”
ResearchBench arXiv arXiv'25 β€”
AI Idea Bench 2025 arXiv arXiv'25 GitHub
AI Scientist v2 arXiv arXiv'25 GitHub
AI-Researcher arXiv arXiv'25 β€”
MOOSE-Chem2 arXiv arXiv'25 β€”
The Ideation-Execution Gap arXiv arXiv'25 β€”
Deep Ideation arXiv arXiv'25 GitHub
Kosmos arXiv arXiv'25 β€”
HeurekaBench Paper ICLR'26 GitHub
Why LLMs Aren't Scientists Yet arXiv arXiv'26 β€”
Literature-Driven Scientific Theories arXiv arXiv'26 β€”
AI Can Learn Scientific Taste arXiv arXiv'26 β€”
EvoIdeator arXiv arXiv'26 β€”
HindSight arXiv arXiv'26 β€”

πŸ” Literature Review & Paper Search

Tools and benchmarks for automated literature search, synthesis, and survey generation.

Name Paper Venue Code
ASReview Paper Nature MI'21 GitHub
PaperQA arXiv arXiv'23 GitHub
LitLLM arXiv arXiv'24 β€”
STORM arXiv arXiv'24 GitHub
OpenResearcher (2024) Paper EMNLP'24 β€”
CHIME arXiv arXiv'24 β€”
CiteME arXiv arXiv'24 β€”
LitSearch arXiv arXiv'24 GitHub
PaperQA2 arXiv arXiv'24 GitHub
AutoSurvey arXiv arXiv'24 GitHub
OpenScholar arXiv arXiv'24 β€”
GPT Researcher β€” GitHub'24 GitHub
LLMs for Automated Literature Review arXiv arXiv'24 β€”
Elicit β€” Web'24 β€”
Semantic Scholar β€” Web'24 β€”
PaSa arXiv arXiv'25 GitHub
SurveyX arXiv arXiv'25 β€”
SurveyForge arXiv arXiv'25 GitHub
CiteGeist arXiv arXiv'25 β€”
DeepResearchAgent β€” GitHub'25 GitHub
DeerFlow β€” GitHub'25 GitHub
Tongyi DeepResearch β€” GitHub'25 GitHub
Agentic AutoSurvey arXiv arXiv'25 β€”
LiRA arXiv arXiv'25 β€”
SurveyG arXiv arXiv'25 β€”
IterSurvey arXiv arXiv'25 GitHub
ReportBench arXiv arXiv'25 GitHub
DeepScholar-Bench arXiv arXiv'25 GitHub
IDRBench arXiv arXiv'26 β€”
CiteLLM arXiv arXiv'26 β€”
O-Researcher arXiv arXiv'26 β€”
ScholarGym arXiv arXiv'26 β€”
SciNetBench arXiv arXiv'26 β€”

πŸ§ͺ Coding & Experimentation

Agents and benchmarks for AI-driven coding, experimentation, hypothesis testing, and scientific software engineering.

Name Paper Venue Code
BioPlanner arXiv arXiv'23 GitHub
Coscientist Paper Nature'23 β€”
MLAgentBench arXiv arXiv'24 GitHub
DS-Agent arXiv arXiv'24 GitHub
ChemCrow Paper Nature MI'24 β€”
CRISPR-GPT arXiv arXiv'24 β€”
FunSearch Paper Nature'24 GitHub
DiscoveryWorld arXiv arXiv'24 GitHub
SciCode arXiv arXiv'24 GitHub
DiscoveryBench arXiv arXiv'24 GitHub
Lab-Bench arXiv arXiv'24 β€”
InfiAgent-DABench arXiv arXiv'24 β€”
MLR-Copilot arXiv arXiv'24 β€”
SWE-Bench Paper ICLR'24 GitHub
ScienceAgentBench arXiv arXiv'24 β€”
RE-Bench arXiv arXiv'24 β€”
autoresearch (Karpathy) β€” GitHub'25 GitHub
AI Scientist (code) β€” GitHub'24 GitHub
Dolphin arXiv arXiv'25 β€”
AIDE arXiv arXiv'25 β€”
Curie arXiv arXiv'25 GitHub
MLGym arXiv arXiv'25 β€”
CodeScientist arXiv arXiv'25 GitHub
SciReplicate-Bench arXiv arXiv'25 GitHub
PaperBench arXiv arXiv'25 GitHub
Paper2Code arXiv arXiv'25 GitHub
AutoReproduce arXiv arXiv'25 GitHub
R&D-Agent arXiv arXiv'25 GitHub
InternAgent / NovelSeek arXiv arXiv'25 GitHub
AlphaEvolve arXiv arXiv'25 β€”
ResearchCodeBench arXiv arXiv'25 β€”
SWE-Bench Pro arXiv arXiv'25 β€”
MLR-Bench arXiv arXiv'25 β€”
SWE-EVO arXiv arXiv'25 β€”
Execution-Grounded AI Research arXiv arXiv'26 β€”
SciNav arXiv arXiv'26 β€”
EvoScientist arXiv arXiv'26 GitHub

πŸ“Š Tables & Figures

Systems for automated generation of scientific tables, charts, figures, TikZ diagrams, and visualizations.

Name Paper Venue Code
ChartGPT arXiv arXiv'23 β€”
Chain-of-Table arXiv arXiv'24 β€”
MatPlotAgent arXiv arXiv'24 β€”
AutomaTikZ Paper ICLR'24 β€”
ArxivDIGESTables Paper EMNLP'24 β€”
DeTikZify Paper NeurIPS'24 β€”
DiagramAgent Paper CVPR'25 β€”
AbGen Paper ACL'25 β€”
StarVector Paper CVPR'25 β€”
VisCoder Paper EMNLP Findings'25 β€”
PlotGen arXiv arXiv'25 β€”
CoDA arXiv arXiv'25 β€”
PlotCraft arXiv arXiv'25 β€”
ShowTable arXiv arXiv'25 β€”
Table2LaTeX-RL arXiv arXiv'25 β€”
VIS-Shepherd arXiv arXiv'25 β€”
TeXpert arXiv arXiv'25 β€”
PaperBanana arXiv arXiv'26 β€”
SciFig arXiv arXiv'26 β€”
SciFlow-Bench arXiv arXiv'26 β€”
AutoFigure-Edit arXiv arXiv'26 GitHub
SAIL arXiv arXiv'26 β€”
TikZilla arXiv arXiv'26 β€”
AI-Generated Figures: Policies & Guidelines arXiv arXiv'26 β€”

πŸ”¬ Peer Review

Automated peer review generation, analysis of AI usage in review, and bias/robustness studies.

Name Paper Venue Code
MARG arXiv arXiv'24 β€”
AI Review Lottery arXiv arXiv'24 β€”
Monitoring AI-Modified Content arXiv arXiv'24 β€”
Peer Review as Multi-Turn Dialogue arXiv arXiv'24 β€”
AI-Peer-Review β€” GitHub'24 GitHub
AgentReview Paper EMNLP'24 β€”
LLMs as Meta-Reviewers' Assistants Paper NAACL'25 β€”
AI Text Detection in Peer Review arXiv arXiv'25 β€”
DeepReview arXiv arXiv'25 β€”
ClaimCheck arXiv arXiv'25 β€”
ReviewAgents arXiv arXiv'25 β€”
OpenReviewer arXiv arXiv'25 β€”
REMOR arXiv arXiv'25 β€”
Detecting LLM-Generated Peer Reviews arXiv arXiv'25 β€”
Automated Scientific Reviewing (Stanford) β€” Web'25 β€”
Breaking the Reviewer arXiv arXiv'25 β€”
Prompt Injection Attacks on Peer Review arXiv arXiv'25 β€”
When Your Reviewer is an LLM arXiv arXiv'25 β€”
CycleResearcher arXiv arXiv'25 β€”
Automatic Paper Reviewing with Graph Reasoning arXiv arXiv'25 β€”
ReviewerToo arXiv arXiv'25 β€”
ReviewRL Paper EMNLP'25 β€”
Large-Scale Randomized Study of LLM Feedback Paper Nature MI'26 β€”
RATE arXiv arXiv'26 β€”
What Happens When Reviewers Receive AI Feedback arXiv arXiv'26 β€”
Policies Permitting LLM Use Not Enforceable arXiv arXiv'26 β€”
More than Half of Researchers Use AI for Peer Review Paper Nature News'26 β€”
Major Conference Catches Illicit AI Use Paper Nature News'26 β€”

πŸ’¬ Rebuttal

Systems and datasets for AI-assisted author rebuttals and response generation in the peer review process.

Name Paper Venue Code
Re2 Dataset arXiv arXiv'25 β€”
Insights from ICLR Rebuttal Process arXiv arXiv'25 β€”
DRPG arXiv arXiv'26 GitHub
Paper2Rebuttal arXiv arXiv'26 β€”
RebuttalAgent arXiv arXiv'26 β€”
Author-in-the-Loop arXiv arXiv'26 β€”
Commitment Checklist arXiv arXiv'26 β€”

✍️ Paper Writing

Tools and studies on AI assistance for academic writing, revision, citation, and co-authorship.

Name Paper Venue Code
CoAuthor arXiv arXiv'22 β€”
CycleResearcher arXiv arXiv'24 β€”
Script&Shift Paper CHI'25 β€”
AI in the Writing Process Paper AIED'25 β€”
FutureGen arXiv arXiv'25 β€”
ScholarCopilot arXiv arXiv'25 β€”
OpenDraft β€” GitHub'25 GitHub
DraftMarks arXiv arXiv'25 β€”
XtraGPT arXiv arXiv'25 β€”
Let's Use ChatGPT to Write Our Paper! arXiv arXiv'25 β€”
PaperDebugger arXiv arXiv'25 GitHub
AI Tools Expand Impact but Contract Focus Paper Nature'26 β€”
APRES arXiv arXiv'26 β€”
Multi-Agent LLMs for Research Limitations arXiv arXiv'26 β€”

πŸ“’ Dissemination (Paper2X)

Systems that transform research papers into slides, posters, videos, websites, and other presentation formats.

πŸ“‘ Slides & Presentations

Name Paper Venue Code
DOC2PPT Paper AAAI'22 β€”
AutoPresent Paper CVPR'25 β€”
PASS arXiv arXiv'25 β€”
Talk to Your Slides arXiv arXiv'25 β€”
PPTAgent Paper EMNLP'25 GitHub
PresentAgent arXiv arXiv'25 GitHub
Auto-Slides arXiv arXiv'25 β€”
SlideGen arXiv arXiv'25 β€”
Paper2Slides β€” GitHub'25 GitHub
SlideTailor Paper AAAI'26 GitHub
DeepPresenter arXiv arXiv'26 GitHub
Office Raccoon (SenseTime) β€” Web'26 β€”

πŸ—ΊοΈ Posters

Name Paper Venue Code
P2P (Paper-to-Poster) arXiv arXiv'25 β€”
Paper2Poster arXiv arXiv'25 GitHub
PosterGen arXiv arXiv'25 β€”
PosterForest arXiv arXiv'25 β€”
APEX arXiv arXiv'26 GitHub
PosterOmni arXiv arXiv'26 β€”

🎬 Video & Web

Name Paper Venue Code
Preacher Paper ICCV'25 GitHub
Paper2Video arXiv arXiv'25 GitHub
Paper2Web arXiv arXiv'25 GitHub

πŸ€– End-to-End Systems

Fully integrated autonomous research pipelines that span multiple stages of the scientific process.

Name Paper Venue Code
ResearchTown Paper ICML'25 GitHub
Agent Laboratory arXiv arXiv'25 β€”
Towards an AI co-scientist arXiv arXiv'25 β€”
OpenAI Deep Research β€” Web'25 β€”
Google Deep Research β€” Web'25 β€”
AgentRxiv arXiv arXiv'25 β€”
AI-Research-SKILLs β€” GitHub'25 GitHub
Biomni β€” GitHub'25 GitHub
Idea2Paper β€” GitHub'25 GitHub
ResearchClaw β€” GitHub'25 GitHub
ARIS β€” GitHub'25 GitHub
PiFlow arXiv arXiv'25 β€”
Towards End-to-End Automation of AI Research Paper Nature'26 GitHub
Idea2Story arXiv arXiv'26 β€”
LabClaw β€” Web'26 β€”
UniScientist β€” Web'26 β€”
ASI-Evolve β€” GitHub'26 GitHub
FARS β€” Web'26 β€”
AutoResearchClaw β€” GitHub'26 GitHub
OpenResearcher (2026) arXiv arXiv'26 GitHub
Aletheia arXiv arXiv'26 GitHub
OpenAI Is Building a Fully Automated Researcher Article MIT TR'26 β€”

🌐 Societal & Critical Perspectives

Studies on the societal implications, risks, integrity concerns, and broader impacts of AI in scientific research.

Name Paper Venue Code
Navigating the Jagged Technological Frontier Paper Org. Sci.'25 β€”
Reassessing Academic Integrity in the Age of AI Paper SSH Open'25 β€”
The AI Deskilling Paradox Paper CACM'25 β€”
Hidden Pitfalls of AI Scientist Systems arXiv arXiv'25 β€”
Rethinking Science in the Age of AI arXiv arXiv'25 β€”
Measuring AI Ability to Complete Long Tasks Blog METR'25 β€”
Towards a Science of Scaling Agent Systems arXiv arXiv'25 β€”
AI Tools Expand Impact but Contract Focus Paper Nature'26 β€”
AI for Scientific Discovery is a Social Problem Paper Patterns'26 β€”
Research Integrity in the Age of AI arXiv arXiv'26 β€”
SciSciGPT Paper Nature CS'26 β€”
SimStep arXiv arXiv'25 β€”
ConvoLearn arXiv arXiv'26 β€”
AFIM: Academic Fraud Inclination Metric Web Web'26 β€”
AI Researchers' Views on Automating AI R&D arXiv arXiv'26 β€”
AI Scientists Are Changing Research (Editorial) Paper Nature'26 β€”
Learning by Creating (Talk) Video Talk'26 β€”

πŸ“š Surveys & Curated Lists

Survey papers and curated reading lists that provide an overview of AI for scientific research.

Name Paper Venue Code
LLM4SR arXiv arXiv'25 β€”
From Automation to Autonomy arXiv arXiv'25 β€”
AI4Research arXiv arXiv'25 β€”
A Survey of AI Scientists arXiv arXiv'25 β€”
LLMs for Scientific Idea Generation: Survey arXiv arXiv'25 β€”
LLMs for Automated Scholarly Paper Review: Survey Paper Inf. Fusion'25 β€”
awesome-ai-research-writing β€” GitHub'24 GitHub
Awesome-LLM-Scientific-Discovery β€” GitHub'25 GitHub

πŸ›  Tools & GitHub Repos

Open-source tools, frameworks, and curated resource lists for AI-assisted research (not directly tied to a single paper).

Curated Lists

Repository Stars Description
Awesome-Deep-Research ~684 Up-to-date collection of agentic deep research resources
Awesome-Scientific-Language-Models ~647 Survey of scientific LLMs (EMNLP'24)
Awesome-LLM-Scientific-Discovery ~319 Three-level autonomy framework (EMNLP'25)
Awesome-AI-Scientist-Papers ~136 Resources on AI Scientist systems
Awesome-Auto-Research-Tools ~129 Automated research tools catalog
awesome-autoresearch β€” Autonomous improvement loops and research agents

Idea Generation

Repository Stars Description
Virtual-Scientists ~66 VirSci: multi-agent collaborative idea generation (ACL'25)
ResearchAgent ~29 Iterative idea proposal with reviewing agents

Literature Review

Repository Stars Description
paper-qa ~8,300 PaperQA2: superhuman RAG for scientific Q&A
local-deep-research ~4,200 Fully local deep research
researchgpt ~3,500 Conversational interaction with research papers
gpt-researcher β€” Autonomous agent for comprehensive online research
AutoSurvey ~462 Automated comprehensive literature surveys
storm β€” Wikipedia-style article generation (STORM)

Coding & Experiments

Repository Stars Description
autoresearch (Karpathy) ~55,400 Autonomous ML experiments, ~12 exp/hour overnight
Paper2Code ~4,300 Multi-agent ML paper to code transformation
RD-Agent β€” Microsoft's LLM framework for autonomous data science
MLAgentBench ~334 13 end-to-end ML experimentation tasks
SWE-bench β€” Real-world GitHub issue resolution benchmark

Peer Review

Repository Stars Description
paper-reviewer ~824 arXiv paper reviews + blog posts
ai-peer-review ~123 Multi-LLM reviews + meta-review synthesis
openreviewer ~9 Llama-8B fine-tuned on 79K expert reviews

⬆ Back to Top

Last updated: 2026-04-08 Β· Maintained by WorldBench