A survey of Code Agents for improving development productivity. These agents aim to help
- SWE (Software Engineer)
- MLE (Machine Learning Engineer)
- DS (Data Scientist)
- DA (Data Analyst)
- Paper with Code
- Opensource Projects / Company Products
- Foundation Models
| Paper |
Year |
Publisher |
Type |
Institution |
Code |
| SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering |
2024 |
Arxiv |
GitHub issue fixing |
Princeton |
 |
| SWE-bench: Can Language Models Resolve Real-World GitHub Issues? |
2024 |
ICLR |
benchmark github issue fixing |
Princeton |
 |
| DevBench: A Comprehensive Benchmark for Software Development |
2024 |
Arxiv |
benchmark LLM for dev lifecycle |
Shanghai AI Laboratory etc |
 |
| Code Generation with AlphaCodium: From Prompt Engineering to Flow Engineering |
2024 |
Arxiv |
code generation for CodeContests |
CodiumAI |
 |
| ChatDev: Communicative Agents for Software Development |
2023 |
Arxiv |
design, coding, and testing |
Tsinghua University etc |
 |
| MetaGPT: The Multi-Agent Framework |
2023 |
Arxiv |
Multi-Agent Framework. using the software collaboration as an example |
DeepWisdom etc |
 |
| Data Interpreter: An LLM Agent For Data Science |
2024 |
Arxiv |
address data science problem |
DeepWisdom etc |
|
| Agentless: Demystifying LLM-based Software Engineering Agents |
2024 |
Arxiv |
agentless method for swe-bench |
UIUC |
 |
| DS-1000: A Natural and Reliable Benchmark for Data Science Code Generation |
2023 |
ICML |
code generation benchmark with a thousand data science questions |
The University of Hong Kong etc |
 |
| AutoCodeRover: Autonomous Program Improvement |
2024 |
[Arxiv] |
|
NUS |
 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Opensource Projects / Company Products
| Name |
Type |
Target |
Contributor |
Code / Product |
| OpenDevin: Code Less, Make More |
write code, fix bugs, and ship features. |
SWE |
OpenDevin Community |
 |
| Devon: An open-source pair programmer |
Codebase exploration Config writing Test writing Bug fixing Architecture exploration |
SWE |
entropy-research |
 |
| gpt-engineer |
write and execute software code |
SWE |
gpt-engineer-org |
 |
| Aider is AI pair programming in your terminal |
start a new project or work with an existing git repo. |
SWE |
paul-gauthier |
 |
| Cover-Agent |
automate and enhance the generation of tests (currently mostly unit tests) |
QA Engineer |
CodiumAI |
 |
| PR-Agent |
Automated Pull Request Analysis, Feedback, Suggestions |
SWE |
CodiumAI |
 |
| GPT PILOT |
VS Code extension that aims to provide the first real AI developer companion |
SWE |
Pythagora-io |
 |
| Claude Engineer |
assist with a wide range of software development tasks |
SWE |
Doriandarko |
 |
| cognition AI |
An applied AI lab building end-to-end software agents. |
SWE |
cognition.ai |
Product |
| Tabby |
self-hosted AI coding assistant, Github Copilot alternative |
SWE |
tabbyml |
 |
| Sweep AI |
issue PR, unit test |
SWE |
Sweep AI |
Product |
| Continue AI |
GitHub Copilot alternative, VS Code and JetBrains extension |
SWE |
Continue |
 |
| Hex Magic AI |
text to sql/python data analysis code, copilot to understand and fix code issues |
MLE / DS |
Hex |
Product |
| datagpt |
chatbot to SQL, automatic data analysis |
DA |
datagpt |
Product |
| pandas-ai |
Chat with your database (SQL, CSV, pandas, polars, mongodb, noSQL, etc). |
DA |
pandas AI |
 |
| bito |
generate, explain and review code |
SWE |
bito |
[Product] |
|
|
|
|
|
Foundation Model (Code Specific)
| Name |
Paper |
Year |
Blog |
Institution |
GitHub |
| Code Llama: Open Foundation Models for Code |
arxiv |
2023 |
link |
Meta |
 |
| CodeQwen1.5-7B |
arxiv |
2024 |
link |
Alibaba |
 |
| StarCoder2-Instruct: Fully Transparent and Permissive Self-Alignment for Code Generation |
N.A. |
2024 |
link |
HuggingFace etc. |
 |
| DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code Intelligence |
arxiv |
2024 |
link |
DeepSeek |
 |
| Codestral |
N.A. |
2024 |
link |
Mistral |
[Hugging Face] |
