A Survey on LLM-based Autonomous Agents

Growth Trend

Autonomous agents are designed to achieve specific objectives through self-guided instructions. With the emergence and growth of large language models (LLMs), there is a growing trend in utilizing LLMs as fundamental controllers for these autonomous agents. While previous studies in this field have achieved remarkable successes, they remain independent proposals with little effort devoted to a systematic analysis. To bridge this gap, we conduct a comprehensive survey study, focusing on the construction, application, and evaluation of LLM-based autonomous agents. In particular, we first explore the essential components of an AI agent, including a profile module, a memory module, a planning module, and an action module. We further investigate the application of LLM-based autonomous agents in the domains of natural sciences, social sciences, and engineering. Subsequently, we delve into a discussion of the evaluation strategies employed in this field, encompassing both subjective and objective methods. Our survey aims to serve as a resource for researchers and practitioners, providing insights, related references, and continuous updates on this exciting and rapidly evolving field.

📍 This is the first released and published survey paper in the field of LLM-based autonomous agents.

Paper link: A Survey on Large Language Model based Autonomous Agents

Update Records

🔥 [25/3/2024] Our survey paper has been accepted by Frontiers of Computer Science, which is the first published survey paper in the field of LLM-based agents.
🔥 [9/8/2023] The second version of our survey has been released on arXiv.

Updated contents

-  **📚 Additional References**
    - We have added 31 new works until 9/1/2023 to make the survey more comprehensive and up-to-date.

-  **📊 New Figures**
    - **Figure 3:** This is a new figure illustrating the differences and similarities between various planning approaches. This helps in gaining a clearer understanding of the comparisons between different planning methods.
    ![single-path and multi-path reasoning](assets/planning.png)
    - **Figure 4:** This is a new figure that describes the evolutionary path of model capability acquisition from the "Machine Learning era" to the "Large Language Model era" and then to the "Agent era." Specifically, a new concept, "mechanism engineering," has been introduced, which, along with "parameter learning" and "prompt engineering," forms part of this evolutionary path.
    ![Capabilities Acquisition](assets/capability.png)

-  **🔍 Optimized Classification System**
    - We have slightly modified the classification system in our survey to make it more logical and organized.

🔥 [8/23/2023] The first version of our survey has been released on arXiv.

Table of Content

🤖 Construction of LLM-based Autonomous Agent
📍 Applications of LLM-based Autonomous Agent
📊 Evaluation on LLM-based Autonomous Agent
🌐 More Comprehensive Summarization
👨‍👨‍👧‍👦 Maintainers
📚 Citation
💪 How to Contribute
🫡 Acknowledgement
📧 Contact Us

🤖 Construction of LLM-based Autonomous Agent

Architecture Design

Model

Profile

Memory

Planning

Action

Paper

Code

Operation

Structure

WebGPT

w/ tools

w/ fine-tuning

LLM-Agent-Survey

A Survey on LLM-based Autonomous Agents

Update Records

Table of Content

🤖 Construction of LLM-based Autonomous Agent

📍 Applications of LLM-based Autonomous Agent

📊 Evaluation on LLM-based Autonomous Agent

🌐 More Comprehensive Summarization

👨‍👨‍👧‍👦 Maintainers

📚 Citation

💪 How to Contribute

🫡 Acknowledgement

📧 Contact Us