Must-read Papers on Large Language Model (LLM) as Optimizers and Automatic Optimization for Prompting LLMs.
- 2023-10-06 We create this paper list on LLM as Optimizers and Automatic Optimization for Prompting LLMs .
-
RLPrompt: Optimizing Discrete Text Prompts with Reinforcement Learning
Mingkai Deng, Jianyu Wang, Cheng-Ping Hsieh, Yihan Wang, Han Guo, Tianmin Shu, Meng Song, Eric P. Xing, Zhiting Hu. [abs]. EMNLP 2022.
-
Large Language Models Are Human-Level Prompt Engineers
Yongchao Zhou, Andrei Ioan Muresanu, Ziwen Han, Keiran Paster, Silviu Pitis, Harris Chan, Jimmy Ba. [abs]. ICLR 2023.
-
GrIPS: Gradient-free, Edit-based Instruction Search for Prompting Large Language Models
Archiki Prasad, Peter Hase, Xiang Zhou, Mohit Bansal. [abs]. EACL 2023.
-
Automatic Prompt Optimization with "Gradient Descent" and Beam Search
Reid Pryzant, Dan Iter, Jerry Li, Yin Tat Lee, Chenguang Zhu, Michael Zeng. [abs]. Preprint 2023.05.
-
InstructZero: Efficient Instruction Optimization for Black-Box Large Language Models
Lichang Chen, Jiuhai Chen, Tom Goldstein, Heng Huang, Tianyi Zhou. [abs]. Preprint 2023.06.
-
Retroformer: Retrospective Large Language Agents with Policy Gradient Optimization
Weiran Yao, Shelby Heinecke, Juan Carlos Niebles, Zhiwei Liu, Yihao Feng, Le Xue, Rithesh Murthy, Zeyuan Chen, Jianguo Zhang, Devansh Arpit, Ran Xu, Phil Mui, Huan Wang, Caiming Xiong, Silvio Savarese. [abs]. Preprint 2023.08.
-
Forget Demonstrations, Focus on Learning from Textual Instructions
Renze Lou, Wenpeng Yin. [abs]. Preprint 2023.08.
-
Large Language Models as Optimizers
Chengrun Yang, Xuezhi Wang, Yifeng Lu, Hanxiao Liu, Quoc V. Le, Denny Zhou, Xinyun Chen. [abs]. Preprint 2023.09.
-
Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolution
Chrisantha Fernando, Dylan Banarse, Henryk Michalewski, Simon Osindero, Tim Rocktäschel. [abs]. Preprint 2023.09.
-
Connecting Large Language Models with Evolutionary Algorithms Yields Powerful Prompt Optimizers
Qingyan Guo, Rui Wang, Junliang Guo, Bei Li, Kaitao Song, Xu Tan, Guoqing Liu, Jiang Bian, Yujiu Yang. [abs]. Preprint 2023.09.
-
Self-Taught Optimizer (STOP): Recursively Self-Improving Code Generation
Eric Zelikman, Eliana Lorch, Lester Mackey, Adam Tauman Kalai. [abs]. Preprint 2023.10.
-
DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelines
Omar Khattab, Arnav Singhvi, Paridhi Maheshwari, Zhiyuan Zhang, Keshav Santhanam, Sri Vardhamanan, Saiful Haq, Ashutosh Sharma, Thomas T. Joshi, Hanna Moazam, Heather Miller, Matei Zaharia, Christopher Potts. [abs]. Preprint 2023.10.
-
Eureka: Human-Level Reward Design via Coding Large Language Models
Yecheng Jason Ma, William Liang, Guanzhi Wang, De-An Huang, Osbert Bastani, Dinesh Jayaraman, Yuke Zhu, Linxi Fan, Anima Anandkumar. [abs]. Preprint 2023.10.
-
PromptAgent: Strategic Planning with Language Models Enables Expert-level Prompt Optimization
Xinyuan Wang, Chenxi Li, Zhen Wang, Fan Bai, Haotian Luo, Jiayou Zhang, Nebojsa Jojic, Eric P. Xing, Zhiting Hu. [abs], Preprint 2023.10
-
OptiMUS: Optimization Modeling Using MIP Solvers and large language models
Ali AhmadiTeshnizi, Wenzhi Gao, Madeleine Udell. [abs], Preprint 2023.10
-
AI-Copilot for Business Optimisation: A Framework and A Case Study in Production Scheduling
Pivithuru Thejan Amarasinghe, Su Nguyen, Yuan Sun, Damminda Alahakoon. [abs], Preprint 2023.10
-
Enhancing Genetic Improvement Mutations Using Large Language Models
Alexander E.I. Brownlee, James Callan, Karine Even-Mendoza, Alina Geiger, Carol Hanna, Justyna Petke, Federica Sarro, Dominik Sobania. [abs], Preprint 2023.10
-
Language Model Decoding as Direct Metrics Optimization
Haozhe Ji, Pei Ke, Hongning Wang, Minlie Huang. [abs], Preprint 2023.10
-
Large Language Models to Enhance Bayesian Optimization
ICLR 2024 Conference Submission8133 Authors. [openreview], ICLR submission 2023.10
-
Large Language Models as Evolutionary Optimizers
Shengcai Liu, Caishun Chen, Xinghua Qu, Ke Tang, Yew-Soon Ong. [abs], Preprint 2023.11
-
Large Language Models can Implement Policy Iteration
Ethan Brooks, Logan Walls, Richard L. Lewis, Satinder Singh. [abs], NeurIPS 2023
-
Large Language Models for Automated Data Science: Introducing CAAFE for Context-Aware Automated Feature Engineering
Noah Hollmann, Samuel Müller, Frank Hutter. [abs], NeurIPS 2023
-
Plum: Prompt Learning using Metaheuristic
Rui Pan, Shuo Xing, Shizhe Diao, Xiang Liu, Kashun Shum, Jipeng Zhang, Tong Zhang. [abs], Preprint 2023.11
-
ReEvo: Large Language Models as Hyper-Heuristics with Reflective Evolution
Haoran Ye, Jiarui Wang, Zhiguang Cao, Guojie Song. [abs], [code], Preprint 2024.02