JiwenJ/Awesome-LLM

Awesome-LLM

---

• Awesome LLM
  • Video
  • Paper & Blog
  • Prompt Engineering

---

Video

Li Hungy-yi

• https://speech.ee.ntu.edu.tw/~hylee/index.php

Li Mu

• https://space.bilibili.com/1567748478

Andrew Ng

• https://learn.deeplearning.ai/chatgpt-prompt-eng/lesson/1/introduction

Awesome LLM

• https://github.com/kyaiooiayk/Awesome-LLM-Large-Language-Models-Notes
• https://github.com/Hannibal046/Awesome-LLM
• https://github.com/thunlp/PLMpapers

Paper & Blog

LLMs Survey

• A Survey on Multimodal Large Language Models
• A Survey of Large Language Models

Paper Must Read

• https://arxiv.org/abs/2303.18223

Blog

• https://wqw547243068.github.io/
• 符尧
• A kar

GPT

• https://s3-us-west-2.amazonaws.com/openai-assets/research-covers/language-unsupervised/language_understanding_paper.pdf

GPT-2

https://arxiv.org/pdf/2303.08774.pdf

GPT-3

https://arxiv.org/pdf/2303.08774.pdf

Instruct GPT

• https://arxiv.org/abs/2203.02155

GPT-4

• https://arxiv.org/pdf/2303.08774.pdf

Sparks of Artificial General Intelligence: Early experiments with GPT-4

• https://arxiv.org/pdf/2303.08774.pdf

GPTs are GPTs: An Early Look at the Labor Market Impact Potential of Large Language Models

• https://arxiv.org/abs/2303.10130

LLaMa

• https://ai.facebook.com/blog/large-language-model-llama-meta-ai/
• https://github.com/facebookresearch/llama
• https://arxiv.org/abs/2302.13971
• https://research.facebook.com/publications/llama-open-and-efficient-foundation-language-models/

Vicuna

• https://lmsys.org/blog/2023-03-30-vicuna/

Dalai

• https://github.com/cocktailpeanut/dalai

Alpaca

• https://crfm.stanford.edu/2023/03/13/alpaca.html

Survey

• https://github.com/RUCAIBox/LLMSurvey
• https://arxiv.org/pdf/2101.01169.pdf

Blip2

• https://github.com/salesforce/LAVIS/tree/main/projects/blip2
• https://arxiv.org/abs/2301.12597
• https://pub.towardsai.net/minigpt-4-chatgpt-for-your-images-ac111a5b288a

MiniGPT-4

• https://github.com/Vision-CAIR/MiniGPT-4

Claude

• https://www.anthropic.com/index/introducing-claude

Transformer in computer vision

• DETR
• ViT
• BEiT
• DeiT
• Swin-Transformer
• CSWin-Transformer

Optimizer

• Lion https://arxiv.org/abs/2302.06675

HELM

• https://arxiv.org/pdf/2211.09110.pdf

Benchmark

• https://super.gluebenchmark.com/leaderboard
• https://chat.lmsys.org/?arena

Course

• https://zhuanlan.zhihu.com/p/50910925

Tutorial

• https://mp.weixin.qq.com/s/4QNgF6nAUo8imSaIB_OWmg

transformers are Sample-Efficient World Models

• https://arxiv.org/abs/2209.00588

---

Prompt Engineering

Date	Paper	Info	Innovation	Implementation
2021-09-03	Finetuned Language Models Are Zero-Shot Learners	Zero-Shot	1	1
2022-01-28	Chain-of-Thought Prompting Elicits Reasoning in Large Language Models	CoT	1	1
1	1	1	1	1
1	1	1	1	1
1	1	1	1	1
1	1	1	1	1
1	1	1	1	1
1	1	1	1	1

Reference

• https://learnprompting.org/docs/intro
• https://www.promptingguide.ai/
• https://mattnigh.github.io/ChatGPT3-Free-Prompt-List/

---

Finetune Tutorial

Blog

• https://zhuanlan.zhihu.com/p/618894319

Project

https://github.com/tloen/alpaca-lora

tips: https://www.reddit.com/r/Oobabooga/comments/12eniem/bitsandbytes_now_for_windows_8bit_cuda_functions/