hululuzhu/better-chatbot-than-chatgpt

Brainstorm possible research/engineering candidates that could let us train better chatbots than ChatGPT/GPT4

better-chatbot-than-chatgpt

• Brainstorm possible research/engineering candidates that could let us train better chatbots than ChatGPT/GPT4 in selected aspects.

Slides as of 2023/05/21

• See brainstorm_better_chatbot_than_chatgpt_v1 slides here

Agenda 2023/05/21

• Solid foundation pretrained models
  • Llama & ChatGLM
  • MPT-7b & RedPajama?
• Get close to ChatGPT by “behavioral cloning” or self-align?
  • Alpaca
  • Vicuna
  • Dromedary
• More [sub-domain] knowledge than ChatGPT?
  • Domain specific pretraining: e.g. codex, Minerva
  • Retrieval in LM training: WebGPT and Sparrow
  • Augmented LM (retrieval outside LM training)
    • E.g. Langchain, or DPR
• Longer context than GPT4?
  • AliBi
  • HWFA (chinese only, by Su Jianlin)
• Lower cost of training and inference?
  • Multi-query attention
  • FlashAttention
  • FastTranformer
  • PEFT by HuggingFace
  • DeepSpeedChat
• Better reward model and RL?
  • InstructGPT
  • Anthropic
  • Sparrow
  • John Schulman Bekerley talk
• More modalities than GPT4?
  • HuggingGPT
  • MiniGPT4
  • Visual-GLM6B
• Very very important, evaluation!