/CodeLlama-via-DeepInfra

Primary LanguagePythonApache License 2.0Apache-2.0

A Playground for 🦙 CodeLlama in Streamlit!

Overview

I've created a simple 🎈Streamlit app using DeepInfra's inference API to showcase the CodeLlama model that Meta launched last Thursday.

App Usage

The app is currently utilizing my DeepInfra key. This allows for free interactions producing responses up to 500 tokens. For more extended answers, users must input their own DeepInfra API key. If you need one, you can obtain it here.

Note: All Llama models are charged $1 per 1M tokens on DeepInfra

Code Llama Highlights:

  • Foundation: Enhanced version of Llama 2 for coding.
  • Open Access: Free for research and commercial use.
  • Capabilities:
    • Generate and discuss code.
    • Code completion and debugging.
    • Supports languages like Python, C++, Java, and more.
  • Varieties: Available in 7B, 13B, and 34B parameter sizes.
  • Special Variations:
    • Python: Fine-tuned for Python code.
    • Instruct: Improved for natural language instructions.
  • Community Engagement: Encourages public feedback and improvements.
  • Versatility: Supports various sectors, from research to businesses.