/mistral-image-captioning-agent

Image Captioning Agent using Mistral 7B

Primary LanguageJupyter Notebook

Multimodal Image Captioning Agent using Mistral 7B

  • We use quantized Mistral-7B Instruct
  • Salesforce BLIP for image captioning using HuggingFace transformers
  • Langchain for building custom tools and agent