dustinblackman/oatmeal

Use markdown parser in chat for sending media to multimodal LLMs

Opened this issue · 0 comments

Hi there,

First of all, fantastic tool, thank you!

I want to embed media in my chat conversations(such as wireframes, prerecorded sound etc.) I think if chat boxes had markdown parsers already, it could fetch the media from local file system and send it to ollama or other servers. Markdown seems to be the perfect format for this, just like how github supports it(but with local file access). Have you considered this feature?

Also we probably would need decent additions to the chat history format to have these files stored in history as binary(or not if certain flag is passed to the cli). What do you think?