idea: push Ichago inference to upstream llama.cpp

[bennmann]

Problem Statement

I want more people to use Ichago multi-modal methods.

Idea

Not sure how Ichago aligns with llama.cpp goals and user stories.... huge userbase would test if all stakeholders aligned a little bit on any feature addition on llama.cpp. It would be good to push Ichago inference upstream to llama.cpp.