is this still being worked on?
Opened this issue · 4 comments
CoffeeShifter commented
when can we expect updates?
EthanC111 commented
Hi @CoffeeShifter , thank you for your interest! We have made several small updates: the demo and the multimodal inference inference script. We will be making new updates soon! Stay tuned!
CoffeeShifter commented
This lack of (public) progress is frightening
EthanC111 commented
Hi @CoffeeShifter thank you for your interest!
Indeed we encounter several technical issues (data mixing, qk norm weights allocation) while finetuning Chameleon on 7b and 34b model for multimodal data. We are trying our best to find the best training recipe at this moment. We will update the repo as soon as we find the recipe. Thank you!
hectorcarrion commented
Any updates?