Aleph-Alpha/magma
MAGMA - a GPT-style multimodal model that can understand any combination of images and language. NOTE: The freely available model from this repo is only a demo. For the latest multimodal and multilingual models from Aleph Alpha check out our website https://app.aleph-alpha.com
PythonMIT
Issues
- 3
OpenSource strategy
#50 opened by sebastianlutter - 0
- 0
How are the n-shot VQA examples selected?
#48 opened by ys-zong - 3
- 2
How to reproduce the n shot VQA, OKVQA and GQA results from Table -1? No eval script is available
#45 opened by sanyalsunny111 - 2
Typeguard version in requirements
#47 opened by NiclasGoering - 0
Issue with the dataloader
#44 opened by sanyalsunny111 - 2
Reproducing results from your paper
#42 opened by Golovneva - 1
how did you calculate the bleu score
#40 opened by TobiasLee - 0
- 1
top_p argument is used like 1-top_p
#29 opened by nostalgebraist - 6
AssertionError: Parameter with name: lm.transformer.wte.weight occurs multiple times in optimizer.param_groups. Make sure it only appears once to prevent undefined behaviour
#32 opened by masoud-monajati - 1
Torch Size Mismatch
#34 opened by harshagundala - 5
Automatic model download doesn't work
#23 opened by Heath123 - 0
Host checkpoints
#22 opened by CoEich - 6
No module named 'magma.transformers'
#28 opened by Tuxius - 1
size mismatch for lm.lm_head.weight: copying a param with shape torch.Size([50400, 4096]) from checkpoint, the shape in current model is torch.Size([50258, 4096]).
#31 opened by UCCME - 1
- 3
- 0
Add LICENSE
#21 opened by CoEich - 0
Implement loading checkpoint from url
#20 opened by CoEich - 1
Improved inference interface
#9 opened by CoEich - 0
Refactor README
#8 opened by sdtblck - 1
Update to latest version of transformers
#5 opened by sdtblck - 1
Split up model.py into different files
#13 opened by sdtblck - 0
clean up train.py
#17 opened by CoEich - 0
- 0
Cleanup requirements.txt
#10 opened by sdtblck - 0
Eval.py: To keep or not to keep?
#7 opened by sdtblck - 0
Cleanup `multimodal_fewshot/config.py`
#4 opened by sdtblck - 1
- 0
remove `proj_layer_type` Option
#3 opened by sdtblck - 0
Clean Up `multimodal_fewshot/adapters.py`
#2 opened by sdtblck - 0
Delete Unneeded Configs
#1 opened by sdtblck