Add falcon support in megatron2hf.py

Question

Closed this issue a year ago · 4 comments

Answer 1 · 2023-08-15T11:35:52.000Z

Is someone already working on this? Otherwise you could assign me please.

Answer 2 · 2023-08-15T15:54:51.000Z

Nobody is working on it at the moment, go for it

Answer 3 · 2023-08-16T12:06:11.000Z

I implemented the basic megatron to HF convertion for falcon7b-like models. See https://gist.github.com/malteos/85fd117cb0ba4cd28882464026252ee9

The implementation is still pretty much WIP and requires manually downloading the RWModel + RWConfig files from HF hub.

Answer 4 · 2023-08-16T12:59:50.000Z

very cool, thanks! would you like to make a PR out of it and then one of @andreaskoepf @Olivia-fsm @mpagli @AleHD could have a look?