Language Model Generation Example

[aykutfirat]

This is very exciting work! Can you provide the steps to generate a language model using your architecture?

Thanks.

[Newmu]

Hi @aykutfirat,

This current release is focused on supervised fine-tuning of the language model. In the next month or so we will be releasing some followup work discussing the generative behaviors of the model and likely include this code in that release.

[ncammarata]

@Newmu any update in ETA? I'd love to build an interface for it to explore some of its properties more!

[madisonmay]

@ncammarata we have an interface for text generation using this language model up at https://github.com/IndicoDataSolutions/finetune.

Example usage is at:
https://github.com/IndicoDataSolutions/finetune/blob/master/tests/test_classifier.py#L167

[ncammarata]

@madisonmay super cool thanks!