axolotl-ai-cloud/axolotl

Gemma2 Support

Closed this issue ยท 1 comments

โš ๏ธ Please check that this feature request hasn't been suggested before.

  • I searched previous Ideas in Discussions didn't find any similar feature requests.
  • I searched previous Issues didn't find any similar feature requests.

๐Ÿ”– Feature description

With the release of Google's new models Gemma2 9B and Gemma2 27B, it would be very useful to have those models incorporate to the training framework of Axolotl.

โœ”๏ธ Solution

Integrate the new model by providing configuration scripts and incorporating the Gemma2 template.

โ“ Alternatives

No response

๐Ÿ“ Additional Context

No response

Acknowledgements

  • My issue title is concise, descriptive, and in title casing.
  • I have searched the existing issues to make sure this feature has not been requested yet.
  • I have provided enough information for the maintainers to understand and evaluate this request.

Seems to be implemented now.