/caikit-nlp

Primary LanguagePythonApache License 2.0Apache-2.0

Caikit NLP

caikit_nlp is a Caikit library that currently provides PEFT prompt tuning and MPT (multi-task prompt tuning) functionalities.

More information on MPT can be found at: https://arxiv.org/abs/2303.02861

Currently causal language models and sequence-to-sequence models are supported.

Notes

  • The data model for text generative capabilities is baked into this repository itself at caikit_nlp/data_model/generation.py.