chaitanyaanimesh/OPT-Unbounded

An implementation in Pytorch showing how to replace the learned position embedding with positional encoding in Meta's OPT models to make the context length unbounded.

Python