Error report: not implemented (When run prefix on gpt2)
yushengsu-thu opened this issue · 0 comments
yushengsu-thu commented
When performing prefix on gpt-2, it will report error: not implemented.
I think that's because the pre-fix module is not recognized as GPTAttention in new_modules_like function (director: delta_modules/prefix.py).