huggingface/peft

Inquiry on Inserting P-Tuning Soft Prompts at Any Position in Input

Betty1202 opened this issue · 2 comments

Betty1202 commented

System Info

None

Who can help?

No response

Information

  • The official example scripts
  • My own modified scripts

Tasks

  • An officially supported task in the examples folder
  • My own task or dataset (give details below)

Reproduction

None

Expected behavior

How to insert P-tuning soft prompt into the input at any position (not just the beginning). As mentioned in your document at https://huggingface.co/docs/peft/main/en/package_reference/p_tuning, "The prompt tokens can be added anywhere in the input sequence." However, I didn't find any parameters in PromptEncoderConfig or PromptEncoder that can be set for this purpose. Could you please advise on how to set this up?