LuLuLuyi/LongHeads

LongHeads: Multi-Head Attention is Secretly a Long Context Processor

Python

Issues

Poor Performance on Passkey Retrieval
#3 opened 3 months ago by 1190303125
4
Talking-Heads
#2 opened 9 months ago by Ryu1845
1
example.py bug
#1 opened 9 months ago by Leona-Karelin
1