Baijiong-Lin/LoRA-Torch
PyTorch Reimplementation of LoRA (featuring with supporting nn.MultiheadAttention)
PythonMIT
Issues
- 8
MultiheadAttention out_projection
#3 opened - 2
a question about nn.MultiheadAttention
#6 opened by PoopBear1 - 0
Torch .compile() vs. implementation
#4 opened by AlexanderLavelle - 5
About Code Efficiency Improvement
#2 opened by xbingsun - 5
Some problem on that structure modification of pre-trained model when use loratorch
#1 opened by hacker-jerry