smpanaro/more-ane-transformers

Run transformers (incl. LLMs) on the Apple Neural Engine.

Python

Issues

How straightforward is it to run embeddings models in swift, like bge or gte series models
#2 opened 8 months ago by michaeljelly
12
Pythia 2.8b converted by convert.py script will not call ANE
#1 opened a year ago by adonishong
1