This repository contains the code for the conversion of PyTorch models to GGML format. The conversion is done using the ONNX format as an intermediate representation. This can be used to convert models from other frameworks to GGML as well, as long as they support ONNX.
The conversion code is written in Python 3.11. To install the required dependencies, run:
poetry installIf you do not have Poetry installed, please refer to the Poetry documentation.
To run the tests, run:
make clean testModule implementations (to get to BERT):
- Add
- Constant
- ConstantOfShape
- Div
- Equal
- Erf
- Expand
- Gather
- Gemm
- MatMul
- Mul
- Pow
- ReduceMean
- Reshape
- Softmax
- Sqrt
- Sub
- Tanh
- Transpose
- Where