antmikinka

ane

Reverse engineered Linux driver for the Apple Neural Engine (ANE).

coremltools

Core ML tools contain supporting tools for Core ML model conversion, editing, and validation.

exporters

Export Hugging Face models to Core ML and TensorFlow Lite

ml-ane-transformers

Reference implementation of the Transformer architecture optimized for Apple Neural Engine (ANE)

swift-coreml-transformers

Swift Core ML 3 implementations of GPT-2, DistilGPT-2, BERT, and DistilBERT for Question answering. Other Transformers coming soon!

swift-transformers

Swift Package to implement a transformers-like API in Swift

swift-transformers-test

antmikinka/ane

Reverse engineered Linux driver for the Apple Neural Engine (ANE).

antmikinka/swift-transformers-test

antmikinka/exporters

Export Hugging Face models to Core ML and TensorFlow Lite

antmikinka/surya

OCR, layout analysis, reading order, line detection in 90+ languages

antmikinka/swift-transformers

Swift Package to implement a transformers-like API in Swift

antmikinka/ane-prototypes

ANE optimized prototypes

antmikinka/AQLM

Official Pytorch repository for Extreme Compression of Large Language Models via Additive Quantization https://arxiv.org/pdf/2401.06118.pdf

antmikinka/Autonomous-Balloon-Detecting-Tracking-and-Shooting

This project employs computer vision to identify and target circular balloons with a laser system. It utilizes a Raspberry Pi 4 with 4 GB of RAM for detecting, tracking and shooting down balloons from the largest to the smallest without human interventions.

antmikinka/Awesome-GPTs

Curated list of awesome GPTs 👍.

antmikinka/coreml-examples

Swift Core ML Examples

antmikinka/CoreMLInspect

See the device (CPU/GPU/ANE) and estimated cost for every layer in your CoreML model.

antmikinka/DiffusionKit

On-device Inference of Diffusion Models for Apple Silicon

antmikinka/executorch

On-device AI across mobile, embedded and edge for PyTorch

antmikinka/llm-datasets

High-quality datasets, tools, and concepts for LLM fine-tuning.

antmikinka/llmfarm_core.swift

Swift library to work with llama and other large language models.

antmikinka/mamba.py

An efficient Mamba implementation in PyTorch and MLX.

antmikinka/max

A collection of sample programs, notebooks, and tools which highlight the power of the MAX platform

antmikinka/ml-ferret

antmikinka/ml-mobileclip

This repository contains the official implementation of the research paper, "MobileCLIP: Fast Image-Text Models through Multi-Modal Reinforced Training" CVPR 2024

antmikinka/ml-superposition-prompting

antmikinka/ml-tweak

antmikinka/mlx

MLX: An array framework for Apple silicon

antmikinka/mlx-rag

Explore a simple example of utilizing MLX for RAG application running locally on your Apple Silicon device.

antmikinka/mlx-ui

A hackish frontend for mlx-lm using streamlit.

antmikinka/photo-editor-luts-swiftui

🎨 An image editor using SwifUI & muukii/Pixel

antmikinka/QuaRot

Code for QuaRot, an end-to-end 4-bit inference of large language models.

antmikinka/sglang

SGLang is a structured generation language designed for large language models (LLMs). It makes your interaction with models faster and more controllable.

antmikinka/Sparkle

A software update framework for macOS

antmikinka/WhisperKit

On-device Inference of Whisper Speech Recognition Models for Apple Silicon

antmikinka/whisperkittools

Python tools for WhisperKit: Model conversion, optimization and evaluation