vitoplantamura/OnnxStream
Lightweight inference library for ONNX files, written in C++. It can run Stable Diffusion XL 1.0 on a RPI Zero 2 (or in 298MB of RAM) but also Mistral 7B on desktops and servers. ARM, x86, WASM, RISC-V supported. Accelerated by XNNPACK.
C++NOASSERTION
Issues
- 1
- 25
Help converting and using custom models
#29 opened by GaelicThunder - 4
Safetensors?
#67 opened by KintCark - 3
Any updates in generating dynamic shape images?
#69 opened by Meshwa428 - 1
- 2
Onnxstream won't build
#65 opened by KintCark - 3
Seed option feature request and a question about onnx with custom sd model + lora
#35 opened by coldeny - 9
Segmentation Fault
#34 opened by tiki-2 - 7
- 1
vae_decoder_qu8/range_data.txt value generation
#63 opened by thexa4 - 2
Tensor memory layout
#61 opened by thexa4 - 1
Add support for 1 step diffusion (DMD)
#62 opened by bil-ash - 2
UnsupportedOperatorError: Exporting the operator ::_transformer_encoder_layer_fwd to ONNX opset
#59 opened by Peterzzz-hub - 2
changing image size
#58 opened by ciaotesla - 2
- 3
Stable Diffisuon 1.5 installation from?
#57 opened by ciaotesla - 1
Username and password required?
#55 opened by KintCark - 3
[feature request] Whisper with openblas
#52 opened by bil-ash - 1
- 2
- 8
Error build
#51 opened by pavelprosto94 - 1
Errors with ./sd
#47 opened by NickoDo - 5
SDXL moire/dither effect - picture quality
#43 opened by lustfeind - 0
[feature request] image 2 image?
#48 opened by ben-barnard - 20
Odroid N2+
#22 opened by CarlFink - 15
SDXL turbo/SDXL importing
#44 opened by AeroX2 - 0
[FEATURE REQUEST] LCM Sampler
#45 opened by JVGA8837CTC - 0
Implement text-to-video using onnx stream
#42 opened by bil-ash - 1
how to MAX_SPEED=ON
#41 opened by cozmo14047 - 1
failed to create multiply operation
#39 opened by TheGib123 - 0
Can we working on solution to save every steps into separated / same PNG files?
#38 opened by ThomAce - 1
could you upload the onnx model?
#37 opened by caofx0418 - 27
Logging needed
#18 opened by ThomAce - 2
Errors build XNNPACK
#33 opened by lustfeind - 5
- 1
running on raspberry pi 3b+
#32 opened by jaydenchan1027 - 9
error doing OnnxStream build
#27 opened by TheJohnHanson1 - 2
Feature Proposal: Integration of OnnxStream with Automatic1111webui using RAM instead of VRAM
#28 opened by katyukuki - 1
How to work with stable diffusion 1.5?
#30 opened by ganesh3 - 2
Unable to run cmake
#26 opened by ganesh3 - 3
- 2
build error with latest Cpp
#24 opened by ThomAce - 1
- 2
Things I want to ask
#21 opened by shashankx86 - 1
- 15
issues with provided xnnpack build
#16 opened by ThomAce - 4
compiling in raspi 4
#13 opened by RorschachTest - 2
- 1
OnnxStream and TinyLlama?
#15 opened by stl3 - 1
Very slow performance on Ryzen 7 4700u + more features and command line options needed
#14 opened by JohnClaw