vitoplantamura/OnnxStream
Lightweight inference library for ONNX files, written in C++. It can run Stable Diffusion XL 1.0 on a RPI Zero 2 (or in 298MB of RAM) but also Mistral 7B on desktops and servers. ARM, x86, WASM, RISC-V supported. Accelerated by XNNPACK.
C++NOASSERTION
Issues
- 5
Compilation errors "cmake -DXNNPACK_BUILD_TESTS=OFF -DXNNPACK_BUILD_BENCHMARKS=OFF .."
#88 opened by rigin - 1
- 1
wasm demos
#87 opened by bil-ash - 2
(Not an issue) WASM Branch: How to build?
#84 opened by JVGA8837 - 9
- 2
Can we working on solution to save every steps into separated / same PNG files?
#38 opened by ThomAce - 0
- 3
Errors with ./sd
#47 opened by NickoDo - 7
Safetensors?
#67 opened by KintCark - 3
- 3
=== ERROR === failed to create multiply operation
#78 opened by kroryan - 2
failed to create multiply operation
#39 opened by TheGib123 - 1
Optimizations for Pi AI hat (Hailo)
#77 opened by eiddor - 0
- 0
More models
#75 opened by KintCark - 0
Diffusers?
#74 opened by KintCark - 2
(LLM) Less: unexpected shape of output
#73 opened by cheapie - 3
Change resolution?
#72 opened by KintCark - 7
Tensor memory layout
#61 opened by thexa4 - 2
Is there an error in "Cast" operator?
#71 opened by noah003 - 2
- 6
Seed option feature request and a question about onnx with custom sd model + lora
#35 opened by coldeny - 25
Help converting and using custom models
#29 opened by GaelicThunder - 3
Any updates in generating dynamic shape images?
#69 opened by Meshwa428 - 1
- 2
Onnxstream won't build
#65 opened by KintCark - 9
Segmentation Fault
#34 opened by tiki-2 - 7
- 1
vae_decoder_qu8/range_data.txt value generation
#63 opened by thexa4 - 1
Add support for 1 step diffusion (DMD)
#62 opened by bil-ash - 2
UnsupportedOperatorError: Exporting the operator ::_transformer_encoder_layer_fwd to ONNX opset
#59 opened by Peterzzz-hub - 2
changing image size
#58 opened by ciaotesla - 2
- 3
Stable Diffisuon 1.5 installation from?
#57 opened by ciaotesla - 1
Username and password required?
#55 opened by KintCark - 3
[feature request] Whisper with openblas
#52 opened by bil-ash - 1
- 2
- 8
Error build
#51 opened by pavelprosto94 - 5
SDXL moire/dither effect - picture quality
#43 opened by lustfeind - 0
[feature request] image 2 image?
#48 opened by ben-barnard - 15
SDXL turbo/SDXL importing
#44 opened by AeroX2 - 0
[FEATURE REQUEST] LCM Sampler
#45 opened by JVGA8837CTC - 0
Implement text-to-video using onnx stream
#42 opened by bil-ash - 1
how to MAX_SPEED=ON
#41 opened by cozmo14047 - 1
could you upload the onnx model?
#37 opened by caofx0418 - 2
Errors build XNNPACK
#33 opened by lustfeind - 5
- 1
running on raspberry pi 3b+
#32 opened by jaydenchan1027 - 1
How to work with stable diffusion 1.5?
#30 opened by ganesh3