TensorNotFound error appearing with v5 upgrade
Closed this issue · 3 comments
root@79532d12746a:/workspace/web-rwkv# cargo run --release --example chat -- --model assets/models/converted.st
Finished release [optimized] target(s) in 0.07s
Running target/release/examples/chat --model assets/models/converted.st
error: XDG_RUNTIME_DIR not set in the environment.
error: XDG_RUNTIME_DIR not set in the environment.
error: XDG_RUNTIME_DIR not set in the environment.
error: XDG_RUNTIME_DIR not set in the environment.
✔ Please select an adapter · NVIDIA RTX A4000 (Vulkan)
error: XDG_RUNTIME_DIR not set in the environment.
error: XDG_RUNTIME_DIR not set in the environment.
error: XDG_RUNTIME_DIR not set in the environment.
error: XDG_RUNTIME_DIR not set in the environment.
AdapterInfo {
name: "NVIDIA RTX A4000",
vendor: 4318,
device: 9392,
device_type: DiscreteGpu,
driver: "NVIDIA",
driver_info: "535.104.05",
backend: Vulkan,
}
thread 'main' panicked at 'called Result::unwrap()
on an Err
value: TensorNotFound("blocks.0.att.time_mix_g")', examples/chat.rs:263:34
note: run with RUST_BACKTRACE=1
environment variable to display a backtrace
Seems that you are running v4 models. Currently the examples support v5 only (for quick test, but the library itself supports both versions), I will add support for detecting and loading both versions in the examples later.
Hi! May you try the latest v0.3.1 build? It should detect the version automatically.
yes, it worked, I successfully loaded v4 models, thank you!