cryscan/web-rwkv

TensorNotFound error appearing with v5 upgrade

Closed this issue · 3 comments

mal-sh commented

root@79532d12746a:/workspace/web-rwkv# cargo run --release --example chat -- --model assets/models/converted.st
Finished release [optimized] target(s) in 0.07s
Running target/release/examples/chat --model assets/models/converted.st
error: XDG_RUNTIME_DIR not set in the environment.
error: XDG_RUNTIME_DIR not set in the environment.
error: XDG_RUNTIME_DIR not set in the environment.
error: XDG_RUNTIME_DIR not set in the environment.
✔ Please select an adapter · NVIDIA RTX A4000 (Vulkan)
error: XDG_RUNTIME_DIR not set in the environment.
error: XDG_RUNTIME_DIR not set in the environment.
error: XDG_RUNTIME_DIR not set in the environment.
error: XDG_RUNTIME_DIR not set in the environment.
AdapterInfo {
name: "NVIDIA RTX A4000",
vendor: 4318,
device: 9392,
device_type: DiscreteGpu,
driver: "NVIDIA",
driver_info: "535.104.05",
backend: Vulkan,
}
thread 'main' panicked at 'called Result::unwrap() on an Err value: TensorNotFound("blocks.0.att.time_mix_g")', examples/chat.rs:263:34
note: run with RUST_BACKTRACE=1 environment variable to display a backtrace

Seems that you are running v4 models. Currently the examples support v5 only (for quick test, but the library itself supports both versions), I will add support for detecting and loading both versions in the examples later.

Hi! May you try the latest v0.3.1 build? It should detect the version automatically.

mal-sh commented

yes, it worked, I successfully loaded v4 models, thank you!