Unsupported cuda toolkit version: 13.1
Author: b7kichCreated Mar 7, 2026Updated Mar 7, 2026
Labelsbug
Backend impacted
The Rust implementation
Operating system
Linux
Hardware
GPU with CUDA
Description
$ cargo run --features cuda --bin moshi-backend -r -- --config moshi-backend/config.json standalone
warning: profiles for the non root package will be ignored, specify profiles at the workspace root:
package: /home/ec2-user/ai/moshi/rust/moshi-backend/Cargo.toml
workspace: /home/ec2-user/ai/moshi/rust/Cargo.toml
warning: profiles for the non root package will be ignored, specify profiles at the workspace root:
package: /home/ec2-user/ai/moshi/rust/moshi-cli/Cargo.toml
workspace: /home/ec2-user/ai/moshi/rust/Cargo.toml
Compiling icu_locid v1.5.0
Compiling gemm-f32 v0.18.2
Compiling gemm-f64 v0.18.2
Compiling gemm-c64 v0.18.2
Compiling gemm-c32 v0.18.2
Compiling gemm-f32 v0.17.1
Compiling cudarc v0.16.2
Compiling candle-kernels v0.9.1
Compiling hyper-util v0.1.11
Compiling gemm-c64 v0.17.1
Compiling gemm-f64 v0.17.1
Compiling gemm-c32 v0.17.1
Compiling unicode-width v0.2.0
Compiling num_threads v0.1.7
Compiling rustls v0.23.26
Compiling unicase v2.8.1
Compiling num-conv v0.1.0
Compiling rustls v0.21.12
Compiling cfg-if v1.0.0
Compiling log v0.4.27
Compiling time-core v0.1.4
Compiling cpufeatures v0.2.17
error: failed to run custom build command for `cudarc v0.16.2`
Caused by:
process didn't exit successfully: `/home/ec2-user/ai/moshi/rust/target/release/build/cudarc-35a624df91e59fa9/build-script-build` (exit status: 101)
--- stdout
cargo:rerun-if-changed=build.rs
cargo:rerun-if-env-changed=CUDA_ROOT
cargo:rerun-if-env-changed=CUDA_PATH
cargo:rerun-if-env-changed=CUDA_TOOLKIT_ROOT_DIR
--- stderr
thread 'main' (17151) panicked at /home/ec2-user/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.16.2/build.rs:104:14:
Unsupported cuda toolkit version: `13.1`. Please raise a github issue.
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
warning: build failed, waiting for other jobs to finish...Extra information
The web demo is great! Hence I wanted to try this at home.
Environment
Fill in the following information on your system.
- Operating system version: Ubuntu LTS 24.04
- NVIDIA-SMI 590.52.01 Driver Version: 591.74 CUDA Version: 13.1
- GPU model and memory: NVIDIA GeForce RTX 4060 8GB
Source: kyutai-labs/moshi