#406·moshi

Unsupported cuda toolkit version: 13.1

Author: b7kichCreated Mar 7, 2026Updated Mar 7, 2026
Labelsbug

Backend impacted

The Rust implementation

Operating system

Linux

Hardware

GPU with CUDA

Description

$ cargo run --features cuda --bin moshi-backend -r -- --config moshi-backend/config.json standalone
warning: profiles for the non root package will be ignored, specify profiles at the workspace root:
package:   /home/ec2-user/ai/moshi/rust/moshi-backend/Cargo.toml
workspace: /home/ec2-user/ai/moshi/rust/Cargo.toml
warning: profiles for the non root package will be ignored, specify profiles at the workspace root:
package:   /home/ec2-user/ai/moshi/rust/moshi-cli/Cargo.toml
workspace: /home/ec2-user/ai/moshi/rust/Cargo.toml
   Compiling icu_locid v1.5.0
   Compiling gemm-f32 v0.18.2
   Compiling gemm-f64 v0.18.2
   Compiling gemm-c64 v0.18.2
   Compiling gemm-c32 v0.18.2
   Compiling gemm-f32 v0.17.1
   Compiling cudarc v0.16.2
   Compiling candle-kernels v0.9.1
   Compiling hyper-util v0.1.11
   Compiling gemm-c64 v0.17.1
   Compiling gemm-f64 v0.17.1
   Compiling gemm-c32 v0.17.1
   Compiling unicode-width v0.2.0
   Compiling num_threads v0.1.7
   Compiling rustls v0.23.26
   Compiling unicase v2.8.1
   Compiling num-conv v0.1.0
   Compiling rustls v0.21.12
   Compiling cfg-if v1.0.0
   Compiling log v0.4.27
   Compiling time-core v0.1.4
   Compiling cpufeatures v0.2.17
error: failed to run custom build command for `cudarc v0.16.2`

Caused by:
  process didn't exit successfully: `/home/ec2-user/ai/moshi/rust/target/release/build/cudarc-35a624df91e59fa9/build-script-build` (exit status: 101)
  --- stdout
  cargo:rerun-if-changed=build.rs
  cargo:rerun-if-env-changed=CUDA_ROOT
  cargo:rerun-if-env-changed=CUDA_PATH
  cargo:rerun-if-env-changed=CUDA_TOOLKIT_ROOT_DIR

  --- stderr

  thread 'main' (17151) panicked at /home/ec2-user/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.16.2/build.rs:104:14:
  Unsupported cuda toolkit version: `13.1`. Please raise a github issue.
  note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
warning: build failed, waiting for other jobs to finish...

Extra information

The web demo is great! Hence I wanted to try this at home.

Environment

Fill in the following information on your system.

  • Operating system version: Ubuntu LTS 24.04
  • NVIDIA-SMI 590.52.01 Driver Version: 591.74 CUDA Version: 13.1
  • GPU model and memory: NVIDIA GeForce RTX 4060 8GB