Failed to install Horovod
Author: adityakm24Created Oct 25, 2024Updated Apr 8, 2025
Labelsbug
Environment:
- Framework: TensorFlow, PyTorch
- Framework version:
- TensorFlow: 2.18.0
- PyTorch: 2.4.1
- Horovod version: Attempting to install latest via pip
- MPI version: Microsoft MPI (attempted with version 10)
- CUDA version: 11.8
- NCCL version: None
- Python version: 3.11.9
- Spark / PySpark version: N/A
- Ray version: N/A
- OS and version: Windows 10
- GCC version: Not installed (Windows environment)
- CMake version: 3.30
Checklist:
- Did you search issues to find if somebody asked this question before? Yes
- If your question is about hang, did you read this doc? Yes
- If your question is about docker, did you read this doc? N/A
- Did you check if your question is answered in the troubleshooting guide? Yes
Bug report: I'm encountering issues installing Horovod on Windows 10 with TensorFlow and PyTorch frameworks. Here’s a summary of the setup and error details:
Steps Taken:
- Set environment variables:
set HOROVOD_WITH_MPI=1 set HOROVOD_WITH_CUDA=1 set HOROVOD_CUDA_HOME=C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.8 set MPI_HOME="E:/Program Files/Microsoft MPI" set MPIEXEC_EXECUTABLE="E:\Program Files\Microsoft MPI\Bin\mpiexec.exe" - Attempted installation command:
pip install horovod --no-cache-dir
Error:
Could NOT find MPI (missing: MPI_CXX_FOUND)
CMake Error: The source directory "E:/Projects" does not appear to contain CMakeLists.txt.Additional Details:
- Running
mpiexec --versiondid not provide the expected version output. - Verified CUDA 11.8 installation via
nvcc --version. - Using Microsoft MPI, but suspect compatibility issues with Horovod on Windows.
Source: horovod/horovod