make install-server does not have Apple MacOS Metal Framework
Author: qdrddrCreated Jan 8, 2025Updated Feb 17, 2026
System Info
make install-server does not have Apple MacOS Metal Framework
- Please either remove from the readme info about brew/macOS altogether to not confuse users.
- OR add support for Apple MPS framework to the ./server folder so the make command can install on macOS.
Information
- Docker
- The CLI directly
Tasks
- An officially supported command
- My own modifications
Reproduction
#on macOS M-series:
make install-server
Tries to install flash attention with NVIDIA CUDA
Expected behavior
make install-server should be optimized for Apple Metal Framework.
Source: huggingface/text-generation-inference