How to use the model that has already been downloaded?
Author: AntonioZC666Created Jan 7, 2024Updated Oct 16, 2024
Hello, I'm trying to use FlexGen. I would like to know if I can run the project with a model that I have already downloaded? I'm using the case command line
python3 -m flexgen.flex_opt --model facebook/opt-1.3b
and it automatically downloads the model from Huggingface, but I've already downloaded it myself in advance. I tried using other parameter such as '--path' and adding the file path where my model is located, but it didn't work.
I just want to use a model that I've already downloaded, how should I do that?
Source: FMInference/FlexLLMGen