Error while split the model name
Author: neomi-tenenbaum-huaweiCreated Mar 26, 2024Updated Mar 26, 2024
on file: flexgen/opt_config.py on func get_opt_config (~line 54) name = name.split("/")[1] if the model name is "foder_name/folder_name1/opt-125m" the code will return "folder_name1" you have to change the code to: name = name.split("/")[-1]
Source: FMInference/FlexLLMGen