Predictor.from_path using in memory file instead of disk
Author: smiles3983Created Apr 9, 2021Updated Dec 22, 2021
LabelsContributions welcome
We use openshift, and our enterprise sets limits on ephemeral storage. We need to be able to load a 1.4GB Model and all I see available is Predictor.from_path, which requires the model to be on disk before we can use it. They wont let us use something like S3FS at the moment, so we cant "mount" a network storage location. Is there a way we can take the model that we have loaded into memory as a binary file, and load it to the Predictor directly? We apparently have plenty of RAM to work with.
Source: allenai/allennlp