LiteLLM unnecessary memory usage when only trying to use paper metadata features

Hello! I am attempting to only use paper metadata lookup - but PaperQA imports LMI / LiteLLM no matter what, incurring a ~100MB memory penalty. It's imported in init.py even when I only have from paperqa.clients import DocMetadataClient

Is there a way around this? Maybe scoping imports a little tighter.