NotImplementedError: Loading a streaming dataset cached in a LocalFileSystem is not supported yet.
Author: jingli-wtboxCreated Dec 14, 2023Updated Dec 14, 2023
Error
when i run below command,
bash training/finetune_llama-2-7b-32k-mqa.sh
it will return errors:
NotImplementedError: Loading a streaming dataset cached in a LocalFileSystem is not supported yet.
How-to-Fix
re-install datasets old version: 2.13.0 (above error) new version: 2.15.0 (working)
Source: togethercomputer/OpenChatKit