FileContentReaderTool hangs when reading very large directories
Author: fieryWatersCreated Feb 19, 2025Updated Feb 19, 2025
I'm working on a project with ~800MB of .txt files in a data directory. When instructing CE3 to inspect the data folder, the process hangs while generating GB's of swap data with no end. I think it tries to dump all 800MB of .txt files into the context, and the process hangs even if you try to print the resulting data due to its size. A simple check might be to set a threshold for the number of files in a subfolder and only read say the top 30 of each file type.
If you want, I can try to make a pull request to fix the bug. Thanks.
Source: Doriandarko/claude-engineer