bug: duplicate -m CLI flag, RESOURCE_EXCLUSTIONS typo, no URL deduplication, no crawl timing
Author: VaishnavGunjariCreated Mar 10, 2026Updated Mar 10, 2026
Bugs Found
1. Duplicate -m short flag in CLI (src/cli.ts)
Both --match and --maxPagesToCrawl are registered with the same -m shorthand, causing silent option shadowing — --maxPagesToCrawl is effectively unreachable via short flag.
// Both use -m ❌
.option("-m, --match <string>", ...)
.option("-m, --maxPagesToCrawl <number>", ...)
NOTE : Fix : Change --maxPagesToCrawl short flag to -n.
Source: BuilderIO/gpt-crawler