bug: duplicate -m CLI flag, RESOURCE_EXCLUSTIONS typo, no URL deduplication, no crawl timing

Author: VaishnavGunjariCreated Mar 10, 2026Updated Mar 10, 2026

Bugs Found

1. Duplicate -m short flag in CLI (src/cli.ts)

Both --match and --maxPagesToCrawl are registered with the same -m shorthand, causing silent option shadowing — --maxPagesToCrawl is effectively unreachable via short flag.

// Both use -m ❌
.option("-m, --match <string>", ...)
.option("-m, --maxPagesToCrawl <number>", ...)

NOTE : Fix : Change --maxPagesToCrawl short flag to -n.