xsv fixlengths never finishes on some input
Author: seamusabshereCreated Feb 2, 2023Updated Mar 5, 2025
$ xsv stats bad.csv
CSV error: record 1501690 (line: 1501690, byte: 419783925): found record with 39 fields, but the previous record has 38 fields
$ csvclean bad.csv > fixed.csv
CSV contains fields longer than maximum length of 131072 characters. Try raising the maximum with the field_size_limit parameter, or try setting quoting=csv.QUOTE_NONE.
$ xsv fixlengths bad.csv > fixed.csv
^Cxsv fixlengths never finishes
(csvclean is from https://csvkit.readthedocs.io/en/1.1.0/scripts/csvclean.html)
Source: BurntSushi/xsv