#1496·CoreNLP

Formatting issues with Stanford Segmenter (Chinese)

Author: WGroleauCreated Feb 5, 2026Updated Jun 28, 2026

(!) README says "filename: The file you want to segment. Each line is a sentence." It appears to work when each line is a paragraph—and it should. It should also work if a line is part of a sentence.

(2) With UTF-8, it replaces non-breaking space (U+00A0) with an ASCII space. It should not do that.

(3) It removes blank lines. It should not do that.