-
ilor authored
Handle BOM marks (ZERO WIDTH NO-BREAK SPACEs) as non-counted whitespace, add comments. Fixes seemingly "empty" token orths in output.
6f733cf9
Handle BOM marks (ZERO WIDTH NO-BREAK SPACEs) as non-counted whitespace, add comments. Fixes seemingly "empty" token orths in output.