A word that search cannot find, a number a spreadsheet will not add up, a line of code that fails though it looks fine: hidden characters copied from web pages, PDFs and chat apps are a common cause.
The usual suspects
Zero-width space (U+200B) is a line-break hint with no width. The byte order mark (U+FEFF) often sits at the start of a file. A soft hyphen (U+00AD) only shows when a word breaks. The no-break space (U+00A0) looks like a space but is a different character, so "100 kg" with one does not match "100 kg" with a normal space.
What to keep
The zero-width non-joiner (U+200C) stops two letters from joining and is part of correct Persian spelling. The zero-width joiner (U+200D) glues emoji such as the family emoji into one picture. Deleting them breaks text, so the tool keeps both and tells you how many it found.
Symptoms and causes
Worked example 1: a search that fails
A name copied from a web page will not match in your database. The report shows "U+200B (zero width space) x1": remove it and the match works.
Worked example 2: a spreadsheet number
"1 250" from a PDF will not sum. It contains U+202F, a narrow no-break space. The tool turns it into a normal space; then remove the space in the sheet or use Find and Replace.
Worked example 3: Persian text
Text such as کتابها uses U+200C between the parts. It is kept, so the word still displays correctly.
What the ZYSNOR tool does
- Removes zero-width space, BOM, soft hyphen, direction marks and tag characters.
- Turns no-break and typographic spaces into normal spaces.
- Keeps ZWNJ and ZWJ; optional straight quotes.
- Reports every character by code point and count. Runs in your browser.
Practice problems
Problem 1. Should a remover delete U+200D in 👨👩👧?
Show the worked answer
No. It joins the three people into one family emoji.
Problem 2. "HelloWorld" contains U+200B. What do you get?
Show the worked answer
HelloWorld: a zero-width space has no width, so nothing replaces it.
Ready to try it? The free tool works in your browser, and the button in the page header takes you straight to it.