Hacker News Reader

Comment by Ajedi32 | Hacker News Reader

Wow, that's actually pretty neat: https://www.google.com/search?q=site%3Anews.ycombinator.com%...

Anyone know if there are any existing libraries that do this conversion?

The ICU [1] transliterator does this. Here is an example showing how to use it:

    icu::ErrorCode status;
    auto t = icu::Transliterator::createInstance("Any-Latin; NFKD", UTRANS_FORWARD, status);
    t->transliterate("unicode string");

[1] http://site.icu-project.org/

Here's a test page for one.

http://minaret.info/test/normalize.msp

If you use c#:

"𝕙𝕖𝕝𝕝𝕠".Normalize(NormalizationForm.FormKC);

Look up Case Folding for how this is done, most languages have libraries to handle it.

Reply on news.ycombinator.com