Hacker News Reader

nawazgafaron From text to token: How tokenization pipelines work

You beat me to the punch. I wrote a blog post[1] with the exact same title last week! Though, I went into a bit more detail with regard to embedding layers, so maybe my title is not accurate.

1. https://gafar.org/blog/text-to-tokens

nawazgafaron Llama-Scan: Convert PDFs to Text W Local LLMs

Author here, that sucks. I'd love to recreate this locally. Would you be willing to share the PDF?

nawazgafaron Llama-Scan: Convert PDFs to Text W Local LLMs

Author here, I tested it with this PDF of a handwritten doc [1], and it converted both pages accurately.

1. https://github.com/pnshiralkar/text-to-handwriting/blob/mast...

nawazgafaron Llama-Scan: Convert PDFs to Text W Local LLMs

Glad to hear it! What types of symbols did it miss?

nawazgafaron Llama-Scan: Convert PDFs to Text W Local LLMs

Will do!

nawazgafaron Show HN: Build your own isometric city

This is super cool, and really intuitive.

Not going to lie, I've put a few hundred hours into playing Cities:Skylines and have never finished a city. One night with this and I've actually made something I'm proud of.

Check my city out!: https://i.imgur.com/10nCtrO.png