Hacker News Reader

>However, they did not publish any details on their training data.

Yes they did. It's in the README.

All I can see is “ 1.7 TB of online texts, books, and countless other sources in both English and Russian.”

if there are more details, can you please share a link?

I am worried that “other sources” may contain Yandex.news which is a cesspool of anti-West and anti-Ukraine propaganda

The pile dataset is used for the English language