Hacker News Reader

Sorry for the dumb question, but is there any useful non-trivial LLM that is open-source where you could bit reproducibly train it from sources?

Yes, quite a bit, but you can lookup OlMo from allen.ai for starts