There is one already:
https://arxiv.org/abs/2305.07759
https://huggingface.co/datasets/roneneldan/TinyStories
6.5GB of tiny stories, as requested. ;)
6.5GB of tiny stories, as requested. ;)
The best opening I got from my own TinyStories trained model was.
Once upon a time, in a small town, there was a large town.
Which I just love as an evocative idea.
So to LLM-generate 6.5GB of tiny stories is quite a permutation in action :)