Hey all,
After reading the TinyStories paper (using small language models of 1m to 33m parameter size to generate short stories), me and a friend decided to port it as a test to see what performance of tiny LMs look like on mobile devices. The stories it generates aren't great or anything, it's really just a toy tech demo to play with. We used HuggingFace's exporters library to do this.
You can try it out here: https://apps.apple.com/us/app/tinystories-on-device/id645149...
(we are not affiliated with MS research or the authors)