From Prompt to Adventures:Creating Games with LLMs and Restate Durable Functions

I've experimented with a very similar flow back in the days of GPT3.5. It resulted in really fun story lines, but i found that the player choices benefitted from some steering: For each plot point i generated three choices, where [1] progressed the story, [2] stalled the plot and [3] resulted in a plot twist, just these additions to the choice prompts increased playability by a lot, and prevented plot stagnation and "feedback loops".

I think the intersection of games and LLMs is the way to solve alignment. Imagine a 3D UI for an LLM, this way we can democratize interpretability research.

Basically to train another model, that will take the LLM and convert it into 3D shapes and put them in some 3D world that is understandable for humans.

Simpler example: represent an LLM as a green field with objects, where humans are the only agents:

You stand near a monkey, see chewing mouth nearby, go there (your prompt now is “monkey chews”), close by you see an arrow pointing at a banana, father away an arrow points at an apple, very far away at the horizon an arrow points at a tire (monkeys rarely chew tires).

So things close by are more likely tokens, things far away are less likely, you see all of them at once (maybe you’re on top of a hill to see farther). This way we can make a form of static place AI, where humans are the only agents

Who else is making games with LLMs? Is there a good round up anywhere?

This is really cool! When you get a restate instance, does that just handle the durable execution journal / orchestration, or can you run code in the instance as well?

This is a very thoughtful and well engineered solution that I think unfortunately removes one of the main advantages of choose your own adventures with an LLM -- that you can just tell them you don't like their choices and want to do something completely different.

If author is here you should remove any mentions of "ch00se your 0wn adventure" and also it's 4 letter acronym. The trademark owner goes very aggressively after it. Use user generated adventures or something similar.