If projects like this and DynamicLand interest you, it's worth checking out https://folk.computer/ - they've been working on this much more recently than DynamicLand and share their code as open source.