tnspacetime

Ok nice find! Did you try it?

This seems nice but I’ll need to read the syntax more carefully to see how capable and convenient it is.

The point about semantic diff viewer sounds very interesting. I think many coding harnesses are not doing this well enough.

If you need any background info on Jev read this:

https://software.human-tokens.dev/

I have not studied it properly too. Good that it has both code and note though.

I think as an experiment your setup is interesting. But in realistic systems even standard evals, i.e. making sure things work well for normal use cases, are already enormous, let alone thinking about catastrophic forgetting.

Yes I read that one, and that’s why I said the explanation is not clear. Anyway, catastrophic forgetting is theoretically not possible. “ Existing capability must substantially learn new information, so its representation must change, while retaining its still-valid old knowledge”. I think your setup is demonstrating something weaker.

This is sort of clever! It seems to me though you can almost design a small dsl and you don’t need ai at all.

I read your github page and there's mention of continual learning but no argument how catastrophic forgetting is avoided. I think you should explain that better.