This sparks a thought that I have not seen revisited in the LLM age - memristors [1].

[1] https://en.wikipedia.org/wiki/Memristor