are there some review papers you would recommend to get an overview over weight space interpretability research?
(can be as maths heavy as possible/necessary to understand the topic)
(can be as maths heavy as possible/necessary to understand the topic)
Also check out Tracr: https://deepmind.google/research/publications/22295/ Here they attempt to compile static programs into weights.
This is less of an overview but I remember reading this before, from the larger collection of posts: https://sidn.baulab.info/david_atkinson_project/