Really cool to see more tooling making self-supervised learning usable on real-world datasets. Domain shift is a recurring pain, especially when labels are limited—so being able to pretrain directly on unlabeled data is a big deal. Also great to see it open-sourced under AGPL.
Have you tried LightlyTrain on any more niche domains, like satellite or industrial inspection data? Would be interesting to see how it performs outside the usual benchmarks. Nice work!