> We show that NN loss landscapes contain effectively only a single basin(!) provided sufficient width. Even better, we develop practical algos to navigate these basins...
Supporting twitter thread:
https://twitter.com/SamuelAinsworth/status/15697194946455265...
Paper: