Yes. Also I imagine it's easy to "bulldoze and start over" when there are fewer life-worn paths to start with.
Even if adults could regenerate large numbers of neurons like we do skin cells, those new neurons would have no idea how the old ones were connected.