There is I believe also a theory that suggests that the brain actively rewrites and combines/compresses memories to make them more useful. That also fits in well with this defragmentation concept.