Exactly, agreed.
Antoine de Saint-exupéry had a similar way to put it: "It's the time you wasted on your rose that makes your rose so important"
I don't know why he chose that word, but I love that choice "waste" (perdre in original French). So telling.