Regularization might give better solutions, but it’s no more optimizing the stated objective, and often runs counter. In some cases, regularization is explicit and by choice, but it’s also often implicit and not under control.
You say that it gets a "better" solution, so the against some indescribable original objective there's a difference.