I could imagine having the build date embedded into the binary can be helpful, similarly other metadata is probably useful as well.
Removing this information what makes reproducible builds reproducible.
If you want bit-by-bit reproduction, you can't have that metadata inside your final artifact.