The byproducts are sea salt. You might pay less for it at the store.
The environmental impacts come from having so much extra salt that there's nothing worth doing with it other than dumping it. Considering how tiny of a fraction Earth's freshwater (let alone that actually used by humans) represents of the total global water supply, the environmental concerns are arguably way overblown even in that worst-case scenario of "we literally can't find any better use of this salt other than dumping it back into the ocean whence it came".