The problem with bad/unsafe replacement batteries is that Apple intentionally makes it impossible to obtain an original battery.
If you could just walk into an Apple store and buy the original, Apple-endorsed battery at a fair price there would be no reason to go with third-party (and potentially unsafe) batteries.