There were a ton of firmware issues earlier. They have been (mostly) ironed out now. It was baffling when SP4 launched with so many issues. You'd expect that they would have learnt a lot from fixing the issues on SP3.
OT: Let's see how they fare with the SP5. I hope they upgrade the Surface 3 this time.