Every part of the "build and use ML in production" workflow is horrible (unless maybe you work at Google).
Firstly, the Datascience workflow is NOT the same as software engineering. Things like version control tools don't work properly (in every part: git on Jupyter notebooks doesn't work without hacks, versioning data is horrible, versioning models is horrible).
Deployment is horrible. Sagemaker (and equivalents) provide the very base level of functionality needed, but are so separated from the feature engineering side that everyone ends up doing vast amounts of work to get something useful.
Frameworks are horrible. TensorFlow did the upgrade to TF2, so half the examples on the web don't work anymore. The TF data loading abstractions are great - if you work at Google but so complicated to get basic examples going.
PyTorch has a horrible deployment story.
Every other frame work are either experimental research things and take months to make progress (JAX) or are so far behind modern work they are useless (MXNet).
But the thing is dealing with all these issues is worth it because ultimately it does actually work.