as someone who’s been in the industry for 20 years, and worked in ML data engineering at twitch, i think you’re just using new words (some are tools but so what) to describe moving data around and making it accessible to people who need it.
Yeah - I've never been a "data engineer", but I've been doing this sort of shoveling for twenty years. We called it "ETL" and felt faintly foolish blogging about it.
i think ETL is the most timeless phrase because it's not tied to a trend. devops, data engineering, ML engineering, MLOps are all just lipstick on the pig.
Yes I've been an engineer for 15 years at a bunch of big companies. MLops isn't ML data engineering. I doubt data engineering has many changes outside of active learning.
again, i think these labels are useless. they just say you might understand the trendiest tool in the arena right now.
ML isn't about trendy tools, its a fundamentally different paradigm from deterministic programming that has a different skillset
maybe if you’re writing gradient descent, but not if you’re creating ETL pipelines.