top | item 37122238

(no title)

maxFlow | 2 years ago

> It would be useful to give more clarity around your thoughts on the "Data Engineer" role. Is it also in decline? Is the market as a whole in a relative decline?

My thoughts: the tech job market as a whole has been in decline, as unanimously observed. There may be some signs that the slowdown is abating though. Next 6-12 months will be key to see how DS and DE rebound (or not).

> Most businesses' data engineering needs have been solved or will shortly be solved by managed services that 10 years ago would require endless and extensive self-built ETL pipelines, databases and tools. For the exceeding majority of businesses, this means they can and should focus on building capacity for business logic, analysis and predictions instead of data engineering.

Could not disagree more with your take of "DE demand will decline due to DE needs being already solved for most businesses". Apologies, but have you ever worked as a data engineer or even close to one? Pipelines break, requirements change, businesses expand, and infrastructure needs to be managed and optimized, etc. ETL processes, in the wild, are decidedly not one-off affairs.

discuss

order

sails|2 years ago

The evidence points to demand for data engineers declining on a relative basis to other data roles, following the data science trajectory. Agree or disagree?

Maybe the analysis as to _why_ is wrong, but that is what I'm trying to unpack.

HN Guidelines: "When disagreeing, please reply to the argument instead of calling names"

nerdponx|2 years ago

Anecdotally, DE demand has increased relative to DS as companies realize they need DEs and not DSes.

naijaboiler|2 years ago

Currently demand for DEs outstrip DS