TE
科技回声
首页24小时热榜最新最佳问答展示工作
GitHubTwitter
首页

科技回声

基于 Next.js 构建的科技新闻平台,提供全球科技新闻和讨论内容。

GitHubTwitter

首页

首页最新最佳问答展示工作

资源链接

HackerNews API原版 HackerNewsNext.js

© 2025 科技回声. 版权所有。

Ask HN: How do I become a Data Engineer

7 点作者 josep2超过 9 年前
I worked doing analytics for a while (Machine Learning with Python and R and ETL style work). I transitioned to software development (Backend Engineer Working with a combination of Scala and Node.js).<p>[Insight](http:&#x2F;&#x2F;insightdataengineering.com&#x2F;blog&#x2F;Data_Science_vs_Data_Engineering.html) has this description:<p>&quot;A good data engineer is has extensive knowledge on databases and best engineering practices. These include handling and logging errors, monitoring the system, building human-fault-tolerant pipelines, understanding what is necessary to scale up, addressing continuous integration, knowledge of database administration, maintaining data cleaning, and ensuring a deterministic pipeline.&quot;<p>I find that most courses and resources (off and online) are aimed at Data Science. Just looking for advice on how to gain the skills needed to build an impressive Data Engineer style portfolio.

1 comment

lgieron超过 9 年前
Just get hired for a team using Hadoop or Spark, and preferably doing some real-time processing (you might need to study these frameworks in your own time to be able to get such job).<p>On such team, you&#x27;ll be exposed to all of the concepts you&#x27;ve listed.
评论 #10498419 未加载