Senior Data Engineer
Role details
Job location
Tech stack
Job description
-
Solve complex data problems to deliver insights that helps the organization's business to achieve their goals .
-
Create data products for analytics and data scientist team members to improve their productivity .
-
Mentor and coach other data and analytic professionals on data standards and practices
-
Foster a culture of sharing, re-use, design for scale stability, and operational efficiency of data and analytical solutions .
-
Lead the evaluation, implementation and deployment of emerging tools and process for analytic data engineering in order to improve the organization's productivity as a team .
-
Develop and deliver communication and education plans on analytic data engineering capabilities, standards, and processes .
-
Partner with business analysts and solutions architects to develop technical architectures for strategic enterprise projects and initiatives.
-
Learn about machine learning, data science, computer vision, artificial intelligence, statistics, and/or applied mathematics
-
Ensure timely analysis and testing for regular maintenance of solutions over time
Requirements
-
Post graduate degree in STEM field with 3-5 years of experience as Sr/Lead Data Engineer
-
Expertise in SQL and data analysis and experience with at least one programming language (Python or Scala preferred)
-
Experience developing and maintaining data lakes or lake-houses platforms.
-
Experience with developing solutions on cloud computing services and infrastructure in the data and analytics space using streaming and CDC pipelines
-
Strong Datalake/DW development experience using Cloud MPP engines (BigQuery preferred) and experience with a variety of relational, NoSQL, and cloud database technologies.
-
Conceptual knowledge of data and analytics, such as dimensional modeling, ETL, reporting tools, data governance, data warehousing, structured and unstructured data.
-
Data Engineering experience using GCP portfolio (Big query, DataStream, DataProc, DataPlex and DataForm)
-
Familiarity with the Linux operating system
-
Passionate about Agile software processes, data-driven development, reliability, and experimentation
-
Experience working on a collaborative Agile product team.
-
Self-motivated with strong problem-solving and learning skills .
-
Flexibility to change in work direction as the project develops .
-
Excellent communication, listening, and influencing skills.
-
Demonstrated strong number sense, intellectually curious and willing to adjust position based on additional information.
-
Strong work ethic; ability to work at an abstract level and gain consensus