Data Engineer
Role details
Job location
Tech stack
Job description
decision-making capabilities of the organization's enterprise. Responsibilities Solve complex data problems to deliver insights that helps the organization's business to achieve their goals. Create data products for analytics and data scientist team members to improve their productivity. Mentor and coach other data and analytic professionals on data standards and practices Foster a culture of sharing, re-use, design for scale stability, and operational efficiency of data and analytical solutions. Lead the evaluation, implementation and deployment of emerging tools and process for analytic data engineering in order to improve the organization's productivity as a team. Develop and deliver communication and education plans on analytic data engineering capabilities, standards, and processes. Partner with business analysts and solutions architects to develop technical architectures for strategic enterprise projects and initiatives. Learn about machine learning, data science, computer vision
Requirements
artificial intelligence, statistics, and/or applied mathematics Ensure timely analysis and testing for regular maintenance of solutions over time Requirements Post graduate degree in STEM field with 3-5 years of experience as Sr/Lead Data Engineer Expertise in SQL and data analysis and experience with at least one programming language (Python or Scala preferred) Experience developing and maintaining data lakes or lake-houses platforms. Experience with developing solutions on cloud computing services and infrastructure in the data and analytics space using streaming and CDC pipelines Strong Datalake/DW development experience using Cloud MPP engines (BigQuery preferred) and experience with a variety of relational, NoSQL, and cloud database technologies. Conceptual knowledge of data and analytics, such as dimensional modeling, ETL, reporting tools, data governance, data warehousing, structured and unstructured data. Data Engineering experience using GCP portfolio (Big query, DataStream, DataProc, DataPlex and DataForm) Familiarity with the Linux operating system Passionate about Agile software processes, data-driven development, reliability, and experimentation Experience working on a collaborative Agile product team. Self-motivated with strong problem-solving and learning skills. Flexibility to change in work direction as the project develops. Excellent communication, listening, and influencing skills. Demonstrated strong number sense, intellectually curious and willing to adjust position based on additional information. Strong work ethic; ability to work at an abstract level and gain consensus