Data Engineer II
Role details
Job location
Tech stack
Job description
As the Data Engineer II, you will play a critical role in developing, transitioning and optimizing data transformations that enable efficient data processing and analysis. Your collaboration with internal and cross-functional teams will drive data-driven decision-making and contribute to the continuous improvement of our Lakehouse hosted on databricks.
Roles & Responsibilities:
- Work with large datasets, ensuring data quality, accuracy, and performance.
- Follow User Story requirements and acceptance criteria to deliver outcomes as defined by senior team members
- Leverage databricks SQL to curate and transform data as defined by project plan or user stories
- Follow data transformation, integration, and validation guidelines to support analytics and reporting needs.
- Optimize and fine-tune data pipelines for improved speed, reliability, and efficiency.
- Troubleshoot and resolve data-related issues, collaborating with the team to identify root causes.
- Document data processes, data lineage, and technical specifications for future reference.
- Participate in code reviews, ensuring adherence to coding standards and best practices.
- Collaborate with DevOps teams to automate deployment and monitoring of data pipelines.
Requirements
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
- 5+ years of experience in data engineering or a related field, with hands-on experience building and supporting modern data platforms using Databricks, Spark, SQL, and Python.
- Experience with SAP data collection, extraction, analysis, and ABAP development prefered.
Technical Qualification
- Proven experience in data engineering, including hands-on experience with Databricks and implementing scalable data solutions.
- Strong proficiency in ANSI SQL, Python, and/or Scala, with experience using Spark and Databricks SQL Warehouse/Lakehouse environments.
- Experience developing data products, analytical models, and model governance frameworks.
- Experience with data governance, including data quality, hygiene, anonymization, security, and responsible data management practices.
- Ability to analyze and modernize legacy ETL solutions, including SSIS packages, stored procedures, and database views.
- Strong problem-solving skills with the ability to navigate complex Microsoft data environments.
- Experience working in Agile environments using Azure DevOps (Microsoft DevOps).
Business & Professional Skills
- Excellent communication and collaboration skills, with the ability to partner effectively with both technical and non-technical stakeholders.
- Strong business acumen with experience supporting manufacturing or industrial organizations preferred.
- Ability to balance strategic, long-term architecture with near-term business priorities.
- Passion for leveraging data and analytics to drive business outcomes.
Target Hiring Range Annual Salary: USD 103,040.00 - USD 136,013.00
Benefits & conditions
Actual compensation is commensurate with experience, skills and education. CoorsTek strives to give all qualified applicants equal opportunity and to make selection decisions on job related factors. Do not provide any information on the application which will indicate your race, color, religion, national origin, sex, age, disability, sexual orientation, gender identity, pregnancy, genetic information, veteran status, or any other status protected by law or regulation.