Data Engineer
Role details
Job location
Tech stack
Job description
The Data Engineer is responsible for designing, building, and maintaining scalable data pipelines and infrastructure to support enterprise analytics, reporting, and AI initiatives. This role ensures the availability, quality, and reliability of data by integrating diverse sources into secure and optimized data platforms. Working closely with data scientists, analysts, and business stakeholders, the Data Engineer enables data-driven decision-making across the organization., * Develop and operate data management tools, monitoring data flows, data quality, data cleansing and data processing.
- Create and document logical data integration (ETL) strategies for data flows between disparate systems and the enterprise data warehouse/data lakes.
- Collaborate with different stakeholders (engineers, data owners) to collect required data from internal and external systems.
- Work in an Agile environment that focuses on collaboration and teamwork.
- Improve and extend existing data infrastructure services.
- Monitor production job schedule and correct job failures in a timely manner.
Requirements
Education/Experience/Background:
- MS degree in Computer Science or computer related field from an accredited institution.
- 3+ years hands proven experience as a Data Engineer or similar role.
Knowledge/Skills/Abilities:
Skills:
- More than 2 years of experience developing with Python.
- 1+ year performing with production environments in a DevOps culture managing code composed of multi-developer teams, following industry best practices.
- 2+ years SQL development experience.
- 1+ year experience with data modeling
- 1+ year bash scripting experience.
- 1+ year experience with Git, CI/CD (preferably GitLab) and Docker.
- 2+ years experience deploying and running services in Cloud Big Data platforms such as BigQuery and Snowflake.
- 1+ year experience with DAG workflows orchestration such as Apache Airflow, Prefect.
- Experience with designing and building data pipelines using tools like Apache Beam, CDAP (Data fusion).
- 1+ year experience with CDC design patterns and their challenges.
- Experience with NoSQL databases is a plus (i.e Firestore, MongoDB).
- Experience designing and developing APIs is a plus (i.e using FastAPI, Flask)
Abilities:
- Embrace mentorship through design sessions, code reviews, and community building.
- Take ownership and support solutions you develop.
- Value collaboration with other members of the team.
- Have a product mindset.
- Good communication.
Benefits & conditions
Pay Range: $169,541 to $175,000 Per Year.
Benefits: Veolia's comprehensive benefits package includes paid time off policies, as well as health, dental, vision, life insurance, savings accounts, tuition reimbursement, paid volunteering and more. In addition, employees are also entitled to participate in an employer sponsored 401(k) plan, to save for retirement.
Sick leave - 56 hours; Observed Holidays - 11 days; Vacation - Flexible Time Off
Eligible for up to 10% Annual Performance Bonus