Data Engineer
Horizontal Talent
Rochester, United States of America
2 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
SeniorJob location
Rochester, United States of America
Tech stack
Java
Airflow
Azure
Continuous Integration
Information Engineering
Data Integrity
ETL
Data Systems
Python
Cloud Services
SQL Databases
Google Cloud Platform
Azure
GIT
Software Version Control
Data Pipelines
Programming Languages
Job description
Join our team as a Senior Data Engineer, where you'll lead the design and operation of robust data pipelines across cloud platforms, ensuring secure and efficient data solutions in a dynamic healthcare environment. Responsibilities
- Design and implement scalable data pipelines on cloud platforms like Google Cloud Platform and Azure.
- Optimize data models for analytics and reporting, ensuring data integrity and performance.
- Manage workflow orchestration using tools such as Airflow and Azure Data Factory.
- Ensure compliance with data security standards, including HIPAA, for handling sensitive information.
- Collaborate with stakeholders to translate business needs into technical solutions.
- Monitor and enhance the performance and reliability of data pipelines.
Requirements
- Extensive experience in data engineering with a focus on enterprise-scale solutions.
- Proficiency in SQL and programming languages like Python or Java.
- Hands-on experience with cloud data platforms, including Google Cloud Platform and Azure.
- Strong understanding of ETL/ELT processes and data modeling techniques.
- Knowledge of CI/CD deployment processes and version control systems like Git.
Preferred Skills
- Experience with healthcare data management and understanding of PHI handling.
- Familiarity with additional workflow orchestration tools such as Dagster or Prefect.
- Ability to communicate complex technical concepts to non-technical stakeholders.
At Horizontal, we are committed to fostering a diverse and inclusive workplace where all individuals are valued and empowered to succeed. We believe that diversity drives innovation and are dedicated to creating an environment that reflects the diverse communities we serve.