Data Engineer

Horizontal Talent
Rochester, United States of America
2 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Rochester, United States of America

Tech stack

Java
Airflow
Azure
Continuous Integration
Information Engineering
Data Integrity
ETL
Data Systems
Python
Cloud Services
SQL Databases
Google Cloud Platform
Azure
GIT
Software Version Control
Data Pipelines
Programming Languages

Job description

Join our team as a Senior Data Engineer, where you'll lead the design and operation of robust data pipelines across cloud platforms, ensuring secure and efficient data solutions in a dynamic healthcare environment. Responsibilities

  • Design and implement scalable data pipelines on cloud platforms like Google Cloud Platform and Azure.
  • Optimize data models for analytics and reporting, ensuring data integrity and performance.
  • Manage workflow orchestration using tools such as Airflow and Azure Data Factory.
  • Ensure compliance with data security standards, including HIPAA, for handling sensitive information.
  • Collaborate with stakeholders to translate business needs into technical solutions.
  • Monitor and enhance the performance and reliability of data pipelines.

Requirements

  • Extensive experience in data engineering with a focus on enterprise-scale solutions.
  • Proficiency in SQL and programming languages like Python or Java.
  • Hands-on experience with cloud data platforms, including Google Cloud Platform and Azure.
  • Strong understanding of ETL/ELT processes and data modeling techniques.
  • Knowledge of CI/CD deployment processes and version control systems like Git.

Preferred Skills

  • Experience with healthcare data management and understanding of PHI handling.
  • Familiarity with additional workflow orchestration tools such as Dagster or Prefect.
  • Ability to communicate complex technical concepts to non-technical stakeholders.

At Horizontal, we are committed to fostering a diverse and inclusive workplace where all individuals are valued and empowered to succeed. We believe that diversity drives innovation and are dedicated to creating an environment that reflects the diverse communities we serve.

Apply for this position