Data Engineer

Horizontal Talent
Rochester, United States of America
2 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Intermediate

Job location

Rochester, United States of America

Tech stack

Business Analytics Applications
Data analysis
Azure
Data Architecture
Data Cleansing
Information Engineering
Data Governance
Data Infrastructure
Data Integration
ETL
Data Transformation
Data Security
Data Systems
DevOps
Document-Oriented Databases
Python
Role-Based Access Control
Power BI
Standard Sql
SQL Databases
Data Streaming
Data Storage Technologies
Data Ingestion
GIT
Microsoft Fabric
Data Lake
Data Lineage
Real Time Data
Data Management
Data Pipelines

Job description

We are seeking a Data Engineer to design, build, and support scalable data pipelines and data platform solutions that enable enterprise reporting, analytics, and business intelligence initiatives. This role will focus on data ingestion, transformation, quality, lineage, and governance, ensuring trusted and reliable data is available for downstream consumers. The ideal candidate is a hands-on engineer with strong SQL and Python skills who thrives in a collaborative environment and is passionate about building well-governed, high-quality data solutions., * Design, develop, and maintain scalable ETL/ELT pipelines to support enterprise data and analytics initiatives.

  • Build and optimize data ingestion and transformation processes for structured and semi-structured data sources.
  • Implement data cleansing, shaping, aggregation, and enrichment processes to prepare data for reporting and analytical use cases.
  • Support and maintain modern data platform architectures, including Delta Lake and Medallion (Bronze, Silver, Gold) data models.
  • Ensure data quality, consistency, and reliability through validation, monitoring, and troubleshooting processes.
  • Maintain and document data lineage, enabling traceability from source systems through downstream reporting and analytics solutions.
  • Collaborate with BI, analytics, governance, and business teams to understand data requirements and deliver trusted datasets.
  • Support reporting and dashboard solutions, with a preference for experience working with Power BI environments.
  • Implement and maintain data security controls, including role-based access control (RBAC) and governance standards.
  • Participate in platform improvements, automation initiatives, and best practice development for data engineering processes.

Requirements

  • 3-5+ years of experience in Data Engineering or a related field.
  • Proven experience designing, building, and supporting scalable data pipelines and data platforms.
  • Strong proficiency in SQL and Python.
  • Hands-on experience with ETL/ELT development and data integration frameworks.
  • Strong understanding of modern data architecture concepts, including:
  • Delta Lake and modern data storage formats
  • Medallion Architecture (Bronze, Silver, Gold layers)
  • Data transformation and preparation techniques
  • Data lineage and traceability
  • Data quality and governance principles
  • Experience supporting reporting and analytics platforms, preferably Power BI.
  • Familiarity with data security concepts and role-based access control (RBAC).
  • Strong troubleshooting and root-cause analysis skills.
  • Preferred Qualifications
  • Experience with Microsoft Fabric.
  • Familiarity with data catalog and lineage tools such as Purview or similar platforms.
  • Experience with CI/CD pipelines and DevOps practices using Azure DevOps, Git, or similar tools.
  • Exposure to streaming data platforms or real-time data ingestion patterns.
  • Experience working within enterprise data governance programs.

Apply for this position