Data Engineer

Horizontal Talent
East Bethel, United States
25 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Starter
Experience required
1 year minimum
Compensation
$85,280.0 - $162,240.0
Working hours
Regular working hours
Job source

Tech stack

Airflow Data Analysis Big Data Databases Data Architecture Data Validation Extract Transform Load (ETL) Data Structures Apache Hadoop Issue Tracking Systems Python (Programming Language) Power BI
+12 more
Cloudera SAP (Applications) SQL Databases Data Processing Google Cloud Pyspark Data Lineage Data Analytics Google Bigquery Tools for Reporting Looker Analytics Data Pipelines

Job description

We are seeking a Data Engineer to support data validation, reconciliation, and reporting for a finance data platform modernization initiative. This role focuses on identifying variances between legacy and modern systems, helping improve data quality, and supporting go-live readiness through clear analysis and collaboration across technical and business teams. Responsibilities

  • Build and run queries to compare legacy and modern datasets and identify data variances.
  • Create reports and dashboards to highlight discrepancies, trends, and reconciliation results.
  • Support source-to-target reconciliation, duplicate detection, control total checks, and business rule validation.
  • Analyze mapping documents, reporting requirements, transformation logic, and data lineage to support validation efforts.
  • Document variances, root causes, exception findings, defect logs, and sign-off materials in partnership with stakeholders.
  • Collaborate with product, engineering, finance, business, and legacy system teams to resolve issues and support go-live decisions.
  • Assist with determining tolerance thresholds and readiness for parallel operations and production launch.
  • Contribute to iterative delivery in an agile environment, including sprint ceremonies and defect triage.

Requirements

  • 5+ years of hands-on SQL experience with big data platforms or databases such as Google BigQuery, Hadoop, or similar tools.
  • Strong background in ETL and data pipeline tools such as Dataproc, Airflow, Dataform, dbt, or comparable technologies.
  • Experience using Python and/or PySpark for data movement, analysis, and validation.
  • Proven experience in data analysis, data quality validation, and reconciliation across systems.
  • Ability to work with visualization and reporting tools such as Power BI, Looker, or LookML.
  • Strong communication and collaboration skills with the ability to work across technical and business teams.
  • Experience creating documentation that supports validation, issue tracking, and business approvals.
  • 5+ years working in a data analytics role.
  • 1-3 years of experience working on agile teams.

Preferred Skills

  • Experience in the retail industry, especially across finance, supply chain, merchandising, inventory, stores, sales, digital, product, or customer domains.
  • Familiarity with Google Cloud medallion data architecture and Google Cloud Platform-supported data processing tools.
  • Experience with SAP S/4 data structures and finance reporting.
  • Background supporting dashboard development, KPI reconciliation, and semantic layer validation.
  • Experience working in a modern data platform migration or parallel run environment.
  • Comfort working in a fast-paced, collaborative setting with evolving priorities.

Horizontal is committed to creating an inclusive environment where diverse perspectives are valued and everyone has the opportunity to thrive. We welcome candidates from all backgrounds and are dedicated to equity, belonging, and respect throughout the hiring process.

Benefits & conditions

Please apply through this online posting or by visiting our Job Board at Applications will be accepted for 4 weeks. For those that join the team, we offer competitive compensation and benefits including medical, dental, vision, and retirement. Check out all we have to offer and how you can become part of the Horizontal Talent Team. The pay range for this role is $41 - $78 per hour based on qualifications and experience.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon Sandhya Menon · WWC Europe 2026

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

3:05 min

Audience questions on AI agents and pipeline vectorization

Joy Joy · WWC 2024

3:37 min

Scaling machine learning pipelines from prototypes to petabytes

Julian Joseph · LIVE

1:34 min

Bringing diverse skills to industrial data science roles

Katja Träumner

Videos

See all

Related articles

See all