Data Engineer

Corporate Brokers, LLC
Albuquerque, United States of America
2 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Remote
Albuquerque, United States of America

Tech stack

Airflow
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Business Analytics Applications
Data analysis
Big Data
Unix
Catalyst
Information Engineering
Data Infrastructure
ETL
Data Transformation
Data Security
Data Warehousing
IBM DB2
Database Queries
IBM InfoSphere DataStage
DevOps
Disaster Recovery
Identity and Access Management
Knowledge Management
Microsoft SQL Server
Oracle Applications
Performance Tuning
Query Optimization
Runbook
SAS (Software)
SQL Stored Procedures
SQL Databases
Data Streaming
Tableau
Enterprise Data Management
Fast Healthcare Interoperability Resources
System Availability
Spark
Sap Business Objects
Data Lake
Information Technology
Collibra
Amazon Web Services (AWS)
Data Analytics
Health Level Seven International
Integration Frameworks
Amazon Web Services (AWS)
Hardware Infrastructure
Cloud Migration
ServiceNow

Job description

Long-term contract with a Big 4 consulting firm supporting a hospital and healthcare system engagement Remote: Working MST Hours Travel: Once a month to client site in Albuquerque, NM, The Data Engineer is responsible for the development, maintenance, and operational support of enterprise data pipelines, ETL processes, and data platform components within the Data & Analytics Managed Services. The Data Engineer is accountable for the reliability, performance, and evolution of enterprise data pipelines, ensuring the organization transitions from foundational stabilization toward a modern, cloud-native data platform. This individual sets the technical direction, drives delivery excellence, and represents the data engineering function at the leadership level. Working across a complex environment of stored procedures, scheduled and streaming jobs, and a recently AWS-migrated data platform, this role ensures reliable, high-quality data flows that power enterprise reporting, analytics, and decision-making across clinical, operational, financial, and health plan domains., * Develop, maintain, and optimize SQL-based ETL processes, stored procedures, and data transformations across DB2, SQL Server, Datastage, Collibra and AWS

  • Define the enterprise data engineering architecture and technology standards across DB2, SQL Server, IBM DataStage, IBM Workload Scheduler, Oracle GoldenGate, Collibra and AWS
  • Develop and maintain data integration workflows from source systems to analytics platforms, including validation and reconciliation logic
  • Build and maintain data pipelines using IBM DataStage and UNIX scripting for enterprise data integration workflows
  • Govern platform health including capacity planning, performance benchmarks, upgrade management, and disaster recovery compliance with BCP/DR standards
  • Lead workload rationalization - identifying pipelines, stored procedures, and jobs for consolidation, retirement, or re-architecture
  • Evaluate and drive adoption of modern data engineering capabilities (Apache Airflow, dbt, AWS Glue, Spark) aligned to Project Catalyst objectives
  • Monitor pipeline health proactively, detect anomalies, and resolve data quality and availability issues within defined SLAs
  • Support Dev/QA/Prod environment management including release coordination and production readiness validation
  • Assist with AWS stabilization activities for analytics data layers post migration from on-premises infrastructure
  • Track and manage all work through ServiceNow, ensuring accurate classification, status updates, and SLA compliance
  • Collaborate with Tableau, SAS and BusinessObjects developers to ensure data availability and pipeline reliability for reporting
  • Participate in L1/L2 triage for pipeline incidents, data quality failures, and integration issues
  • Contribute to runbook documentation and standard operating procedures for supported pipelines and jobs
  • Collaborate with cross-functional teams, including data engineers, data scientists, and business analysts, to deliver end-to-end solutions across client domains
  • Own SLA and KPI adherence across all data engineering queues - incidents, service requests, small-ticket enhancements, and larger backlog-driven work
  • Lead root cause analysis (RCA) for critical data incidents and drive permanent fixes to prevent recurrence
  • Maintain full backlog visibility in ServiceNow - classification, aging, capacity tracking, and executive-level reporting
  • Define and oversee data quality monitoring frameworks, escalation procedures, and continuous improvement programs
  • Own CSAT measurement and improvement for the data engineering domain, proactively addressing data trust and availability concerns
  • Deliver weekly operational and monthly executive reporting on pipeline health, throughput, SLA performance, and platform KPIs
  • Identify and implement automation opportunities to reduce manual pipeline interventions, dataset refreshes, and extract requests
  • Lead knowledge management across the engineering team - runbooks, architecture diagrams, onboarding playbooks, and continuity documentation
  • Oversee end-to-end delivery of managed data analytics services to clients, ensuring projects meet business requirements, timelines, and quality standards
  • Manage client escalations and ensure timely resolution of issues.

Requirements

  • Minimum Degree Required: Bachelor's Degree in Engineering, Statistics, Mathematics, Computer Science, Data Science, Economics, or a related quantitative field
  • 8+ years of data engineering experience with deep expertise in enterprise ETL/ELT architecture, pipeline design, and large-scale data platform operations
  • Expert-level SQL proficiency in IBM DB2 and SQL Server including complex schema design, query optimization, and stored procedure management
  • Expert-level IBM DataStage experience including architecture, parallel job design, performance tuning, and enterprise deployment
  • Deep expertise in IBM Workload Scheduler - complex job stream design, dependency management, SLA configuration, and production operations
  • Advanced Oracle GoldenGate experience including replication architecture, CDC design, and production support
  • Proven AWS data engineering experience in production - S3, Glue, RDS, Redshift, Lambda, and IAM-governed data access
  • Demonstrated ability to develop and execute multi-year technology roadmaps and lead platform modernization programs
  • Experience leading managed services or outsourced delivery models with SLA, CSAT, and throughput accountability, * Healthcare data engineering experience across claims, clinical (HL7/FHIR), EMR, pharmacy, population health, or regulatory reporting domains
  • AWS certification - Data Engineer Professional, Solutions Architect Professional, or equivalent
  • Experience with modern data stack adoption in enterprise settings - Apache Airflow, dbt, Spark, Delta Lake, or equivalent
  • Knowledge of HIPAA, HITRUST, CMS, and healthcare data regulatory compliance requirements
  • Experience leading on-premises to cloud migrations for large-scale enterprise data platforms
  • Familiarity with Tableau, BusinessObjects, or SAS as downstream analytics consumers of engineered data
  • Background in agile delivery, DevOps practices, and CI/CD pipelines for data engineering

Apply for this position