Lead Data Engineer

Infometry, Inc.
Raleigh, NC, United States
13 days ago

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
9 years minimum
Compensation
$145,600.0 - $149,760.0
Working hours
Regular working hours
Job source

Tech stack

Application Programming Interfaces (APIs) Amazon Web Services Data Analysis Automation of Tests Microsoft Azure Cloud Computing Code Review Continuous Integration Data as a Services Data Architecture Information Engineering Data Integration
+30 more
Extract Transform Load (ETL) Data Mart Data Masking Data Vault Modeling Data Warehousing Relational Databases Database Development Dimensional Modeling Python (Programming Language) Meta-Data Management Metadata Repositories Online Transaction Processing Performance Tuning Release Management Cloud Services Standard Sql Simple Data Format SQL Databases Enterprise Data Management Macros Snowflake Grafana Change Data Capture Git Data Layers Kubernetes Information Technology Data Management Software Version Control Data Pipelines

Job description

We are seeking an experienced Lead Data Engineer with strong expertise in Snowflake, dbt, Snowpipe, and enterprise data warehouse development. The ideal candidate will have hands-on experience designing and delivering scalable cloud data platforms using dbt Vault/dbtvault, particularly for file-based data sources and multiple OLTP systems., This role requires a strong combination of data architecture, engineering leadership, dimensional and Data Vault modeling, performance optimization, and production delivery experience. The Lead Data Engineer will work closely with architects, business stakeholders, analysts, and engineering teams to build reliable, governed, and high-performing enterprise data solutions., * Lead the design, development, and implementation of enterprise data warehouse solutions on Snowflake.

  • Build scalable ingestion and transformation pipelines using Snowpipe, Snowflake, dbt, SQL, and related cloud technologies.
  • Design and implement Raw Vault, Business Vault, and information delivery layers using dbtvault.
  • Integrate data from file-based sources, APIs, relational databases, and multiple OLTP applications.
  • Develop reusable dbt models, macros, tests, documentation, and deployment standards.
  • Design incremental data-loading patterns, change data capture processes, historization, and audit frameworks.
  • Implement automated data-quality checks, reconciliation controls, exception handling, and monitoring.
  • Optimize Snowflake warehouses, queries, storage, clustering, and workload configurations for performance and cost.
  • Translate business and analytical requirements into scalable data models and technical solutions.
  • Establish engineering standards for naming conventions, source control, code reviews, testing, and CI/CD.
  • Provide technical leadership, conduct design reviews, mentor developers, and support delivery planning.
  • Troubleshoot production issues involving data pipelines, transformation logic, data quality, and performance.
  • Collaborate with security and governance teams to implement role-based access, data masking, lineage, and compliance controls.

Requirements

Work Arrangement: Candidates must be able to work from one of the listed locations, * 9-10+ years of experience in data engineering, data warehousing, ETL/ELT, and enterprise data-platform delivery.

  • Strong hands-on experience with Snowflake architecture, SQL development, performance tuning, and administration concepts.
  • Advanced experience with dbt, including model development, macros, testing, documentation, packages, and deployment.
  • Proven experience implementing Data Vault 2.0 solutions using dbtvault or comparable frameworks.
  • Experience delivering an enterprise data warehouse using file-based data sources and multiple OLTP systems.
  • Strong experience with Snowpipe, stages, file formats, streams, tasks, and incremental ingestion patterns.
  • Strong understanding of Data Vault concepts, including hubs, links, satellites, hash keys, hash differences, effectivity, and historization.
  • Experience designing dimensional models, data marts, semantic layers, and analytical datasets.
  • Strong SQL, data-analysis, troubleshooting, and performance-optimization skills.
  • Experience with Git-based development, CI/CD pipelines, automated testing, and release management.
  • Ability to lead technical teams and communicate effectively with business and technology stakeholders.
  • Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related discipline.

Preferred Qualifications

  • Experience with AWS, Azure, or Google Cloud storage and data services.
  • Experience with Python, orchestration platforms, APIs, or event-driven data integration.
  • Familiarity with data catalogs, lineage, metadata management, governance, and observability tools.
  • Snowflake, dbt, or cloud-platform certifications.
  • Experience working in Agile delivery environments.

What We Are Looking For

The successful candidate will be a hands-on technical leader who can independently drive solution design while remaining actively involved in development and delivery. The candidate should have successfully implemented production-grade Snowflake data platforms and be comfortable managing complex data integration, modeling, quality, scalability, and performance requirements.

Applicants must be U.S. Citizens or Green Card holders and must be available to work from Dallas, Raleigh, or Phoenix.

Benefits & conditions

$70 - $72 an hour - Temporary, Full-time, Contract

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer · Coffee With Developers

3:03 min

Exploring declarative and procedural macro subtypes in Rust environments

Mykhailo Maidan · LIVE

10:40 min

Visualizing Prometheus open metrics using custom Grafana dashboards

Stijn Polfliet · LIVE

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

56 sec

Favorite git commands and the importance of patch commits

Eileen Uchitelle Eileen Uchitelle +1 · Coffee With Developers

Videos

See all

Related articles

See all