Lead Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+30 more
Job description
We are seeking an experienced Lead Data Engineer with strong expertise in Snowflake, dbt, Snowpipe, and enterprise data warehouse development. The ideal candidate will have hands-on experience designing and delivering scalable cloud data platforms using dbt Vault/dbtvault, particularly for file-based data sources and multiple OLTP systems., This role requires a strong combination of data architecture, engineering leadership, dimensional and Data Vault modeling, performance optimization, and production delivery experience. The Lead Data Engineer will work closely with architects, business stakeholders, analysts, and engineering teams to build reliable, governed, and high-performing enterprise data solutions., * Lead the design, development, and implementation of enterprise data warehouse solutions on Snowflake.
- Build scalable ingestion and transformation pipelines using Snowpipe, Snowflake, dbt, SQL, and related cloud technologies.
- Design and implement Raw Vault, Business Vault, and information delivery layers using dbtvault.
- Integrate data from file-based sources, APIs, relational databases, and multiple OLTP applications.
- Develop reusable dbt models, macros, tests, documentation, and deployment standards.
- Design incremental data-loading patterns, change data capture processes, historization, and audit frameworks.
- Implement automated data-quality checks, reconciliation controls, exception handling, and monitoring.
- Optimize Snowflake warehouses, queries, storage, clustering, and workload configurations for performance and cost.
- Translate business and analytical requirements into scalable data models and technical solutions.
- Establish engineering standards for naming conventions, source control, code reviews, testing, and CI/CD.
- Provide technical leadership, conduct design reviews, mentor developers, and support delivery planning.
- Troubleshoot production issues involving data pipelines, transformation logic, data quality, and performance.
- Collaborate with security and governance teams to implement role-based access, data masking, lineage, and compliance controls.
Requirements
Work Arrangement: Candidates must be able to work from one of the listed locations, * 9-10+ years of experience in data engineering, data warehousing, ETL/ELT, and enterprise data-platform delivery.
- Strong hands-on experience with Snowflake architecture, SQL development, performance tuning, and administration concepts.
- Advanced experience with dbt, including model development, macros, testing, documentation, packages, and deployment.
- Proven experience implementing Data Vault 2.0 solutions using dbtvault or comparable frameworks.
- Experience delivering an enterprise data warehouse using file-based data sources and multiple OLTP systems.
- Strong experience with Snowpipe, stages, file formats, streams, tasks, and incremental ingestion patterns.
- Strong understanding of Data Vault concepts, including hubs, links, satellites, hash keys, hash differences, effectivity, and historization.
- Experience designing dimensional models, data marts, semantic layers, and analytical datasets.
- Strong SQL, data-analysis, troubleshooting, and performance-optimization skills.
- Experience with Git-based development, CI/CD pipelines, automated testing, and release management.
- Ability to lead technical teams and communicate effectively with business and technology stakeholders.
- Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related discipline.
Preferred Qualifications
- Experience with AWS, Azure, or Google Cloud storage and data services.
- Experience with Python, orchestration platforms, APIs, or event-driven data integration.
- Familiarity with data catalogs, lineage, metadata management, governance, and observability tools.
- Snowflake, dbt, or cloud-platform certifications.
- Experience working in Agile delivery environments.
What We Are Looking For
The successful candidate will be a hands-on technical leader who can independently drive solution design while remaining actively involved in development and delivery. The candidate should have successfully implemented production-grade Snowflake data platforms and be comfortable managing complex data integration, modeling, quality, scalability, and performance requirements.
Applicants must be U.S. Citizens or Green Card holders and must be available to work from Dallas, Raleigh, or Phoenix.
Benefits & conditions
$70 - $72 an hour - Temporary, Full-time, Contract
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.indeed.comGood distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Highest Paying Tech Companies for Developers
Data Engineer Salary UK
How to Become an AI Engineer
Data Analyst Salary in the UK