Lead Data Engineer
Encora Inc
Peru, IN, United States
12 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.careerbuilder.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
2 years minimum
Working hours
Regular working hours
Job source
Tech stack
Amazon Web Services
Microsoft Azure
Big Data
Cloud Database
Code Review
Continuous Integration
Data Architecture
Information Engineering
Data Governance
Extract Transform Load (ETL)
Data Migration
Distributed Data Store
+17 more
Python (Programming Language)
Performance Tuning
Migration Manager
SQL Server Integration Services
Azure Service Bus
Snowflake
Multi-Cloud
HybridCloud
Git
Star Schema
Apache Kafka
Data Management
Video Streaming
Cloud Integration
Terraform
Software Version Control
Databricks
Job description
- Lead and mentor a team of data engineers, setting technical direction, conducting code reviews, and driving engineering excellence across the data ecosystem.
- Own the end-to-end architecture, design, and implementation of scalable data platforms, pipelines, and data models, ensuring reliable and production-ready solutions.
- Define and lead data migration strategies from Snowflake/SSIS to Azure Databricks and DBT, including architecture decisions, cloud integration, data quality, and observability.
- Drive Infrastructure as Code with Terraform, CI/CD adoption, architectural standards, troubleshooting, and collaboration with data, product, architecture, and business stakeholders.
Requirements
Technical Recruiting, Code Reviews, Mentoring, Ecosystems, Data Modeling, Migration Strategy, SQL Server Integration Services (SSIS), Microsoft Windows Azure, Data Migration, Snowflake Schema, * 8+ years of Data Engineering experience, including at least 2-3 years in a Lead or Staff-level role.
- Proven experience owning system design and leading implementations of large-scale data platforms.
- Strong hands-on expertise with Snowflake, Azure Databricks, DBT, Python, and advanced SQL.
- Experience with large-scale data transformations involving thousands of DBT models and pipelines processing terabytes of data daily.
- Deep understanding of data architecture, data modeling, distributed data systems, and ETL/ELT frameworks.
- Extensive experience with Terraform, Infrastructure as Code, CI/CD pipelines, and Git-based version control.
- Experience leading cloud-to-cloud data migration projects, preferably from AWS to Azure.
- Previous experience in insurance or financial services, with knowledge of domains such as claims, policies, underwriting, and risk.
- Proven experience leading and developing engineering teams, including mentoring, training, and managing different performance levels.
- Strong problem-solving, architectural decision-making, communication, and stakeholder management skills.
Preferred Skills:
- Experience implementing data governance, observability, and data quality frameworks.
- Strong knowledge of security and compliance standards within insurance or financial services.
- Experience with Kafka, Event Hubs, Delta Live Tables, or other real-time and streaming technologies.
- Familiarity with lakehouse architectures and cost/performance optimization strategies.
- Experience working in multi-cloud or hybrid cloud environments.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.careerbuilder.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦