Lead Data Engineer

Ecco
Dallas, TX, United States
2 days ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
2 years minimum
Working hours
Regular working hours
Job source

Tech stack

.NET Framework Application Programming Interfaces (APIs) Airflow Amazon Web Services Amazon S3 Business Intelligence Development C Sharp (Programming Language) Software as a Service Code Review Continuous Delivery Continuous Integration Data as a Services
+28 more
Data Validation Information Engineering Data Infrastructure Data Integration Data Integrity Data Masking Data Transformation Data Security Data Warehousing Database Development Digital Assets Dimensional Modeling Monitoring of Systems Python (Programming Language) Performance Tuning Query Optimization Power BI Data Streaming Systems Integration Tableau (Software) Snowflake Git Cloudformation Infrastructure Automation Frameworks Information Technology AWS Data Analytics Terraform Data Pipelines

Job description

As a Lead Data Engineer, you will play a key role in designing, building, and maintaining robust data pipelines and the Snowflake data platform on AWS. You will collaborate with cross-functional teams-including data analysts, BI developers, application engineers, and business stakeholders-to ensure the delivery of well-modeled, trustworthy data that serves analytics, reporting, and business intelligence needs. Your combined hands-on technical expertise and leadership will ensure that data assets are reliable, performant, and secure., * Designing and building batch and near-real-time data pipelines on AWS using services such as S3, Glue, Lambda, and Step Functions.

  • Developing and maintaining Snowflake data models-across raw, staging, and reporting layers-to support analytics and reporting.
  • Loading and transforming data in Snowflake, utilizing Snowpipe, Streams and Tasks, and external stages for automation and efficiency.
  • Integrating data from internal applications, SaaS platforms, and third-party sources through APIs and file-based feeds.
  • Performing Snowflake performance tuning/cost optimization by managing warehouse sizing, query optimization, and usage monitoring.
  • Building data quality checks, monitoring systems, and alerting mechanisms to proactively identify and resolve data pipeline failures and issues.
  • Applying data security and governance best practices, including role-based access controls and data masking for compliance and confidentiality.
  • Collaborating with application teams working on .NET-based systems to source data, implement integrations, and ensure data reliability.
  • Documenting data flows, data models, and pipeline processes, and participating in code reviews for continuous improvement.

Requirements

To excel in this role, you will need the following expertise and qualities:

  • 8+ years of hands-on data engineering experience, with a minimum of 2 years in a technical lead or supervisory capacity.
  • Extensive experience with Snowflake, including end-to-end data modeling, SQL development, and performance optimization/tuning.
  • Demonstrated experience with AWS data services, specifically S3, Glue, Lambda, and Step Functions, in a production environment.
  • Advanced SQL expertise and a strong understanding of data warehousing fundamentals, such as dimensional modeling and ELT best practices.
  • Working proficiency with C#/.NET, including reading, supporting, or building data integrations with .NET-based applications.
  • Familiarity with Git for version control and best practices in continuous integration/continuous deployment (CI/CD).
  • Excellent communication skills and an ability to work collaboratively across diverse technology and business teams.
  • Bachelor’s degree in Computer Science, Engineering, or a related technology field-or equivalent professional experience., * Experience with dbt, Python, or Airflow preferred.
  • Familiarity with infrastructure-as-code practices using Terraform or CloudFormation is a plus.
  • Exposure to reporting and BI tools such as Power BI, Tableau, or others that integrate with Snowflake.
  • Background in events, hospitality, or customer engagement data is an advantage.
  • Relevant technical certifications-such as SnowPro Core or AWS Data Engineer (Associate)-are desirable.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Loading talks and stories from around this role…