WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
Back

Lead Data Engineer

Ecco
Fort Worth, TX, United States
1 day ago
Apply on www.careerboard.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
2 years minimum
Working hours
Regular working hours
Job source
www.careerboard.com

Tech stack

.NET Framework Application Programming Interfaces (APIs) Airflow Amazon Web Services Amazon S3 C Sharp (Programming Language) Software as a Service Code Review Continuous Delivery Continuous Integration Data as a Services Data Validation
+25 more
Information Engineering Data Integration Data Integrity Data Masking Data Transformation Data Security Data Warehousing Database Development Dimensional Modeling Monitoring of Systems Python (Programming Language) Performance Tuning Query Optimization Power BI Data Streaming Systems Integration Tableau (Software) Snowflake Git Cloudformation Infrastructure Automation Frameworks Information Technology AWS Data Analytics Terraform Data Pipelines

Job description

  • Designing and building batch and near-real-time data pipelines on AWS using services such as S3, Glue, Lambda, and Step Functions.
  • Developing and maintaining Snowflake data models-across raw, staging, and reporting layers-to support analytics and reporting.
  • Loading and transforming data in Snowflake, utilizing Snowpipe, Streams and Tasks, and external stages for automation and efficiency.
  • Integrating data from internal applications, SaaS platforms, and third-party sources through APIs and file-based feeds.
  • Performing Snowflake performance tuning/cost optimization by managing warehouse sizing, query optimization, and usage monitoring.
  • Building data quality checks, monitoring systems, and alerting mechanisms to proactively identify and resolve data pipeline failures and issues.
  • Applying data security and governance best practices, including role-based access controls and data masking for compliance and confidentiality.
  • Collaborating with application teams working on .NET-based systems to source data, implement integrations, and ensure data reliability.
  • Documenting data flows, data models, and pipeline processes, and participating in code reviews for continuous improvement.

Requirements

  • 8+ years of hands-on data engineering experience, with a minimum of 2 years in a technical lead or supervisory capacity.
  • Extensive experience with Snowflake, including end-to-end data modeling, SQL development, and performance optimization/tuning.
  • Demonstrated experience with AWS data services, specifically S3, Glue, Lambda, and Step Functions, in a production environment.
  • Advanced SQL expertise and a strong understanding of data warehousing fundamentals, such as dimensional modeling and ELT best practices.
  • Working proficiency with C#/.NET, including reading, supporting, or building data integrations with .NET-based applications.
  • Familiarity with Git for version control and best practices in continuous integration/continuous deployment (CI/CD).
  • Excellent communication skills and an ability to work collaboratively across diverse technology and business teams.
  • Bachelor’s degree in Computer Science, Engineering, or a related technology field-or equivalent professional experience., * Experience with dbt, Python, or Airflow preferred.
  • Familiarity with infrastructure-as-code practices using Terraform or CloudFormation is a plus.
  • Exposure to reporting and BI tools such as Power BI, Tableau, or others that integrate with Snowflake.
  • Background in events, hospitality, or customer engagement data is an advantage.
  • Relevant technical certifications-such as SnowPro Core or AWS Data Engineer (Associate)-are desirable.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerboard.com
Prepare application

Good distractions

Loading talks and stories from around this role…