Lead Data Engineer

Nava Software Solutions LLC
Houston, United States of America
yesterday

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Houston, United States of America

Tech stack

Artificial Intelligence
Amazon Web Services (AWS)
Architectural Patterns
Cloud Database
Databases
Data Architecture
Data Governance
Data Transformation
Data Systems
Python
PostgreSQL
Meta-Data Management
Microsoft Visual Studio
Microsoft SQL Server
SQL Azure
Oracle Applications
Power BI
Service-Oriented Architecture
PL-SQL
SQL Databases
Teradata
T-SQL
Data Strategy
GIT
Powerquery
Data Layers
Pandas
Data Lake
PySpark
Information Technology
Data Lineage
Amazon Web Services (AWS)
Data Management
Machine Learning Operations
Cloud Migration
SQL Server Management Studio (SSMS)
Software Version Control
Databricks

Job description

The Lead Data Engineer is responsible for defining, implementing, and overseeing enterprise-wide data architecture strategies that align with business objectives. This role requires deep expertise in cloud platforms (especially AWS), advanced data modeling, and the ability to lead modernization initiatives across the organization., * Develop and execute long-term data architecture vision in alignment with business goals.

  • Design and implement scalable data systems, including Data Lakes, Lakehouse, and Data Mesh architecture.
  • Lead cloud migration strategies and data modernization projects.
  • Collaborate with business and technology stakeholders to ensure architectural alignment.
  • Architect and optimize batch and streaming data pipelines using appropriate tools such as AWS Glue.
  • Implement data governance, metadata management, lineage tracking, and compliance frameworks.
  • Integrate data platforms to support AI/ML workflows (SageMaker, Bedrock, Databricks).
  • Provide technical leadership, mentorship, and oversight for data analysts and engineers.
  • Conduct technical assessments and facilitate stakeholder workshops.
  • Ensure best practices in version control, automation, and documentation., * This role may require occasional travel for stakeholder workshops or technical assessments.
  • The Senior Data Engineer will play a key role in shaping the organization's data strategy and future readiness for AI/ML initiatives.

Requirements

  • Bachelor's or Master's degree in Computer Science, Engineering, or related field.
  • 7 10 years of implementation experience in cloud data architecture, with at least 5 years in AWS environments.
  • Proficiency in AWS services: Glue, Redshift, Athena, Lake Formation, SageMaker, Bedrock, Step Functions.
  • Extensive experience working with Databricks.
  • Working knowledge of the Alation data governance tool.
  • Strong skills in SQL (T-SQL), Python (PySpark/Pandas), DAX, Power Query (M), PL/SQL.
  • Experience with databases: SQL Server, Oracle, PostgreSQL, Azure SQL, Teradata.
  • Skilled in Power BI, Git, Visual Studio Code, SSMS.
  • Knowledge of architectural patterns: Medallion architecture, data mesh, Lakehouse, SOA data layers.
  • AWS and Databricks certifications are preferred.
  • Excellent communication, collaboration, and leadership abilities.

Preferred Experience

  • Leading cloud migration and data modernization initiatives.
  • Designing and implementing scalable data architectures in AWS and Databricks.
  • Managing data governance, security, and compliance in complex environments.
  • Mentoring junior architects and engineers.
  • Working with cross-functional teams to deliver business value through data.

Apply for this position