Lead Data Engineer - Azure Databricks & Snowflake

Diverse Lynx LLC
Boston, MA, United States
1 day ago
Apply on www.careerbuilder.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours

Tech stack

Agile Methodology Artificial Intelligence Amazon Web Services Amazon S3 Business Analytics Applications Data Analysis Microsoft Azure Big Data Cloud Computing Continuous Integration Extract Transform Load (ETL) Data Migration
+25 more
Data Systems Data Warehousing DevOps Dimensional Modeling Apache Hive Python (Programming Language) Performance Tuning Systems Development Life Cycle Power BI Azure Data Lake SQL Databases Enterprise Data Management Scripting Cloud Platform System Azure Data Factory Large Language Models Snowflake Git Microsoft Fabric Data Lakes Pyspark Star Schema Cloud Migration Data Pipelines Databricks

Job description

  • Design and develop data pipelines, ETL/ELT frameworks, and Lakehouse solutions using Azure, Databricks, and Snowflake.
  • Build and Eligible to workimize large-scale data processing solutions using Python, PySpark, and SQL.
  • Develop data models, data warehousing solutions, and cloud migration strategies.
  • Implement data quality, governance, monitoring, and performance tuning best practices.
  • Collaborate with business stakeholders, architects, and development teams to deliver analytics and reporting solutions.
  • Support CI/CD and DevOps processes using Git and Azure DevOps.

Requirements

Microsoft Windows Azure, Snowflake Schema, Microsoft Windows Azure, Snowflake Schema, Cloud Computing, Data Warehousing, Scalable System Development, Amazon Web Services (AWS), Python Programming/Scripting Language, Data Analysis, Seeking an experienced Senior Data Engineer with 15+ years of expertise in building scalable cloud-based data platforms, data lakes, and data warehouses. The ideal candidate will have strong hands-on experience with Azure, Databricks, Snowflake, PySpark, Python, and AWS, along with a proven ability to deliver enterprise data and analytics solutions., * Azure Databricks, Azure Data Factory (ADF), Azure Data Lake (ADLS), Synapse Analytics.

  • Snowflake, DBT, Python, PySpark, Spark SQL, SQL.
  • AWS services including S3, Glue, EMR, Lambda, and Athena.
  • Data warehousing, dimensional modeling, and ETL/ELT development.
  • Git, Azure DevOps, and Agile delivery methodologies.

Preferred Skills:

  • Microsoft Fabric, Power BI, and AI/LLM-enabled data solutions.
  • Experience leading cloud modernization and data migration initiatives.

About the company

Security Notice: Our official website is www.diverselynx.com We do not operate or authorize any other websites representing Diverse Lynx LLC.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerbuilder.com
Prepare application

Good distractions

Loading talks and stories from around this role…