> Markdown version of [/jobs/ext/170398-senior-data-engineer-data-architect-databricks-snowflake-boston-ma](https://www.wearedevelopers.com/jobs/ext/170398-senior-data-engineer-data-architect-databricks-snowflake-boston-ma). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Data Engineer / Data Architect (Databricks & Snowflake) - Boston, MA

- **Company:** Diverse Lynx LLC
- **Location:** Boston, MA, United States
- **Experience:** Expert
- **Salary:** $127,300.0 - $165,500.0
- **Contract:** Permanent contract
- **Skills:** Airflow, Amazon Web Services, Microsoft Azure, Continuous Integration, Data Architecture, Information Engineering, Data Governance, Extract Transform Load (ETL), Data Warehousing, Linux, DevOps, Apache Hive, Python (Programming Language), Performance Tuning, Cloud Services, Azure Data Lake, Shell Script, SQL Databases, Talend, Snowflake, Apache Spark, Multi-Cloud, Caching, Change Data Capture, Git, Data Lakes, Pyspark, Information Technology, Deployment Automation, Apache Kafka, Spark Streaming, Data Management, Data Delivery, Stream Processing, Data Pipelines, Legacy Systems, Jenkins, Databricks
- **Published:** May 17, 2026
- **Apply:** https://www.careerjet.com/jobad/usef3ce9a87619e76d2a013bfae40f3a6c

## About the Role

* 10+ years (ideally 15-20+) of experience in data engineering or data architecture.
 * Strong expertise in:

 * Databricks & Delta Lake
 * Snowflake Data Warehouse
 * Apache Spark (PySpark, Spark SQL)
 * Hands-on experience with Azure Cloud (ADLS Gen2, Azure Databricks, ADF).
 * Proficiency in Python and SQL for data engineering.
 * Experience with ETL/ELT tools such as Talend or Informatica.
 * Strong knowledge of data modeling, CDC (Change Data Capture), and incremental loading techniques.
 * Experience working in Linux/Unix environments with shell scripting.

Preferred Qualifications

 * Knowledge of data governance, compliance, and regulatory standards (e.g., IDMP).
 * Exposure to real-time data streaming technologies (Kafka, Kinesis).
 * Experience with multi-cloud environments (AWS, GCP).
 * Familiarity with workflow orchestration tools such as Airflow or Databricks Workflows., * Data Engineering & Architecture
 * Lakehouse & Data Warehousing
 * Spark Performance Optimization
 * Cloud Data Platforms (Azure)
 * ETL/ELT Pipeline Development
 * Data Governance & Security
 * CI/CD & DevOps Practices

Education

 * Bachelor's degree in Information Technology, Computer Science, or a related field.

Nice-to-Have Traits

 * Strong analytical and problem-solving skills
 * Ability to work in enterprise-scale, complex environments
 * Experience working with global stakeholders and cross-functional teams
 * Leadership capability with mentoring experience

## Description

We are seeking a highly experienced Senior Data Engineer / Data Architect with deep expertise in Databricks, Snowflake, and Azure cloud data platforms. The ideal candidate will have extensive experience designing and implementing scalable data pipelines, Lakehouse architectures, and real-time data processing solutions, particularly in regulated domains such as Life Sciences or Healthcare.
This role requires strong proficiency in Spark (PySpark), Delta Lake, Medallion architecture, and cloud-native data engineering practices, along with a solid background in data warehouse modernization and performance optimization., * Design and implement end-to-end data engineering pipelines using Azure Databricks, ADLS Gen2, and Snowflake.

 * Develop scalable ETL/ELT pipelines using PySpark, Spark SQL, Python, and Talend.
 * Build and maintain Lakehouse architecture using Delta Lake and Medallion (Bronze, Silver, Gold) layers.
 * Implement real-time and batch data ingestion pipelines, including streaming using Spark Structured Streaming.
 * Design and enforce data governance, access control, and lineage using Unity Catalog.
 * Optimize Spark workloads through partitioning, caching, broadcast joins, and cluster tuning to improve performance and reduce cloud costs.
 * Architect and manage CI/CD pipelines using Azure DevOps, Jenkins, and Git for automated deployments.
 * Integrate multiple data sources and systems, ensuring high-quality, reliable, and scalable data delivery.
 * Collaborate with cross-functional teams including data analysts, scientists, and business stakeholders to support analytics and reporting needs.
 * Support data warehouse modernization initiatives, including migration from legacy systems to cloud platforms., Job Description: Saab Inc., Autonomous and Undersea Systems division is seeking an innovative and experienced Senior Staff Electrical Engineer to support our growing team working…
 + 16 days ago


## Related Videos

- [Docker network without Docker](https://www.wearedevelopers.com/videos/1418-docker-network-without-docker)
- [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Docker exec without Docker](https://www.wearedevelopers.com/videos/1094-docker-exec-without-docker)
- [Git for Code Reviews](https://www.wearedevelopers.com/videos/429-git-for-code-reviews)
- [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering)

## Related Articles

- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk)
- [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london)