> Markdown version of [/jobs/ext/4720218-data-engineer-databricks-customer-360](https://www.wearedevelopers.com/jobs/ext/4720218-data-engineer-databricks-customer-360). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Data Engineer - Databricks / Customer 360

- **Company:** Diverse Lynx LLC
- **Location:** Marlborough, MA, United States
- **Salary:** $145,600
- **Contract:** Permanent contract
- **Skills:** Unity 3d, Artificial Intelligence, Amazon Web Services, Data Analysis, Business Logic, Cloud Computing, Continuous Integration, Data Governance, Data Masking, Data Transformation, Software Debugging, Github, Apache Hive, SQL Databases, Data Streaming, Apache Spark, Data Lakes, Pyspark, Data Lineage, Data Management, Terraform, Data Pipelines, Cisco, Databricks
- **Published:** November 14, 2026
- **Apply:** https://www.careerbuilder.com/job-details/data-engineer-databricks-customer-360-marlborough-ma--b8988be1-77d6-4dc3-9a0b-5047a21991b1

## About the Role

Data Management, Marketing, Cloud Computing, eCommerce, SQL (Structured Query Language), Cisco Unity, Performance Metrics, Metrics, Data Quality, Debugging Skills

## Description

* Design, develop, and deploy batch and streaming data pipelines using PySpark, Spark SQL, and Lakeflow to ingest data from POS, e-commerce platforms, loyalty systems, and marketing clouds.
 * Implement data transformations and business logic within the Medallion Architecture (Bronze, Silver, and Gold layers).
 * Build and Eligible to workimize Gold dimension tables as the single source of truth.
 * Define governed business KPIs using Unity Catalog Metric Views.
 * Implement data quality frameworks and cleansing routines to ensure accurate and trustworthy Customer 360 data.
 * Monitor, debug, and Eligible to workimize Databricks jobs and Spark clusters for performance and cost efficiency.
 * Implement partitioning, caching, and Delta Lake data layout best practices.
 * Manage Databricks environments, clusters, and deployments using Terraform and AWS DevOps/GitHub Actions.
 * Implement CI/CD best practices for data pipelines.
 * Implement Unity Catalog governance capabilities, including data lineage, access controls, tags, and data masking.
 * Collaborate with Functional Consultants, Data Scientists, and Analytics Engineers to deliver consumption-ready datasets.
 * Build and govern Unity Catalog Business Semantics, including Metric Views, Domains, Pages, Glossary terms, and certified assets.
 * Configure and curate AI/BI Genie Spaces and the Genie Ontology to enable conversational analytics and AI-driven data consumption.

SKILLS_REQUIRED

 * PySpark
 * Spark SQL
 * Lakeflow
 * Lakeflow Connect
 * Lakeflow Declarative Pipelines
 * Terraform
 * AWS DevOps
 * GitHub Actions