Data Engineer -27793
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+5 more
Job description
Our client is hiring a Data Engineer to build and improve production pipelines in Databricks. You’ll work across the bronze, silver, and gold layers of the lakehouse and help take ownership of existing pipelines. This is a hands-on individual contributor role reporting to the Data Engineering & Platform Manager., Build batch and incremental pipelines that bring data from ERP, CRM, and other operational systems into the Databricks Lakehouse.
\n
Use medallion architecture to land raw data in bronze, validate and standardize it in silver, and publish curated models in gold for reporting and analytics.
\n
Review existing notebooks, pipelines, and data models built by implementation partners. Trace dependencies, fix gaps, and document how to operate and troubleshoot them.
\n
Monitor job failures and data freshness. Troubleshoot root causes and add automated checks to validate data and reconcile it to source systems.
\n
Apply Unity Catalog standards for access controls, ownership, and lineage. Use Git, code review, and CI/CD to deploy changes.
Requirements
Approximately 3 years of data engineering experience, including at least 2 years building production pipelines in Databricks., Strong SQL, Python, and PySpark skills, with experience orchestrating pipelines in Databricks Workflows or Lakeflow Jobs., Working knowledge of Unity Catalog and Azure data services such as Azure Data Lake Storage or Azure Data Factory., Bachelor’s degree in a related field or equivalent practical experience., Integrating SAP ECC, Microsoft Dynamics GP, Salesforce, or similar enterprise systems. SAP ECC experience is especially valuable., Experience with Lakeflow Declarative Pipelines, Power BI, or data engineering in regulated manufacturing.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this role…