> Markdown version of [/jobs/ext/2227887-sr-data-engineer](https://www.wearedevelopers.com/jobs/ext/2227887-sr-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Sr Data Engineer

- **Company:** Hays Specialist Recruitment LLC
- **Location:** United States (Remote available)
- **Experience:** Expert
- **Salary:** $156,000.0 - $172,640.0
- **Contract:** Temporary contract
- **Skills:** Artificial Intelligence, Microsoft Azure, Cloud Computing, Code Review, Continuous Integration, Data Governance, Data Warehousing, Software Design Patterns, Python (Programming Language), Performance Tuning, Systems Development Life Cycle, Software Engineering, SQL Databases, Apache Spark, Pyspark, Databricks
- **Published:** August 25, 2026
- **Apply:** https://www.dice.com/job-detail/bdc20b45-b5d4-40d4-8223-d298d088202b

## About the Role

3-5 years experience with Databricks required (they should know how to ingest data into Databricks;
Must have PySpark experience (which is combination of Python and SQL)
Must have 3-5 years in general analytics, data warehousing, and modern data engieering practices
3-5 years SQL experience
Proven experience leading and performing all SDLC roles not just building
Healthcare data would be preferred ; Any Cloud (ie Azure) preferred; Familiarity with Data Governance and data quality.

## Description

In this role, you will lead and implement with guidance on using the current architecture and design patterns with no mentoring expected in using current Data Bricks features.
You will perform all roles in the software development lifecycle including business requirements definition, design, build, test, and run.
You will lead the definition of best practices, establish common code frameworks, elevate engineering maturity, prove out and determine when new Data Bricks features should be implemented, and ensure consistent delivery of high quality data products and analytical solutions across build teams that will enhance the current architecture.
Collaboration will be central as you work closely with the solution architects, agile team tech leads, business stakeholders, and other partners across security, cloud, testing, and data modeling.
The platform leverages a modern streaming architecture supporting both transactional and analytical pipelines, grounded in Medallion and One Lake design principles.
A primary outcome for this role and others on the team is overseeing the implementation of Data Bricks that will replace many legacy analytical platforms that result in new and better business outcomes.
Perform hands on designing, building, testing, and supporting analytical pipelines.
Establishing and enforcing design, engineering, and coding standards, including code reviews.
Leading CI/CD and design of reusable data tests for future releases.
Expanding your expertise into AI, ML, Lake base, and other capabilities available on the Data Bricks platform to these features are implemented as needed.
Driving Spark performance optimization and leading platform cost optimization opportunities.
Managing production monitoring, troubleshooting, and defect resolution.


## Related Videos

- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)
- [Are Code Reviews Worth It? Insights from 16 Years of Review Data](https://www.wearedevelopers.com/videos/1135-are-code-reviews-worth-it-insights-from-16-years-of-review-data)
- [Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source](https://www.wearedevelopers.com/videos/100151-cutting-llm-costs-without-cutting-quality-how-to-beat-proprietary-llms-with-fine-tuned-open-source)
- [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning)
- [OLTP in the Lakehouse: Redefining Data for AI Workloads](https://www.wearedevelopers.com/videos/2038-oltp-in-the-lakehouse-redefining-data-for-ai-workloads)

## Related Articles

- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk)
- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)