> Markdown version of [/jobs/ext/1138286-sr-data-engineer](https://www.wearedevelopers.com/jobs/ext/1138286-sr-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Sr. Data Engineer

- **Company:** Horizontal Talent
- **Location:** Boston, MA, United States
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Adobe InDesign, Artificial Intelligence, Airflow, Amazon Web Services, Amazon S3, Computer Programming, Information Engineering, Extract Transform Load (ETL), Python (Programming Language), Workflow Management Systems, Data Processing, Cloud Platform System, Real Time Systems, Large Language Models, Apache Spark, Kubernetes, Information Technology, AWS Data Analytics, Stream Processing, Data Pipelines, Docker, Databricks
- **Published:** June 30, 2026
- **Apply:** https://www.disabledperson.com/jobs/73373157-sr-data-engineer

## About the Role

* Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field.
 * 7-10 years of professional experience in data engineering, with a strong focus on cloud-based architectures.
 * Proficiency in Apache Spark and hands-on experience with Databricks.
 * Expertise in AWS data services including S3, Redshift, and Glue.
 * Strong programming skills in Python, with additional knowledge of SQL.

Preferred Skills

 * Experience with ETL orchestration tools such as Airflow and dbt.
 * Familiarity with container orchestration using Docker and Kubernetes.
 * Knowledge of vector databases and LLM use cases.
 * Excellent communication skills, with the ability to convey complex technical concepts to non-technical stakeholders.

We are committed to fostering a diverse, equitable, and inclusive workplace where all individuals feel valued and respected. We encourage candidates from all backgrounds to apply and contribute to our mission.

## Description

We are seeking a Senior Data Engineer who will play a pivotal role in shaping our data platform team. This position offers the opportunity to work with cutting-edge technology while making a meaningful impact on our data-driven initiatives.
Responsibilities

 * Design and implement robust data pipelines utilizing Databricks and AWS services for both batch and real-time processing.
 * Architect and maintain a scalable lakehouse infrastructure, ensuring data is reliable and accessible for analytics and AI applications.
 * Collaborate with data scientists to develop feature store architecture and support predictive modeling efforts.
 * Build and manage ETL/ELT orchestration and stream processing pipelines, integrating diverse data sources.
 * Ensure compliance with HIPAA regulations across all data handling processes.
 * Mentor junior engineers and enforce best engineering practices within the team.
 * Participate in design discussions and contribute to special projects as needed.


## Related Videos

- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered)
- [WeAreDevelopers LIVE - CSS is DOOMed](https://www.wearedevelopers.com/videos/1838-wearedevelopers-live-css-is-doomed)
- [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt)
- [Docker build without Docker](https://www.wearedevelopers.com/videos/100114-docker-build-without-docker)
- [AI Model Management Life Circles: ML Ops For Generative AI Models From Research to Deployment](https://www.wearedevelopers.com/videos/1152-ai-model-management-life-circles-ml-ops-for-generative-ai-models-from-research-to-deployment)

## Related Articles

- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)
- [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market)