> Markdown version of [/jobs/ext/602430-data-engineer-lead](https://www.wearedevelopers.com/jobs/ext/602430-data-engineer-lead). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Data Engineer- Lead

- **Company:** Bridgetown Consulting Group
- **Location:** Malvern, PA, United States
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Agile Methodology, Amazon Web Services, Amazon Elastic Compute Cloud, Amazon S3, Data Analysis, JIRA, Build Automation, Big Data, Computer Programming, Continuous Integration, Extract Transform Load (ETL), Distributed Systems, Apache Hive, Python (Programming Language), Cloud Services, Amazon Simple Notification Service (SNS), SQL Databases, Apache Spark, State Machines, Electronic Medical Records, Git, Pyspark, Data Analytics, Bitbucket, Data Management, Functional Programming, Software Version Control, Data Pipelines, Atlassian Bamboo
- **Published:** June 19, 2026
- **Apply:** https://www.dice.com/job-detail/4bf314b8-b19e-4e0c-94f0-ad4d21757410

## About the Role

12+ years of experience

· Python, SQL, AWS Services

· Strong, hands-on Data Engineers

· Comfortable working end-to-end (ingestion, transformation, delivery)

· Hands-on experience with AWS cloud services, including EMR, S3, EC2, Lambda, SNS, Step Functions, Glue, and ECS, for building, orchestrating, and operating scalable data pipelines and data platforms.

· Strong programming expertise in Python and SQL, with hands-on experience in Big Data technologies such as Apache Spark, Spark SQL, and PySpark to efficiently process and transform large-scale, complex datasets in distributed environments.

· Experience working in an Agile, CI/CD-driven environment, leveraging tools such as Git, Bitbucket, Bamboo, and JIRA for version control, automated builds, deployments, and sprint execution.

· Minimum of five years data analytics, programming, database administration, or data management experience.

· Undergraduate degree or equivalent combination of training and experience.

## Description

* Building and maintaining ETL pipelines, Data Analysis, Reimaging Technical Architecture for Analytics


## Related Videos

- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [Improving quality with Agentic AI with Rovo Dev and Xray](https://www.wearedevelopers.com/videos/2005-improving-quality-with-agentic-ai-with-rovo-dev-and-xray)
- [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)
- [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning)

## Related Articles

- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again)
- [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)