> Markdown version of [/jobs/ext/1317650-principal-data-engineer](https://www.wearedevelopers.com/jobs/ext/1317650-principal-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Principal Data Engineer - **Company:** Motion Recruitment Partners LLC. - **Location:** Waltham, MA, United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Airflow, Amazon Web Services, Amazon S3, Cloud Computing, Data Architecture, Information Engineering, Extract Transform Load (ETL), Relational Databases, Distributed Computing Environment, Python (Programming Language), PostgreSQL, Operational Databases, Oracle (Applications), Performance Tuning, Query Optimization, Cloud Services, Software Engineering, Data Streaming, Data Logging, Data Processing, Sql Optimization, Apache Spark, Backend, Cloudformation, Containerization, Kubernetes, Apache Flink, Real Time Data, Apache Kafka, Terraform, Data Pipelines, Docker, Amazon Redshift - **Published:** July 17, 2026 - **Apply:** https://www.dice.com/job-detail/98f58c99-8815-46b5-9c94-8a625d6cdc52 ## About the Role This is a highly visible technical leadership opportunity where you'll drive the architecture and modernization of next-generation streaming data platforms while mentoring engineers and influencing engineering standards across the organization. The team is looking for someone who thrives in complex distributed environments, enjoys solving large-scale performance challenges, and wants to build resilient, cloud-native systems using cutting-edge event streaming technologies., 8+ years of experience in data engineering, software engineering, or backend platform development Expert-level Python development for data processing, automation, and scalable backend applications Advanced SQL skills including complex query development, CTEs, window functions, performance tuning, and query optimization Extensive experience designing and building scalable ETL/ELT pipelines and distributed data processing systems Strong experience with cloud-native data platforms on AWS, including Redshift, S3, Lambda, Glue, and related services Experience with Apache Kafka and event-driven data architectures Experience building and orchestrating batch and streaming data pipelines using tools such as Airflow, Spark, or Flink Strong knowledge of relational databases including PostgreSQL, Oracle, Amazon Redshift, and Aurora, with expertise in schema design and data modeling Experience with containerization and Infrastructure as Code using Docker, Kubernetes, Terraform, or CloudFormation Experience building CI/CD pipelines and implementing engineering best practices for production data platforms Experience implementing monitoring, logging, data quality, and observability solutions across enterprise data environments Proven ability to lead technical initiatives, mentor engineers, and collaborate across cross-functional engineering teams, Applicants must be currently authorized to work in the US on a full-time basis now and in the future. ## Description A global financial technology leader is hiring a Principal Data Engineer to join its hybrid engineering team in Waltham, MA. This full-time role focuses on designing and building enterprise-scale, real-time data platforms that power mission-critical financial applications. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Developing the Backend with Stefan Lingler, CTO at Shpock](https://www.wearedevelopers.com/videos/100360-developing-the-backend-with-stefan-lingler-cto-at-shpock) - [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [Nest.js - TypeScript in the backend can also be clean](https://www.wearedevelopers.com/videos/1033-nest-js-typescript-in-the-backend-can-also-be-clean) ## Related Articles - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries) - [7 Cloud Computing Trends Coming in 2025 for Developers](https://www.wearedevelopers.com/magazine/412-7-cloud-computing-trends-coming-in-2025-for-developers)