Principal Data Engineer

Motion Recruitment Partners LLC.
Waltham, MA, United States
25 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
8 years minimum
Working hours
Regular working hours
Job source

Tech stack

Airflow Amazon Web Services Amazon S3 Cloud Computing Data Architecture Information Engineering Extract Transform Load (ETL) Relational Databases Distributed Computing Environment Python (Programming Language) PostgreSQL Operational Databases
+21 more
Oracle (Applications) Performance Tuning Query Optimization Cloud Services Software Engineering Data Streaming Data Logging Data Processing Sql Optimization Apache Spark Backend Cloudformation Containerization Kubernetes Apache Flink Real Time Data Apache Kafka Terraform Data Pipelines Docker Amazon Redshift

Job description

A global financial technology leader is hiring a Principal Data Engineer to join its hybrid engineering team in Waltham, MA. This full-time role focuses on designing and building enterprise-scale, real-time data platforms that power mission-critical financial applications.

Requirements

This is a highly visible technical leadership opportunity where you’ll drive the architecture and modernization of next-generation streaming data platforms while mentoring engineers and influencing engineering standards across the organization. The team is looking for someone who thrives in complex distributed environments, enjoys solving large-scale performance challenges, and wants to build resilient, cloud-native systems using cutting-edge event streaming technologies., 8+ years of experience in data engineering, software engineering, or backend platform development Expert-level Python development for data processing, automation, and scalable backend applications Advanced SQL skills including complex query development, CTEs, window functions, performance tuning, and query optimization Extensive experience designing and building scalable ETL/ELT pipelines and distributed data processing systems Strong experience with cloud-native data platforms on AWS, including Redshift, S3, Lambda, Glue, and related services Experience with Apache Kafka and event-driven data architectures Experience building and orchestrating batch and streaming data pipelines using tools such as Airflow, Spark, or Flink Strong knowledge of relational databases including PostgreSQL, Oracle, Amazon Redshift, and Aurora, with expertise in schema design and data modeling Experience with containerization and Infrastructure as Code using Docker, Kubernetes, Terraform, or CloudFormation Experience building CI/CD pipelines and implementing engineering best practices for production data platforms Experience implementing monitoring, logging, data quality, and observability solutions across enterprise data environments Proven ability to lead technical initiatives, mentor engineers, and collaborate across cross-functional engineering teams, Applicants must be currently authorized to work in the US on a full-time basis now and in the future.

Benefits & conditions

40% Real-Time Data Platform & Streaming Engineering 30% Cloud Infrastructure, Microservices & Distributed Systems 20% Architecture, Technical Leadership & Platform Modernization 10% Observability, Performance Optimization & CI/CD Daily Responsibilities 60% Hands On Engineering 20% Technical Leadership & Mentorship 20% Cross-Functional Collaboration The Offer You will receive the following benefits: Medical Insurance Dental Benefits Vision Benefits 401(k) with company match Paid Time Off (PTO) Paid Holidays Paid Parental Leave Professional Development Reimbursement Hybrid Work Environment

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon Sandhya Menon · WWC Europe 2026

2:07 min

Inspecting default bridge architectures and custom Docker networks

Oliver Seitz Oliver Seitz · WWC 2025

1:52 min

Structuring and scaling the backend engineering team

Stefan Lingler Stefan Lingler +1 · Coffee With Developers

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

1:12 min

Choosing TypeScript for complex backend applications

Maximilian Otto Maximilian Otto · WWC 2024

3:05 min

Audience questions on AI agents and pipeline vectorization

Joy Joy · WWC 2024

Videos

See all

Related articles

See all