Principal Data Engineer

Motion Recruitment Partners LLC.
Waltham, United States of America
yesterday

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Waltham, United States of America

Tech stack

Airflow
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Cloud Computing
Data Architecture
Information Engineering
ETL
Relational Databases
Distributed Computing Environment
Python
PostgreSQL
Operational Databases
Oracle Applications
Performance Tuning
Query Optimization
Cloud Services
Software Engineering
Data Streaming
Data Logging
Data Processing
Sql Optimization
Spark
Backend
Cloudformation
Containerization
Kubernetes
Apache Flink
Real Time Data
Kafka
Terraform
Data Pipelines
Docker
Redshift

Job description

A global financial technology leader is hiring a Principal Data Engineer to join its hybrid engineering team in Waltham, MA. This full-time role focuses on designing and building enterprise-scale, real-time data platforms that power mission-critical financial applications.

Requirements

This is a highly visible technical leadership opportunity where you'll drive the architecture and modernization of next-generation streaming data platforms while mentoring engineers and influencing engineering standards across the organization. The team is looking for someone who thrives in complex distributed environments, enjoys solving large-scale performance challenges, and wants to build resilient, cloud-native systems using cutting-edge event streaming technologies., 8+ years of experience in data engineering, software engineering, or backend platform development Expert-level Python development for data processing, automation, and scalable backend applications Advanced SQL skills including complex query development, CTEs, window functions, performance tuning, and query optimization Extensive experience designing and building scalable ETL/ELT pipelines and distributed data processing systems Strong experience with cloud-native data platforms on AWS, including Redshift, S3, Lambda, Glue, and related services Experience with Apache Kafka and event-driven data architectures Experience building and orchestrating batch and streaming data pipelines using tools such as Airflow, Spark, or Flink Strong knowledge of relational databases including PostgreSQL, Oracle, Amazon Redshift, and Aurora, with expertise in schema design and data modeling Experience with containerization and Infrastructure as Code using Docker, Kubernetes, Terraform, or CloudFormation Experience building CI/CD pipelines and implementing engineering best practices for production data platforms Experience implementing monitoring, logging, data quality, and observability solutions across enterprise data environments Proven ability to lead technical initiatives, mentor engineers, and collaborate across cross-functional engineering teams, Applicants must be currently authorized to work in the US on a full-time basis now and in the future.

Benefits & conditions

40% Real-Time Data Platform & Streaming Engineering 30% Cloud Infrastructure, Microservices & Distributed Systems 20% Architecture, Technical Leadership & Platform Modernization 10% Observability, Performance Optimization & CI/CD Daily Responsibilities 60% Hands On Engineering 20% Technical Leadership & Mentorship 20% Cross-Functional Collaboration The Offer You will receive the following benefits: Medical Insurance Dental Benefits Vision Benefits 401(k) with company match Paid Time Off (PTO) Paid Holidays Paid Parental Leave Professional Development Reimbursement Hybrid Work Environment

Apply for this position