Principal Data Engineer

Kelly Services Inc.
Boston, MA, United States
about 1 month ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
8 years minimum
Working hours
Regular working hours
Job source

Tech stack

Airflow Amazon Web Services Amazon S3 Cloud Computing Continuous Integration Data Architecture Information Engineering Extract Transform Load (ETL) Relational Databases Distributed Computing Environment Distributed Systems Python (Programming Language)
+25 more
PostgreSQL Operational Databases Oracle (Applications) Performance Tuning Query Optimization Cloud Services Software Engineering Data Streaming Data Logging Data Processing Cloud Platform System Sql Optimization Apache Spark Backend Cloudformation Containerization Kubernetes Apache Flink Real Time Data Apache Kafka Terraform Data Pipelines Docker Amazon Redshift Microservices

Job description

A global financial technology leader is hiring a Principal Data Engineer to join its hybrid engineering team in Waltham, MA. This full-time role focuses on designing and building enterprise-scale, real-time data platforms that power mission-critical financial applications.

This is a highly visible technical leadership opportunity where you’ll drive the architecture and modernization of next-generation streaming data platforms while mentoring engineers and influencing engineering standards across the organization. The team is looking for someone who thrives in complex distributed environments, enjoys solving large-scale performance challenges, and wants to build resilient, cloud-native systems using cutting-edge event streaming technologies.

Requirements

· 8+ years of experience in data engineering, software engineering, or backend platform development

· Expert-level Python development for data processing, automation, and scalable backend applications

· Advanced SQL skills including complex query development, CTEs, window functions, performance tuning, and query optimization

· Extensive experience designing and building scalable ETL/ELT pipelines and distributed data processing systems

· Strong experience with cloud-native data platforms on AWS, including Redshift, S3, Lambda, Glue, and related services

· Experience with Apache Kafka and event-driven data architectures

· Experience building and orchestrating batch and streaming data pipelines using tools such as Airflow, Spark, or Flink

· Strong knowledge of relational databases including PostgreSQL, Oracle, Amazon Redshift, and Aurora, with expertise in schema design and data modeling

· Experience with containerization and Infrastructure as Code using Docker, Kubernetes, Terraform, or CloudFormation

· Experience building CI/CD pipelines and implementing engineering best practices for production data platforms

· Experience implementing monitoring, logging, data quality, and observability solutions across enterprise data environments

· Proven ability to lead technical initiatives, mentor engineers, and collaborate across cross-functional engineering teams

What You Will Be Doing Tech Breakdown

· 40% Real-Time Data Platform & Streaming Engineering

· 30% Cloud Infrastructure, Microservices & Distributed Systems

· 20% Architecture, Technical Leadership & Platform Modernization

· 10% Observability, Performance Optimization & CI/CD

Benefits & conditions

· Dental Benefits

· Vision Benefits

· 401(k) with company match

· Paid Time Off (PTO)

· Paid Holidays

· Paid Parental Leave

· Professional Development Reimbursement

· Hybrid Work Environment

Applicants must be currently authorized to work in the US on a full-time basis now and in the future.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on dejobs.org

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon Sandhya Menon · WWC Europe 2026

2:07 min

Inspecting default bridge architectures and custom Docker networks

Oliver Seitz Oliver Seitz · WWC 2025

1:52 min

Structuring and scaling the backend engineering team

Stefan Lingler Stefan Lingler +1 · Coffee With Developers

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

1:12 min

Choosing TypeScript for complex backend applications

Maximilian Otto Maximilian Otto · WWC 2024

3:05 min

Audience questions on AI agents and pipeline vectorization

Joy Joy · WWC 2024

Videos

See all

Related articles

See all