Senior Software Engineer - Data Acquisition

WEX Inc.
South Portland, ME, United States
about 2 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours
Job source

Tech stack

Java (Programming Language) Artificial Intelligence Audit Trail Software Quality Code Review Computer Programming Data Integration Distributed Systems Python (Programming Language) Modular Design Network Control Performance Tuning
+10 more
Role-Based Access Control DataOps Scala (Programming Language) Software Engineering Data Streaming Data Ingestion Event Driven Architecture Information Technology Data Lineage Software Version Control

Job description

We are looking for a Senior Staff Software Engineer to architect and lead the next evolution of our data acquisition platform. In this role, you will drive the design of a flexible, extensible ingestion framework that supports batch, streaming, and event-driven pipelines, while ensuring data quality, observability, and governance are built in from the start.

This role is ideal for engineers who want to work on foundational platform problems at scale-helping ingest billions of records across diverse systems and powering enterprise-wide analytics, AI, and product experiences.

How You’ll Make An Impact

  • Lead the design and development of scalable, high-throughput data acquisition systems that integrate internal and external data sources across domains.
  • Architect core platform components-such as data routing, transformation orchestration, lineage tracking, and schema evolution-using sound software engineering principles.
  • Implement a modular ingestion framework capable of supporting streaming and batch pipelines with varying latencies and SLAs.
  • Provide technical leadership, mentor engineers, and establish best practices in code quality, performance optimization, testing, and platform observability.
  • Collaborate with domain teams to understand data integration needs and accelerate onboarding through reusable patterns and automation.
  • Partner closely with the Control Plane and DataOps teams to integrate orchestration, lineage, access control, and validation into the core ingestion process.
  • Build and maintain high-performance data acquisition pipelines that integrate with a variety of systems across WEX and third-party vendors.
  • Contribute to the development of a modular ingestion platform that enables reusability, reliability, and observability at scale.
  • Implement core pipeline components such as schema validation, transformation orchestration, error handling, and audit logging.
  • Support batch and streaming ingestion flows, ensuring the platform meets varying latency and volume requirements across business units.
  • Ensure traceability, lineage, and security through integration with control plane and governance systems.
  • Participate in code reviews, design sessions, and incident resolution-promoting high standards for code quality and operational reliability.

Requirements

  • Strong programming skills in Python, Java, Scala, or another systems-focused language.
  • Strong years of experience as a software and data engineer, ideally in high-volume or distributed systems environments.
  • B.Sc. in Computer Science, Engineering, or related technical field; M.Sc. a plus but not required.
  • Experience with data integration and ingestion pipelines-you understand what it means to bring data in from source systems, transform it, and deliver it reliably downstream.
  • Solid grasp of engineering fundamentals, including version control, modular design, testing, and performance tuning.
  • Familiarity with concepts like schema evolution, event-driven architectures, observability, and role-based access control.
  • A collaborative mindset-comfortable working across domains, products, and infrastructure layers.
  • A strong sense of ownership and accountability-you care deeply about building systems that last.

About the company

As WEX continues to scale its Data-as-a-Service (DaaS) platform, the Data Acquisition Team plays a critical role in enabling secure, scalable, and reliable ingestion of data from hundreds of internal systems and external sources.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on arc.dev

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:39 min

Addressing code review surrender and process exploitation

Laura Tacho Laura Tacho · WWC Europe 2026

3:56 min

Leveraging GitOps for AI auditing and instant rollbacks

Jaroslaw Gajewski Jaroslaw Gajewski · WWC Europe 2026

2:00 min

Separating dataset creation from low-level software implementation steps

Jan Zawadzki · WWC 2022

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

56 sec

The hidden costs of delayed peer code reviews

Tim Gilboy Tim Gilboy

1:09 min

Managing enterprise execution with the Operate runtime

Marcin Makowski Marcin Makowski · WWC Europe 2026

Videos

See all

Related articles

See all