Data Engineer 3

TSPi is seeking a Data Engineer III to support the design, development, and maintenance of enterprise data integration solutions and cloud-based analytics infrastructure for federal government clients. This role serves as the technical lead for data engineering activities, including data pipeline development, data integration, metadata management, and analytics environment support.

The Data Engineer III will work closely with systems managers, data scientists, reporting teams, and business stakeholders to build scalable data solutions that enable advanced analytics, reporting, and data-driven decision-making. The successful candidate will be responsible for developing and maintaining cloud-native data pipelines, integrating data from multiple internal and external sources, and ensuring data quality, governance, and security throughout the data lifecycle.

The ideal candidate is an experienced data engineering professional with strong expertise in AWS cloud services, API-based integrations, data transformation, and Agile software development practices. This role is contingent upon award of the project to Abt Global and TSPi.

Responsibilities

• Design, develop, implement, and maintain enterprise data integration pipelines supporting analytics and reporting initiatives
• Develop and optimize cloud-native data solutions using AWS services including AWS Glue, AWS Lambda, Amazon S3, and related technologies
• Build and maintain automated data ingestion processes from system exports, APIs, external data providers, and other structured and semi-structured data sources
• Develop data transformation workflows using Python, R, SQL, and related technologies
• Manage metadata cataloging, schema management, and data governance processes to ensure data quality, integrity, and accessibility
• Support and maintain AWS-hosted analytics environments and associated data infrastructure
• Design, implement, and support API-based integrations, including RESTful services and automated data exchange processes
• Monitor, troubleshoot, and optimize data pipelines and integration processes to ensure reliability and performance
• Track development activities, enhancements, bug fixes, and optimization efforts using Jira or comparable issue-tracking tools
• Collaborate with systems managers, data scientists, quality and reporting teams, and other stakeholders to support data-driven business objectives
• Participate in Agile development activities, including sprint planning, backlog refinement, daily standups, reviews, and retrospectives
• Develop and maintain technical documentation related to data pipelines, integrations, data models, and operational procedures
• Ensure compliance with federal data security, privacy, and governance requirements

Do you have experience in Web services design?, Do you have a Master’s degree?, * Bachelor’s degree in Computer Science, Data Engineering, Information Systems, Software Engineering, related discipline, or equivalent work experience required

• Bachelor’s degree plus 5 years of relevant experience, Master’s degree plus 3 years of relevant experience, or PhD plus 0 years of relevant experience
• Experience designing, developing, and maintaining production-grade ETL/ELT data pipelines
• Experience with Amazon Web Services (AWS), including AWS Glue, AWS Lambda, and Amazon S3
• Experience developing serverless and event-driven data processing architectures
• Strong programming skills in Python and/or R
• Experience integrating data from APIs, web services, and external data providers
• Experience designing and consuming RESTful APIs
• Experience with metadata management, schema design, and data cataloging practices
• Experience with data modeling, database management, and data governance principles
• Experience working with Jira or similar issue tracking and project management tools
• Experience working in Agile development environments
• Strong understanding of data quality, data validation, and data lifecycle management practices
• Strong analytical, troubleshooting, and problem-solving skills
• Excellent written and verbal communication skills
• Strong organizational skills with attention to detail and accountability
• Ability to collaborate effectively across technical and non-technical teams
• Ability to obtain and maintain a federal public trust clearance
• We are unable to provide visa sponsorship for this role.

Preferred Skills & Experience

• Experience supporting large-scale cloud-based analytics environments
• Experience with AWS API Gateway or similar API management platforms
• Experience integrating data from commercial data providers and third-party systems
• Experience supporting federal government, healthcare, benefits administration, or other highly regulated environments
• Experience working with case management, benefits administration, or analogous government data systems
• Experience implementing data governance, security, and compliance controls in cloud environments
• Experience supporting data science, reporting, and business intelligence initiatives
• Experience leading complex data integration or analytics infrastructure projects
• Knowledge of federal data security and privacy requirements