> Markdown version of [/jobs/ext/4700073-lead-aws-data-engineer](https://www.wearedevelopers.com/jobs/ext/4700073-lead-aws-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Lead AWS Data Engineer - **Company:** Capgemini - **Location:** Atlanta, GA, United States - **Experience:** Expert - **Salary:** $89,000 - $120,000 - **Contract:** Permanent contract - **Skills:** Java (Programming Language), Application Programming Interfaces (APIs), Artificial Intelligence, Amazon Web Services, Automation of Tests, Cloud Computing, Code Coverage, Code Generation, Software Quality, Computer Programming, Databases, Data Architecture, Information Engineering, Data Integrity, Extract Transform Load (ETL), Data Retention, Data Synchronization, DevOps, Amazon DynamoDB, Payment Systems, Python (Programming Language), PostgreSQL, Liquibase, Operational Data Store, Performance Tuning, Query Optimization, Redis, Data Streaming, Sql Optimization, Database Optimization, Caching, Change Data Capture, Indexer, AWS ECS, Database Migration, Amazon Relational Database Service, AWS Data Analytics, Real Time Data, Apache Kafka, Software Version Control, Data Pipelines, Sql Tuning - **Published:** November 13, 2026 - **Apply:** https://www.capgemini.com/jobs/593220-en_US_SAPBTP/x/ ## About the Role As the Technical Lead - Data Engineering, you will architect, lead, and drive the technical execution of a high-throughput, near real-time data caching layer supporting Operational Data Store (ODS) views. You will lead the engineering team responsible for ingesting high-frequency account update events (via Kafka/CDC), orchestrating cache refreshes, and designing high-performance PostgreSQL persistence architectures on AWS to guarantee sub-second lookups and rock-solid consistency for downstream consumers. 8+ years in Data Engineering with at least 2+ years in a lead or principal role., · AWS Data Ecosystem: Amazon Aurora PostgreSQL, RDS, and DynamoDB · Experience in Data Modeling (ODS, transactional cache patterns), Partitioning, Indexing strategies, and Data Retention/Archival policies · Caching: Hands-on experience with Amazon Elastic Cache (Redis), including cache design, key and TTL strategies, invalidation patterns and keeping cache data consistent with the source · Programming: Proficient in Java/Python · Streaming & Messaging: Apache Kafka or AWS MSK event consumption and offset management. · Hands-on experience integrating AI-assisted development & testing practices into engineering workflows · Expert-level PostgreSQL / Advanced SQL: (query optimization, execution plan analysis, vacuuming, connection pooling). · Database DevOps: Schema version control using Liquibase or Flyway. · Proven track record with large-scale ETL/ELT pipelines and Change Data Capture (CDC) / stream-based data synchronization. · Financial services, core banking, or payment platforms experience: (ODS familiarity is a strong plus). ## Description · Architecture & Technical Leadership: Define the end-to-end data architecture, data modeling, partitioning, indexing, and retention strategies for high-volume PostgreSQL/Aurora workloads. · Team Guidance & Code Quality: Lead and mentor a team of Senior and Mid-level Data Engineers; establish best practices for SQL performance tuning, database migrations (Liquibase), and CI/CD pipelines. · Caching: Build cache read/write logic in Amazon Elastic Cache (Redis), including key design, TTLs and invalidation handling. · Performance Tuning: Monitor and improve high-throughput read/write queries, lock contention and index overhead. · Real-Time & Batch Pipelines: Architect event-driven ingestion pipelines to consume events from event streams, driving near real-time cache invalidation and refresh mechanisms. · Data Integrity & Reconciliation: Design automated reconciliation frameworks and audit jobs to detect cache drift against source ODS views and guarantee consistency. · AI-Assisted Engineering: Drive adoption of AI-assisted engineering tools (code generation, SQL optimization, test automation) to accelerate delivery and ensure robust test coverage. · Cross-Functional Collaboration: Partner closely with Service Modernization leads, API engineers, enterprise architects, and platform/cloud operations.