Lead AWS Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+39 more
Job description
We are seeking a Lead AWS Data Engineer to design, build, and optimize enterprise-scale cloud data platforms and lakehouse solutions on AWS. This role will focus on developing high-performance data pipelines using PySpark, AWS Glue, S3, Lake Formation, Athena, Apache Iceberg, Redshift, and Aurora. The ideal candidate will combine strong hands-on data engineering expertise with cloud-native architecture, automation, and GitHub-based engineering practices. The position requires technical leadership across data processing, governance, performance optimization, and production-grade data platform delivery.
In this role, you will:
Β· Design and develop scalable batch and streaming data pipelines using AWS Glue, PySpark, S3, and cloud-native data services.
Β· Build modern lakehouse architectures leveraging Amazon S3, AWS Lake Formation, Apache Iceberg, Athena, and Redshift.
Β· Develop data ingestion, transformation, and processing frameworks using PySpark, Glue, Lambda, EMR, Kinesis, and related AWS services.
Β· Design and optimize analytical and transactional data solutions using Redshift and Amazon Aurora, ensuring performance, scalability, and cost efficiency.
Β· Implement data governance capabilities including access controls, metadata management, lineage, data quality, and secure data sharing through Lake Formation.
Β· Develop serverless data processing and integration components using AWS Lambda, APIs, EventBridge, SQS, and SNS where applicable.
Β· Establish CI/CD and Infrastructure-as-Code practices using GitHub, Terraform, CloudFormation, or AWS CDK for repeatable data platform deployments.
Β· Implement GitHub branching, pull request, code review, testing, and release management standards across engineering teams.
Β· Monitor and optimize data pipelines, storage, queries, and compute resources to improve reliability, performance, and FinOps outcomes.
Β· Collaborate with architects, analysts, application teams, and business stakeholders while providing technical guidance and mentoring to data engineers.
Requirements
Β· 8+ years of experience in Data Engineering, Big Data Engineering, Cloud Data Platforms, or enterprise data architecture.
Β· Expert hands-on experience with PySpark, AWS Glue, Amazon S3, AWS Lake Formation, Amazon Athena, and Apache Iceberg.
Β· Strong experience with Amazon Redshift, including data modeling, query optimization, workload management, and performance tuning.
Β· Hands-on experience with Amazon Aurora and strong knowledge of SQL, relational data modeling, and database integration patterns.
Β· Strong Python development skills and experience building scalable ETL/ELT and data processing frameworks on AWS.
Β· Strong experience with GitHub, including branching strategies, pull requests, code reviews, source control, and CI/CD integration.
Β· Working knowledge of AWS Lambda, EMR, Kinesis, Kafka, and real-time or event-driven data processing architectures.
Β· Experience with Terraform, CloudFormation, or AWS CDK for Infrastructure as Code and automated cloud deployments.
Β· Strong understanding of data governance, metadata, lineage, data quality, IAM, security, and cloud cost optimization.
Β· Experience with AWS VPC, IAM/SSO, KMS, networking, containers, and cloud-native architecture is desirable.
Benefits & conditions
The annual salary for this position is between $[133,000- 156,500] depending on experience and other qualifications of the successful candidate.
This position is also eligible for Cognizantβs discretionary annual incentive program, based on performance and subject to the terms of Cognizantβs applicable plans.
Benefits: Cognizant offers the following benefits for this position, subject to applicable eligibility requirements:
Β· Medical/Dental/Vision/Life Insurance
Β· Paid holidays plus Paid Time Off
Β· 401(k) plan and contributions
Β· Long-term/Short-term Disability
Β· Paid Parental Leave
Β· Employee Stock Purchase Plan
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦