> Markdown version of [/jobs/ext/658923-aws-data-engineer](https://www.wearedevelopers.com/jobs/ext/658923-aws-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# AWS Data Engineer

- **Company:** Purple Drive Technologies LLC
- **Location:** Charlotte, NC, United States
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Amazon Web Services, Amazon S3, Data Analysis, Cloud Database, Cloud Engineering, Data Governance, Data Integrity, Extract Transform Load (ETL), Data Transformation, Data Security, DevOps, Fraud Prevention and Detection, Python (Programming Language), Enterprise Messaging Systems, Meta-Data Management, Performance Tuning, E2e Testing, Cloud Services, Data Streaming, Amazon Connect, Parquet, AWS Lambda, Servicebus, Event Driven Architecture, Pyspark, Infrastructure Automation Frameworks, Deployment Automation, AWS Glue, Data Analytics, AWS Data Analytics, Apache Kafka, Terraform, Stream Processing, Data Pipelines
- **Published:** June 26, 2026
- **Apply:** https://www.dice.com/job-detail/51111654-35cb-4ad5-b63f-89f3d3569a2e

## About the Role

* Strong proficiency in:
 + Python
 + PySpark
 * Experience developing:
 + ETL/ELT Pipelines
 + Data Transformation Workflows
 + Real-Time Data Processing
 * Hands-on experience with:
 + Parquet File Format
 + Glue Crawlers
 + AWS Glue Data Catalog

Streaming & Event-Driven Architecture

 * Experience with:
 + Event-Driven Architecture
 + Publish/Subscribe (Pub/Sub) Models
 + Apache Kafka
 + Amazon EventBridge
 + Kinesis Data Streams
 + Kinesis Firehose

DevOps & Infrastructure

 * Hands-on experience with:
 + Terraform (Infrastructure as Code)
 + CI/CD Pipelines
 + Cloud Automation
 * Experience deploying and managing AWS infrastructure

Data Analytics & Security

 * Experience using:
 + Amazon Athena
 + AWS Glue Catalog
 + Amazon Macie
 * Strong understanding of:
 + Data Governance
 + Data Security
 + Data Integrity
 + Performance Optimization, * Experience in fraud detection or financial services platforms
 * AWS Certifications (Solutions Architect, Data Engineer, or Developer Associate)
 * Experience with:
 + Lakehouse Architectures
 + Streaming Analytics
 + Cloud-Native Data Platforms
 * Knowledge of DevOps best practices and Infrastructure Automation

## Description

+ AWS Lambda
 + Amazon S3
 + Amazon EventBridge
 + Amazon Kinesis (Data Streams & Firehose)
 + AWS Glue (ETL & Crawlers)
 + AWS Step Functions
 + Amazon Athena
 + Amazon Connect
 + Amazon Macie
 * Experience designing and implementing AWS Data Lake architectures, * Design and implement scalable AWS-based data engineering solutions
 * Develop real-time event-driven architectures using EventBridge, Kafka, and Kinesis
 * Build and optimize ETL pipelines using AWS Glue, Python, and PySpark
 * Configure and manage AWS Glue Crawlers for automated schema discovery and metadata management
 * Design and maintain data lakes using Amazon S3, Parquet, Glue Catalog, and Athena
 * Develop integrations between Customer Profiles, messaging platforms, and downstream systems
 * Build automated workflows using AWS Step Functions
 * Provision and manage AWS infrastructure using Terraform
 * Implement CI/CD pipelines for automated deployment and infrastructure management
 * Perform end-to-end testing, monitoring, troubleshooting, and performance tuning
 * Optimize cloud architecture for scalability, reliability, cost efficiency, and security
 * Maintain technical documentation, architecture diagrams, and operational runbooks


## Related Videos

- [Parquet, Delta, Iceberg & Ducklake - An introduction for developers](https://www.wearedevelopers.com/videos/100075-parquet-delta-iceberg-ducklake-an-introduction-for-developers)
- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology)
- [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform)
- [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning)
- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)

## Related Articles

- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Dev Digest 162: AI careers, MCP, AWS best practices & floppy sweaters](https://www.wearedevelopers.com/magazine/571-dev-digest-162-ai-careers-mcp-aws-best-practices-floppy-sweaters)
- [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)