> Markdown version of [/jobs/ext/4586354-aws-data-engineering](https://www.wearedevelopers.com/jobs/ext/4586354-aws-data-engineering). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# AWS Data Engineering

- **Company:** Thinking Minds, Inc.
- **Location:** Atlanta, GA, United States
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** A/B Testing, Application Programming Interfaces (APIs), Artificial Intelligence, Airflow, Amazon Web Services, Amazon S3, Code Review, Encodings, Continuous Integration, Information Engineering, Amazon DynamoDB, Identity and Access Management, Python (Programming Language), Operational Databases, Recommender Systems, Standard Sql, Data Streaming, Management of Software Versions, Feature Store, Feature Engineering, Large Language Models, Apache Spark, Generative AI, Pyspark, Templating, AWS Data Analytics, Apache Kafka, Machine Learning Operations, Functional Programming, Amazon Simple Queue Service (SQS), Amazon Redshift
- **Published:** November 5, 2026
- **Apply:** https://www.dice.com/job-detail/cc4eeda1-c1c1-489b-b8c0-63b906da3eb2

## About the Role

Strong ownership of production data platforms, sound architectural judgment, and an ability to translate ambiguous needs into practical designs.

Clear communication, collaborative technical leadership, and a commitment to mentoring, documentation, and engineering quality.

Experience connecting event data, analytics, and production ML workflows while balancing reliability, performance, and cost.

### Key Responsibilities
Build scalable pipelines on AWS using Airflow (MWAA), Glue, Kafka, S3, and Redshift; evolve event schemas, taxonomy, versioning, and migrations.

Establish Data Quality and observability through schema validation, instrumentation testing, anomaly detection, freshness monitoring, completeness checks, and lineage.

Correctly process late-arriving and out-of-order events using lookback reprocessing and idempotent incremental loads.

Develop personalization datasets and feature pipelines, including a batch and low-latency Feature Store using Redshift or S3 to DynamoDB serving patterns.

Support AWS Batch and SageMaker workflows through training datasets, offline evaluation data, and model-output delivery to downstream APIs.

Apply dimensional and event Data Modeling, instrument AI interaction and feedback events, optimize warehouse workloads, and establish code review, testing, CI/CD, documentation, and on-call standards.

### Required Qualifications
8+ years in data engineering, including ownership of production pipelines at scale, with strong SQL and Python skills.

Deep experience with AWS services including S3, Glue, Redshift, DynamoDB, Lambda, and IAM.

Production Apache Airflow experience covering DAG design, dependencies, templating, alerting, and backfills.

Streaming ingestion experience with Kafka, Kinesis, SQS, or comparable technologies, plus product analytics data and observability frameworks.

Experience supporting production ML through feature engineering, training datasets, feature stores, or model-serving data flows.

### Preferred Qualifications
Experience with PySpark or Spark, recommendation systems, embeddings, and Embedding pipelines supporting candidate generation or ranking.

Familiarity with LLM and Generative AI applications, vector stores, retrieval pipelines, evaluation data, and feedback loops.

Exposure to MLOps tooling, model registries, experiment tracking, instrumentation governance, A/B testing, and experiment metric pipelines.

Experience with Iceberg, Delta, Hudi, or Redshift data sharing.