> Markdown version of [/jobs/ext/176562-data-engineer-senior-level-aws-streaming](https://www.wearedevelopers.com/jobs/ext/176562-data-engineer-senior-level-aws-streaming). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Data Engineer (Senior Level) - AWS & Streaming

- **Company:** TUPPL Technology Inc
- **Location:** Austin, TX, United States
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Amazon Web Services, Profiling, Data Validation, Information Engineering, Data Governance, Data Integrity, Extract Transform Load (ETL), DevOps, Distributed Computing Environment, Python (Programming Language), Cloud Services, SQL Databases, Data Streaming, Data Processing, AWS Lambda, Cloudformation, Data Lakes, Pyspark, Apache Flink, AWS Glue, Apache Kafka, Data Management, Terraform, Stream Processing, Data Pipelines
- **Published:** May 29, 2026
- **Apply:** https://www.dice.com/job-detail/b6110e87-aa87-40fd-aded-367a6d0bad1d

## About the Role

* Strong hands-on experience with Python and PySpark

 * Proven expertise in AWS Glue, Lambda, and other cloud-native data services

 * Solid experience with the Kafka ecosystem (topics, partitions, consumer groups, streaming patterns)

 * Demonstrated experience building and supporting data quality frameworks (validation rules, reconciliation checks, profiling, anomaly detection)

 * Strong understanding of distributed data processing and scalable architecture patterns

Good-to-Have Skills:

 * Experience with Apache Flink for real-time stream processing and stateful computations

 * Knowledge of KSQL or other streaming SQL engines

 * Exposure to CI/CD pipelines, IaC (Terraform/CloudFormation), and DevOps practices

 * Familiarity with data lake/lakehouse architectures and table formats such as Iceberg, Delta, or Hudi

 * Experience working in enterprise or financial data environments

## Description

We are seeking a Mid-Senior Data Engineer with strong expertise in AWS-based data engineering, real-time streaming technologies, and enterprise-grade data quality frameworks. The ideal candidate will design, build, and optimize scalable batch and streaming data pipelines, implement robust data validation and monitoring processes, and support mission-critical analytics platforms., * Develop and maintain scalable ETL/ELT pipelines using AWS Glue, PySpark, and Python

 * Build event-driven workflows using AWS Lambda

 * Design and manage real-time streaming solutions using Kafka, KSQL, and Apache Flink

 * Implement and enforce comprehensive data quality frameworks, including validation, profiling, monitoring, and reconciliation

 * Optimize data processing performance, scalability, reliability, and cost in cloud environments

 * Collaborate with cross-functional teams to deliver reliable, production-grade data platforms and ensure data integrity across the pipeline


## Related Videos

- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology)
- [How we built an AI-powered code reviewer in 80 hours](https://www.wearedevelopers.com/videos/1511-how-we-built-an-ai-powered-code-reviewer-in-80-hours)
- [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform)
- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)
- [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning)

## Related Articles

- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk)
- [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)