> Markdown version of [/jobs/ext/139198-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/139198-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Data Engineer

- **Company:** VeeRteq Solutions Inc
- **Location:** United States (Remote available)
- **Experience:** Expert
- **Contract:** Temporary contract
- **Skills:** Amazon Web Services, Amazon S3, Apache HTTP Server, Information Engineering, Data Infrastructure, Extract Transform Load (ETL), Data Warehousing, Amazon DynamoDB, Python (Programming Language), Metadata, SQL Databases, Data Streaming, Parquet, AWS Cdk, Data Processing, Apache Spark, AWS Lambda, Cloudformation, Build Management, Pyspark, Information Technology, Avro, AWS Glue, Data Analytics, Integration Frameworks, Data Pipelines
- **Published:** May 29, 2026
- **Apply:** https://www.indeed.com/viewjob?jk=e5bdaa12fae92021

## About the Role

Do you have experience in Spark implementation?, Must-have: Strong Glue, ETL, and Spark skills; experience with Iceberg; ability to work with both batch and real-time or streaming ingestion; familiarity with Kinesis and/or MSK; and understanding of Redshift and data warehouse patterns.
Nice-to-have: Working knowledge of DynamoDB for metadata-related use cases, broader awareness of AWS streaming options, and prototype-building capability to support architecture validation., 5-7 years in data engineering or ETL/ELT development

Experience with large-scale streaming and batch data processing

Experience in manufacturing or industrial data environments preferred

Technical Skills (AWS Services, would consider competitive alternatives)

AWS Glue (ETL, Spark, Iceberg), AWS Step Functions, AWS Lambda

Amazon S3 (partitioning, lifecycle management)

Amazon DynamoDB (metadata/state)

AWS CDK / CloudFormation

Programming: Python, PySpark, SQL

Soft Skills

Strong problem-solving and analytical skills

Ability to work collaboratively with architects and customer teams

Experience in agile environments

AWS Certifications (Nice to have)

AWS Certified Data Analytics - Specialty

## Description

We are seeking a Senior Data Engineer to design and build the data pipelines, data products, and integration flows. This role involves hands-on pipeline architecture, data quality validation, and building the foundational data products that enable the Industrial Data Mesh., Technical Leadership

Design and architect batch and streaming data pipelines for industrial data

Define data product schemas, contracts, and quality validation rules

Implement data integration patterns (CDC, event-driven, pub/sub) across OT and IT systems

Design schema evolution strategies using Avro, Parquet, and Apache Iceberg

Optimize pipeline performance and cost efficiency

Customer Engagement

Collaborate with data teams to understand existing data flows

Support data domain workshops with technical pipeline feasibility input

Present pipeline design recommendations to customer engineering teams

Solution Development

Build production-ready data pipelines on AWS infrastructure

Implement data quality validation and enrichment at ingestion


## Related Videos

- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [From event streaming to event sourcing 101](https://www.wearedevelopers.com/videos/91-from-event-streaming-to-event-sourcing-101)
- [Building Reliable Serverless Applications with AWS CDK and Testing](https://www.wearedevelopers.com/videos/812-building-reliable-serverless-applications-with-aws-cdk-and-testing)
- [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning)
- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)

## Related Articles

- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs)
- [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk)