> Markdown version of [/jobs/ext/2566478-data-engineer-onsite](https://www.wearedevelopers.com/jobs/ext/2566478-data-engineer-onsite). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - Onsite - **Company:** MSYS Inc. - **Location:** Wilmington, DE, United States - **Experience:** Expert - **Contract:** Temporary to permanent - **Skills:** Java (Programming Language), Amazon Web Services, Amazon S3, Big Data, Cloud Computing, Cloud Engineering, Information Engineering, Data Infrastructure, Data Transformation, Distributed Computing Environment, Distributed Data Store, Distributed Systems, Python (Programming Language), Microsoft Message Queuing, Cloud Services, Data Processing, Data Ingestion, Snowflake, Apache Spark, Infrastructure as Code (IaC), Event Driven Architecture, Pyspark, AWS Aurora, Apache Kafka, Data Management, Terraform, Stream Processing, Data Pipelines, AWS EKS, Amazon Elastic Mapreduce (EMR), Service Stack, Databricks - **Published:** August 5, 2026 - **Apply:** https://www.dice.com/job-detail/33d0e536-ba02-49e6-a1c4-e5e965691349 ## About the Role * 5 to 10 years of experience. * Strong experience with Apache Spark (Must Have) * Strong experience with Java (Must Have) * Hands-on experience with AWS Cloud Services (Must Have) * Experience with Terraform for Infrastructure as Code (Must Have) * Experience building data ingestion and data transformation pipelines * Experience working with large-scale distributed data environments * Knowledge of real-time and batch data processing architectures Preferred skills: * Python * Apache Kafka Cloud & Technology Stack: * Apache Spark * Java * AWS EKS * AWS EMR * AWS S3 * AWS Aurora * AWS MSK * AWS SNS * AWS SQS * Apache Kafka * Terraform, * Strong background in data engineering and distributed computing. * Experience handling high-volume data platforms. * Comfortable working in cloud-native, event-driven architectures. * Excellent problem-solving and analytical skills. Must have: * Pyspark * Snowflake * Databricks * AWS ## Description We are seeking a highly skilled Data Engineer to join a team responsible for building and enhancing a large-scale decision platform that drives customer-focused business decisions. The ideal candidate will have strong expertise in Spark, Java, AWS, and large-scale data processing environments., * Design, develop, and optimize scalable data pipelines for ingesting and processing high-volume datasets. * Build and maintain distributed data processing solutions using Apache Spark and Java. * Process and manage 20M+ to 40M+ daily data records efficiently. * Develop batch and real-time data processing workflows. * Work with event-driven architectures and streaming platforms. * Collaborate with cross-functional teams to enhance data platform capabilities. * Implement and manage cloud-native solutions within AWS environments. * Utilize Infrastructure as Code (IaC) methodologies using Terraform. ## Related Videos - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [Hosting a modern justice system](https://www.wearedevelopers.com/videos/332-hosting-a-modern-justice-system) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market) - [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs)