> Markdown version of [/jobs/ext/3038696-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/3038696-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Data Engineer

- **Company:** Patton Labs Inc.
- **Location:** Wixom, MI, United States
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Amazon Web Services, Amazon S3, JIRA, Extract Transform Load (ETL), Data Transformation, Data Migration, IBM DB2, Eclipse (Software), Apache Hive, Python (Programming Language), PostgreSQL, Scala (Programming Language), SQL Databases, Teradata SQL, Visual Studio Online, Snowflake, Apache Spark, Git, Database Migration, Pyspark, Data Pipelines, Jenkins, Amazon Redshift, Databricks
- **Published:** September 23, 2026
- **Apply:** https://jobs.mitalent.org/job-seeker/job-details/JobCode/410241574

## About the Role

Related experience must include a minimum of 1 year of experience working with at least 3 of the following: AWS S3, Python, Scala, Spark, Spark SQL, AWS Athena, PostgreSQL, AWS Redshift, Databricks, Stonebranch, Snowflake, Eclipse, VS Code, Jira, Jenkins, Teradata, DB2, or GIT., AWS Athena, PostgreSQL, AWS Redshift, Databricks, Stonebranch, Snowflake, Eclipse, VS Code, Jira, Jenkins, Teradata, DB2, and GIT. Worksite: Relocation for short/long term projects to client sites at varying unanticipated locations throughout the US required. Master's degree plus 2 years of experience required.

## Description

Design and implement scalable ETL frameworks to ingest, transform, and extract data from various source systems into Hive, PostgreSQL, and Redshift, generating business-driven extracts. Develop automated data ingestion pipelines for processing different file types (TXT, CSV) from AWS S3, dynamically loading them into Hive, PostgreSQL, Redshift, and Databricks based on project requirements. Lead database migration efforts, migrating SQL databases to AWS Redshift, leveraging Apache Spark for data transformation and AWS Athena for efficient querying of S3-stored data. Implement Type-1 and Type-2 Slowly Changing Dimensions (SCD) in ETL pipelines, ensuring historical data accuracy and compliance by handling overwrites (Type-1) and preserving versioned records (Type-2). Design and develop Spark-based ETL pipelines to migrate data from AWS Redshift to Databricks, applying complex transformations using PySpark/Scala and optimizing job performance. Work with AWS S3, Python, Scala, Spark, Spark SQL


## Related Videos

- [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology)
- [The Road to MLOps: How Verivox Transitioned to AWS](https://www.wearedevelopers.com/videos/1050-the-road-to-mlops-how-verivox-transitioned-to-aws)
- [Improving quality with Agentic AI with Rovo Dev and Xray](https://www.wearedevelopers.com/videos/2005-improving-quality-with-agentic-ai-with-rovo-dev-and-xray)
- [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94)
- [Integrate your Cognitive Assistant with 3rd-party DBs and software](https://www.wearedevelopers.com/videos/249-integrate-your-cognitive-assistant-with-3rd-party-dbs-and-software)
- [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering)

## Related Articles

- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries)
- [Best Coding Boot Camps in Germany](https://www.wearedevelopers.com/magazine/237-best-coding-boot-camps-in-germany)