> Markdown version of [/jobs/ext/1799118-senior-data-engineer-spark-etl-contract](https://www.wearedevelopers.com/jobs/ext/1799118-senior-data-engineer-spark-etl-contract). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Data Engineer (Spark & ETL) (contract) - **Company:** Wells Fargo - **Location:** Minneapolis, MN, United States (Remote available) - **Experience:** Expert - **Contract:** Temporary contract - **Skills:** Amazon Web Services, CA Workload Automation Ae, Microsoft Azure, Big Data, Code Review, Information Engineering, Data Integrity, Extract Transform Load (ETL), Data Warehousing, DevOps, Dimensional Modeling, Apache Hadoop, Job Scheduling, Performance Tuning, Shell Script, Software Deployment, Software Engineering, SQL Stored Procedures, SQL Databases, Scripting, Real Time Systems, Snowflake, Apache Spark, Git, Data Lakes, Pyspark, Software Version Control, Data Pipelines, Databricks - **Published:** July 31, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=6850350b918febb4 ## About the Role In this contingent resource assignment, you may: Consult on complex initiatives with broad impact and large-scale planning for Software Engineering. Review and analyze complex multi-faceted, larger scale or longer-term Software Engineering challenges that require in-depth evaluation of multiple factors including intangibles or unprecedented factors. Contribute to the resolution of complex and multi-faceted situations requiring solid understanding of the function, policies, procedures, and compliance requirements that meet deliverables. Strategically collaborate and consult with client personnel. Required Qualifications: Software Engineering experience, or equivalent demonstrated through one or a combination of the following: work or consulting experience, training, military experience, education., * Applicants must be authorized to work for ANY employer in the U.S. This position is not eligible for visa sponsorship. * Experience in ETL/Data Engineering development. * Strong hands-on experience with ETL tools and frameworks. * Extensive experience in Apache Spark (PySpark/Scala) for large-scale data processing. * Strong expertise in pipeline orchestration and workflow management. * Hands-on experience with AutoSys scheduling and job dependency management. * Strong scripting skills in Unix/Linux Shell scripting. * Advanced proficiency in SQL, including: o Complex query development o Performance tuning o Data modeling o Stored procedures and functions * Strong understanding of data warehousing concepts and dimensional modeling. * Experience working in Linux/Unix environments. * Knowledge of source control tools such as Git. Preferred Skills * Experience with cloud platforms such as AWS, Azure, or GCP. * Knowledge of Hadoop ecosystem technologies. * Experience with CI/CD pipelines and DevOps practices. * Familiarity with Snowflake, Databricks, or modern data lake architectures. * Exposure to Informatica or other ETL tools is a plus. ## Description * Design, develop, and maintain ETL/ELT processes to ingest, transform, and load large-scale data efficiently. * Build and optimize data pipelines using Apache Spark (PySpark/Scala Spark). * Develop and maintain end-to-end data orchestration workflows for batch and near real-time processing. * Configure, monitor, and troubleshoot job scheduling and dependency management using AutoSys or similar enterprise schedulers. * Develop automation solutions using Shell scripting for operational and deployment activities. * Write complex and optimized SQL queries, stored procedures, and performance tuning scripts. * Analyse data quality issues and implement validation frameworks to ensure data integrity. * Collaborate with business stakeholders, architects, and development teams to understand data requirements and deliver scalable solutions. * Support production deployments, troubleshoot incidents, and perform root cause analysis. * Participate in code reviews ## Related Videos - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) ## Related Articles - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Is Software Engineering Over-Saturated?](https://www.wearedevelopers.com/magazine/418-is-software-engineering-over-saturated) - [How Much FAANG Companies Actually Pay Software Engineers in 2025](https://www.wearedevelopers.com/magazine/230-how-much-faang-companies-actually-pay-software-engineers-in-2025)