> Markdown version of [/jobs/ext/457315-pyspark-developer](https://www.wearedevelopers.com/jobs/ext/457315-pyspark-developer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # PySpark Developer - **Company:** Rose International - **Location:** Tampa, FL, United States (Remote available) - **Experience:** Expert - **Salary:** $135,200.0 - $156,000.0 - **Contract:** Temporary contract - **Skills:** Query Performance, Third Normal Form, Airflow, BigQuery, Code Review, Databases, Continuous Integration, Directed Acyclic Graph (Directed Graphs), Data Architecture, Information Engineering, Data Governance, Extract Transform Load (ETL), Data Structures, Data Systems, Data Vault Modeling, Data Warehousing, Relational Databases, Software Design Patterns, Distributed Systems, Memory Management, Apache Hadoop, Apache Hive, Python (Programming Language), PostgreSQL, Online Analytical Processing, Online Transaction Processing, Oracle (Applications), SQL Databases, Freeform SQL, Sql Optimization, Snowflake, Database Optimization, Apache Spark, Indexer, Pyspark, Low Latency, Optimization Algorithms, Star Schema, Apache Kafka, Stream Processing, Data Pipelines, Control M - **Published:** June 6, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=ee8f8e945e90c816 ## About the Role Do you have experience in System design?, Do you have a Bachelor's degree?, Must Have Skills/Attributes: Banking/Financial, Data Modeling, ETL, Hadoop, Oracle, PySpark, Spark, SQL Experience Desired: Overall software/data engineering experience (10+ yrs); Operating at a senior, lead, or architectural level within a large enterprise (4-5 yrs); Experience navigating data governance & data quality frameworks in heavily regulated banking field (4+ yrs) Preferred Education: Bachelor's Degree **C2C is not available**, * Bachelor's Degree, * Experience: 10+ years of overall software/data engineering experience, with a minimum of 4-5 years operating at a senior, lead, or architectural level within a large enterprise (financial services experience is highly preferred). * PySpark Mastery: Production-level expertise in Apache Spark using Python (PySpark). Must understand Spark internals (DAGs, shuffling, memory management, and optimization techniques). * Data Modeling: Proven track record of building complex data models from scratch (Star/Snowflake schemas, Data Vault, or 3NF). Experience using data modeling tools (e.g., Erwin, Hackolade, or similar). * Database & SQL: Expert-level proficiency in SQL. Extensive hands-on experience with massive relational databases (e.g., Oracle, PostgreSQL) and modern data warehouses/lakes (e.g., Snowflake, BigQuery, or Hive/Hadoop). * Systems Design: Clear understanding of distributed systems processing, ETL/ELT design patterns, and enterprise data warehousing principles. * Communication: Demonstrated ability to translate complex technical concepts into clear, concise language for non-technical stakeholders and business leaders. Preferred Qualifications/Skills/Experience: * Familiarity with modern orchestration tools (Airflow, Control-M). * Experience with real-time data streaming (Kafka). * Prior experience navigating data governance and data quality frameworks within a heavily regulated banking environment. We are seeking a highly experienced PySpark Developer to lead the design, architecture, and development of mission-critical data pipelines and enterprise data models. * As a senior technical leader, you will bridge the gap between complex business requirements and highly scalable data architecture. * The ideal candidate possesses deep expertise in PySpark, advanced SQL optimization, and enterprise data modeling. * You will not only be a hands-on technical contributor but also serve as an architectural guide, mentoring junior developers, establishing best practices, and ensuring that data solutions are highly performant, resilient, and aligned with Client global technology standards. ## Description * Architecture & Data Modeling: Design and implement robust logical and physical data models for both transactional (OLTP) and analytical (OLAP) workloads. Lead the transition from legacy data structures to modern, scalable cloud/hybrid architectures. * Pipeline Engineering: Architect, build, and deploy highly scalable data pipelines using PySpark to process massive volumes of complex financial data with low latency. * Advanced SQL & Database Optimization: Write, tune, and optimize complex SQL queries. Troubleshoot query performance bottlenecks and implement data partitioning, indexing, and clustering strategies. * Technical Leadership: Serve as a Subject Matter Expert (SME) for the data platform. Review code, establish CI/CD best practices for data engineering, and ensure all design adheres to the overall architectural blueprint. * Stakeholder Collaboration: Partner with product managers, business analysts, and downstream consumers (Data Science and BI teams) to translate complex financial business requirements into technical deliverables. * Risk & Compliance: Appropriately assess risk when architectural decisions are made, demonstrating consideration for the firm's reputation and safeguarding Client data by driving compliance with applicable data governance laws, rules, and regulations. #CT1 * **Only those lawfully authorized to work in the designated country associated with the position will be considered.** * **Please note that all Position start dates and duration are estimates and may be reduced or lengthened based upon a client's business needs and requirements.** ## Related Videos - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Optimizing Discovery: PostgreSQL's Role in Transforming GetYourGuide's Search](https://www.wearedevelopers.com/videos/1647-optimizing-discovery-postgresql-s-role-in-transforming-getyourguide-s-search) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) ## Related Articles - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers) - [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs)