Python / PySpark (Mainframe Modernization)

Everforth Apex
San Francisco, United States of America
yesterday

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

San Francisco, United States of America

Tech stack

Java
API
Airflow
Amazon Web Services (AWS)
Amazon Web Services (AWS)
CA Workload Automation Ae
Azure
Big Data
Cloud Engineering
Code Review
Continuous Integration
Data Integration
ETL
Oracle Exadata
Github
Hadoop
Hadoop Distributed File System
Hive
Python
Mainframes
Microsoft SQL Server
Scrum
Cloudera
Scala
Software Engineering
SQL Databases
Data Streaming
Unstructured Data
React
Flask
Spark
Backend
GIT
FastAPI
Containerization
Data Lake
Angular
PySpark
Kubernetes
Amazon Web Services (AWS)
Kafka
Front End Software Development
Virtual Agents
Cloudwatch
Jenkins
Redshift
Databricks

Job description

We are seeking a Senior Software Engineer with backend expertise to join a Scrum-based delivery team modernizing a mission-critical financial system. This role is heavily backend-focused, with an emphasis on Python and PySpark, while also contributing to frontend development using React and Angular as needed. This individual will serve as a technical subject matter expert, guiding a team that is upskilling from mainframe technologies. The position requires mentorship, technical guidance, and communication skills to work with Product Owners, Lines of Business, and Operations teams., * Design, develop, and modernize backend services to replace legacy mainframe functionality on a distributed platform.

  • Build and maintain data ingestion, validation, and transformation pipelines using Python and PySpark.
  • Develop and support APIs using FastAPI and/or Flask.
  • Collaborate within a Scrum team, partnering closely with Product Owners and stakeholders.
  • Act as a Python SME, mentoring engineers transitioning from mainframe technologies.
  • Contribute to frontend development using React and Angular when required.
  • Ensure data accuracy and integrity for financial feeds flowing into general ledger systems.
  • Participate in technical design discussions, code reviews, and architecture decisions.
  • Communicate effectively through documentation, presentations, and stakeholder discussions.
  • Support CI/CD pipelines and cloud-native deployments using containerized platforms.

Requirements

  • 7+ years of relevant professional software engineering experience.
  • Strong expertise in Python, with production experience using PySpark.
  • Backend experience with FastAPI and/or Flask.
  • Frontend experience with React and/or Angular.
  • Experience with SQL Server and/or Exadata.
  • Hands-on experience with Kafka or other streaming platforms.
  • Experience working in Agile / Scrum delivery models.
  • Strong communication, presentation, and stakeholder engagement skills.
  • Ability to guide and mentor other engineers as a senior technical contributor.

Preferred Qualifications

  • Agentic AI frameworks: LangGraph, LangChain, A2A.
  • Programming Languages: Java, Scala, SQL, HiveQL.
  • Big Data Technologies: Hadoop, Spark, HDFS, Hive, Cloudera, Hortonworks.
  • Cloud Platforms: AWS (Glue, Lambda, Redshift, S3, CloudWatch).
  • ETL / ELT Tools: AWS Glue, PySpark, Databricks.
  • Data Integration & Migration: Hadoop ecosystems, Kafka, real-time streaming, data lakes.
  • Data Modeling: dimensional models, structured and unstructured data processing.
  • CI/CD & Automation: GitHub Actions, Azure DevOps, Jenkins, Git, Autosys, Airflow.
  • Containerization & Orchestration: Kubernetes.
  • Experience in financial institutions or enterprise accounting environments.

About the company

Everforth Apex is a world-class IT services company that serves thousands of clients across the globe. When you join Everforth Apex, you become part of a team that values innovation, collaboration, and continuous learning. We offer quality career resources, training, certifications, development opportunities, and a comprehensive benefits package. Our commitment to excellence is reflected in many awards, including ClearlyRated's Best of Staffing in Talent Satisfaction in the United States and Great Place to Work in the United Kingdom and Mexico. Everforth Apex uses a virtual recruiter as part of the application process. Click for more details.

Apply for this position