Sr. Python Spark GCP Engineer - Software Engineer 3 - Contingent 215855

• Deploy, configure, and maintain cloud-native platforms using RedHat OpenShift and Google Cloud Platform (GCP).
• Design and develop large-scale data pipelines using Apache Spark.
• Optimize Spark jobs for performance using Kubernetes/OpenShift resource management and auto-scaling.
• Integrate Spark applications with data sources such as Kafka, S3, Cloud Storage, and multiple data sinks including databases and data lakes.
• Build and maintain CI/CD pipelines for Spark applications using tools like GitHub Actions, Sonar, and Harness.
• Monitor Spark job performance, cluster health, and resource utilization using Prometheus, Grafana, and OpenShift tools.
• Troubleshoot and resolve platform, performance, and production issues proactively.
• Ensure data security by implementing RBAC, encryption for data in transit and at rest.
• Collaborate with data scientists, software engineers, and DevOps teams to architect and support production-ready solutions.

• Hands-on experience working with Apache Spark for big data processing.
• Experience with Django development.
• Experience creating and maintaining Conda environments.
• Experience managing containerized environments using OpenShift or Kubernetes.
• Strong programming skills in Python (PySpark); experience with Scala or Java is a plus.
• Hands-on experience with OpenShift administration, including cluster setup, networking, and storage.
• Solid understanding of Docker, Kubernetes concepts (pods, deployments, services, images).
• Experience with distributed systems, cloud platforms (GCP preferred; AWS/Azure acceptable).
• Familiarity with data storage technologies such as S3, HDFS, cloud storage solutions.
• Experience using CI/CD tools, including GitHub Actions, Helm, Harness.
• Strong problem-solving skills with the ability to debug complex distributed systems.
• Bachelor's degree in Computer Science, Engineering, or a related field.

Nice-to-Have Qualifications

• Experience with Scala-based Spark development.
• Knowledge of Shell scripting.
• Experience supporting high-availability production environments.
• Prior experience working in hybrid cloud or multi-cloud environments.

Benefits: Innova Solutions offers benefits( based on eligibility) that include the following: Medical & pharmacy coverage, Dental/vision insurance, 401(k), Health saving account (HSA) and Flexible spending account (FSA), Life Insurance, Pet Insurance, Short term and Long term Disability, Accident & Critical illness coverage, Pre-paid legal & ID theft protection, Sick time, and other types of paid leaves (as required by law), Employee Assistance Program (EAP).

ABOUT INNOVA SOLUTIONS: Founded in 1998 and headquartered in Atlanta, Georgia, Innova Solutions employs approximately 50,000 professionals worldwide and reports an annual revenue approaching $3 Billion. Through our global delivery centers across North America, Asia, and Europe, we deliver strategic technology and business transformation solutions to our clients, enabling them to operate as leaders within their fields. Recent Recognitions: * Named One of America's Best Employers for New Grads by Forbes (2024 * Named One of the Best Companies to Work for by U.S. News & World Report (Private Companies List, 2024-2025) * One of the Largest IT Staffing Firms in the US - Ranked #3 by Staffing Industry Analysts (SIA, 2024) * One of the Largest Staffing Firms in the US - Ranked #13 by Staffing Industry Analysts (SIA, 2024; includes Innova Solutions, Volt, & HireGenics) * Named One of the Top Ten Private Companies in Atlanta by the Atlanta Business Chronicle (2023) * One of the Largest Certified Minority Business Enterprises (MBEs) in the United States (NMSDC, 2024) * AWS Advanced Tier Services Partner with 100+ certifications, employment opportunities. Innova Solutions (HireGenics/Volt) does not discriminate against applicants based on citizenship status, immigration status, or national origin, in accordance with 8 U.S.C. § 1324b. The company will consider for employment qualified applicants with arrest and conviction records in a manner that complies with the San Francisco Fair Chance Ordinance, the Los Angeles Fair Chance Initiative for Hiring Ordinance, and other applicable laws. By applying for this job, you agree to receive calls, AI-generated calls, text messages, or emails from Innova Solutions and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy at Privacy Policy - innovasolutions.