Lead Consultant | Cloud Platform | Google Cloud - Architecture

Ipolarity LLC
Charlotte, NC, United States
16 days ago
Apply on www.careerjet.com
Prepare application

Role details

Contract type
Temporary to permanent
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
8 years minimum
Compensation
$109,616.0 - $114,234.0
Working hours
Regular working hours

Tech stack

Application Programming Interfaces (APIs) Software Design Patterns Python (Programming Language) Meta-Data Management Software Engineering Web Application Frameworks Google Cloud Cloud Platform System Apache Spark Fastapi Build Management Pytest
+3 more
Pyspark Kubernetes Data Pipelines

Job description

  1. Metadata management
  2. Policy enforcement
  3. Semantic modeling
  4. Observability and telemetry
  5. Side effect capability injection GCP Testing Functional testing Behavioral testing Languages Python Frameworks and Platforms FastAPI ARQ Kubernetes Pytest Minimum Years of Experience: 8+ years Certifications Needed: None Top 3 responsibilities you would expect the Subcon to shoulder and execute: Should have good expertise in delivery coordination Should be able to manage complex software application development and support projects Should be able to manage offshore resources also Interview Process (Is face to face required?) Virtual Any additional information you would like to share about the project specs/nature of work: Project Code: Allocation code for HLDI

Requirements

At least 10 years of experience in IT industry. We are seeking a Python-based platform engineer to design and build a containerized API layer that abstracts and governs interactions with Apache Spark through a well-defined API contract. This role focuses on building platform capabilities, not simply consuming existing data tools enabling consistent, secure, and scalable access to Spark-based data pipelines. Should have good hands-on experience in GCP skills. Should be able to interact, coordinate with the client. Should be able to manage offshore resources also. Should be able to work with other onsite team members and client. Tech Skills Python, Pyspark Experience building control planes Design patterns

  1. Modular containerized services
  2. Asynchronous processing
  3. Job-based work queue execution

Benefits & conditions

  • $78.00 per hour

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerjet.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

1:34 min

Pivoting careers into specialized platform engineering roles

Xavier Portilla Edo · LIVE

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

3:33 min

Connecting frontends via a FastAPI proxy backend layer

Saoussen Chaabnia Saoussen Chaabnia · Europe 2026 Virtual

3:05 min

Tagging and organizing execution scenarios with pytest markers

Florian Bruhin · World Congress 2021

2:14 min

Solving complex platform architecture challenges at an enterprise scale

Maria Apazoglou · Coffee With Developers

3:37 min

Scaling machine learning pipelines from prototypes to petabytes

Julian Joseph · LIVE

Videos

See all

Related articles

See all