Data Engineer

Spectraforce
Oakland, CA, United States
3 days ago
Apply on leoforce.us
Prepare application

Role details

Contract type
Temporary contract
Employment type
Part-time (≀ 32 hours)
Experience level
Expert
Experience required
5 years minimum
Working hours
Regular working hours
Job source

Tech stack

ADMS (Software) Application Programming Interfaces (APIs) Amazon Web Services Data Analysis Unit Testing Code Review Continuous Integration Information Engineering Extract Transform Load (ETL) Data Systems Distributed Data Store Python (Programming Language)
+19 more
Metadata Meta-Data Management Scrum Methodology Standard Sql Software Engineering SQL Stored Procedures SQL Databases Data Streaming TypeScript Palantir Foundry Git Event Driven Architecture Pyspark Integration Tests Information Technology Spark Streaming Restful APIs Stream Processing Data Pipelines

Job description

We are seeking an experienced Palantir Foundry Data Engineer to design and develop scalable data pipelines, data products, and operational solutions using Palantir Foundry, PySpark, Python, SQL, and TypeScript. The ideal candidate will have strong hands-on experience with Foundry Ontology, real-time/streaming data processing, Contour, APIs, and enterprise data integration. Experience in the Energy & Utilities industry is highly preferred., * Design and develop end-to-end data pipelines using Palantir Foundry, PySpark, Python, and SQL.

  • Build and maintain Foundry Ontology models, including object types, properties, relationships, and actions.
  • Develop real-time and near-real-time streaming pipelines for operational and event-driven data.
  • Build business and integration logic using TypeScript and APIs.
  • Develop analytical workflows and data exploration solutions using Foundry Contour.
  • Convert complex SQL, stored procedures, triggers, ETL mappings, and business rules into scalable Foundry/PySpark solutions.
  • Implement data-quality checks, schema validation, lineage, metadata management, monitoring, and health checks.
  • Design reusable frameworks and optimize pipelines for performance, scalability, and reliability.
  • Follow production-grade engineering practices, including Git, CI/CD, unit testing, integration testing, and code reviews.
  • Collaborate with architects, business SMEs, product owners, and engineering teams in an Agile/Scrum environment.

Requirements

  • Palantir Foundry Core Concepts
  • Foundry Ontology
  • PySpark, Python, and SQL
  • TypeScript
  • Foundry Contour
  • Spark Streaming / Real-Time Data Processing
  • REST APIs and enterprise integrations
  • Data modeling and large-scale ETL/ELT
  • Data quality, metadata, and lineage
  • Git and CI/CD
  • Production-grade software engineering and testing, * 10-15+ years of overall IT/data engineering experience.
  • 5+ years of hands-on data engineering/ETL experience.
  • Strong experience building large-scale, production-grade data solutions.
  • Experience with cloud and distributed data-processing environments.
  • Bachelor’s/Master’s degree or equivalent experience in Computer Science, Engineering, MIS, or a related field., * Palantir Foundry Data Engineer Certification.
  • Experience with Ontology modeling, TypeScript, Contour, Foundry APIs, and streaming architectures.
  • AWS experience is a plus.

Preferred Industry Experience Energy & Utilities domain experience involving the following areas is highly desirable:

  • Outage Management
  • ADMS/OMS
  • Grid Operations
  • ETOR
  • PSPS
  • Customer Communications

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on leoforce.us
Prepare application

Good distractions

Loading talks and stories from around this role…