Palantir Data Engineer

Algo Soft Solutions LLC

Kansas City, United States of America

3 days ago

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Working hours

Regular working hours

Languages

English

Kansas City, United States of America

Big Data

Code Reuse

Information Engineering

ETL

Data Transformation

Distributed Systems

Python

NumPy

Performance Tuning

DataOps

SQL Databases

Unstructured Data

Data Processing

Spark

Parallel Computation

Pandas

PySpark

Data Pipelines

Data Processing & Automation: Ability to clean, transform, and process large datasets efficiently.
Integration with Palantir Foundry: Build custom Python functions and libraries to extend Foundry's capabilities.
Pipeline Development: Write modular, reusable code for ETL workflows and data transformations.
Performance Optimization: Use Python libraries like Pandas, NumPy, and PySpark for scalable data operations.
Familiarity with SQL for querying and data modeling.
Data Engineering Fundamentals
Building ETL pipelines for ingestion and transformation.
Designing data models and optimizing workflows.
Handling structured and unstructured data.
Big Data & Distributed Systems
Experience with Spark (PySpark) for scalable data processing.
Understanding parallel computing and performance tuning.