Data Engineer

CLIENT TECHNOLOGY SOLUTIONS LLC
United States
2 days ago
Apply on computerjobs.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours

Tech stack

Application Performance Management Big Data Code Review Python (Programming Language) Operational Databases Standard Sql Software Repository Palantir Foundry Git Pyspark Data Lineage

Job description

  • Hands-on Palantir Foundry experience operating production data pipelines and supporting live reporting products, including incident resolution, recovery and root cause analysis.

Requirements

  • Strong Python, PySpark and SQL skills, with the ability to troubleshoot existing code, implement fixes and optimise processing of large datasets.
  • Practical experience with Code Repositories, Pipeline Builder, Data Connection, Data Lineage, builds, schedules and health checks.
  • Understanding of batch and incremental processing, schema evolution, pipeline dependencies and safe reprocessing. Able to implement completeness, uniqueness and source-to-target reconciliation checks.
  • Working knowledge of the Foundry Ontology, including object types, properties, links and backing datasets, and the ability to trace reporting issues through these dependencies.
  • Experience maintaining Workshop applications and dashboards, including filters, charts and object sets. Able to investigate incorrect results, refresh delays and application performance issues.
  • Understanding of dataset, Ontology and application permissions, including how access controls can affect what different users see in reports.
  • Experience with Git, branching, code review, testing and controlled releases. Able to assess the impact of a change on downstream datasets, Ontology resources and reporting products.
  • Experience working within incident, problem and change management processes. Able to priorities by business impact, explain technical issues clearly and maintain useful support documentation.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on computerjobs.com
Prepare application

Good distractions

Loading talks and stories from around this role…