Lead Data Platform Engineer (Marzán)

Luxoft Spain
El Lloar, Spain
2 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Intermediate

Job location

El Lloar, Spain

Tech stack

Artificial Intelligence
Amazon Web Services (AWS)
Azure
Big Data
Information Engineering
Data Infrastructure
ETL
Data Systems
Distributed Systems
Python
Search Technologies
Retrieval-Augmented Generation
System Availability
PySpark
Data Management

Job description

Role DescriptionWe are seeking an expert with deep proficiency as a Palantir Platform Engineer, possessing experience in data engineering and designing, building, and operationalizing AI-powered workflows, agents, and applications that drive tangible business outcomes. The ideal candidate is a self-starter, able to translate complex business needs into scalable technical solutions, and confident working directly with stakeholders to maximize the value of Foundry and AIP.ResponsibilitiesManage and optimize Palantir data platform.Ensure high availability, security, and performance of data systems.Provide valuable insights about data platforms usage.Optimize computing and storage for large-scale data processing.Design and maintain system libraries (Python) used in ETL pipelines and platform governance.Optimize ETL processes - enhance and tune existing ETL processes for better performance, scalability, and reliability.Support the design and deployment of AIP use cases such as copilots, retrieval workflows, and decision-support agents.Ground agents and logic flows using RAG (retrieval-augmented generation) by connecting to relevant data sources, embedding/vector search, ontology content.Use Ontology-Augmented Generation (OAG) when needed: operational decision-making where logic, data, actions and relationships are embedded in the Ontology.Collaborate with senior engineers on agent design, instructions, and evaluation using AIP's native features.SkillsMinimum 10 years of experience in IT/Data.Minimum 5 years of experience as a Data Platform Engineer/Data Engineer.Minimum 3 years of experience with Palantir Foundry.Practical experience using or supporting AIP features such as RAG workflows, copilots, or agent-based applications.Bachelor's in IT or related field.Infrastructure & Cloud: Azure, AWS (expertise in storage, networking, compute).Proficiency in PySpark for distributed computing.#J-*****-Ljbffr

Requirements

Minimum 10 years of experience in IT/Data. Minimum 5 years of experience as a Data Platform Engineer/Data Engineer. Minimum 3 years of experience with Palantir Foundry. Practical experience using or supporting AIP features such as RAG workflows, copilots, or agent-based applications. Bachelor's in IT or related field. Infrastructure & Cloud: Azure, AWS (expertise in storage, networking, compute). Proficiency in PySpark for distributed computing. #J-*****-Ljbffr

Apply for this position