Data Engineer - INTL India
Role details
Job location
Tech stack
Job description
As a Data Engineer, you'll play a crucial role in ensuring seamless data flow within Foundry. You'll work closely with cross-functional teams to design, implement, and maintain robust data pipelines.Your expertise will contribute to the success of our organization's data-driven initiatives. As a Data Engineer you will be involved in Business requirements, problem statements and developing end-to-end solutions using Palantir. Incumbent will play a paramount role in transforming the Organization on Palantir. This role is not limited to only Data Engineer as it also demands exciting responsibilities of Business analyst.
Secure, scalable, and resilient integration of diverse data sources.
Leverage 200 data connectors using an extensible plugin-based paradigm.
Configure flexible ingress topology (agent-based, REST, JDBC, etc.).
API Integration: Integrating Palantir with other systems and applications using APIs for seamless data flow.
Handle multi-modal data (structured, unstructured, streaming, IoT, geospatial).
Treat data like code (versioning, branching, full change management).2. Data Transformation:
Implement low-code/no-code transformations using tools like Preparation and Contour.
Should have knowledge of Typescript, AIP Natural Language.
Ensure full provenance through the Job Spec paradigm.
Machine Learning and AI: Familiarity with integrating machine learning and AI capabilities within the Palantir environment for advanced analytics.3. Pipeline Orchestration:
Design and manage data pipelines using Pipeline Builder and code repositories.
Generate applications using Workshop or Slate.4. Ontology Management:
Create and manage ontology objects.
Analyze data using tools like Code Workbook, Contour, and Quiver.
Requirements
Bsc IT, IT, or any relevant stream, Relevant Experience: 2-8 yrs in Data Engineering.
2 years+ of Palantir experience
Knowledge of cybersecurity principles and ensuring data privacy and security while working with sensitive information.
Certifications such as Foundry Application Developer, Foundry Data Analyst, or Foundry
Proficiency in data modeling, ETL processes, and data governance
Experience with relational databases (Oracle/SQL Server) & Python working knowledge.
Strong problem-solving skills and attention to detail.
Excellent written & verbal communication skills.
Ready to work permanently in the 2nd shift (12:30 pm to 9:00 PM) to get 3-4 hours to coordinate with US Office. This role demands work from the office. However, four WFH days given in a Month. International Travelling: Candidate having US Business Visa B1/B2 is a plus for occasional visit as per business case.