Senior Data Engineer (Python)

Parser Limited
11 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English

Job location

Tech stack

API
Artificial Intelligence
Airflow
Azure
Cloud Computing
Databases
ETL
Python
Oracle Applications
Parsing
SQL Databases
Data Streaming
Unstructured Data
Data Ingestion
Large Language Models
Snowflake
Multi-Agent Systems
Prompt Engineering
Spark
Kubernetes
Kafka
Data Management
Databricks

Job description

We are seeking strong Data Engineers to help design and build next-generation AI-driven data products and investment intelligence platforms. This role sits at the foundation of new AI initiatives, where you will own and shape the data ingestion, ETL, AI-generated dashboards, and multi-agent analytical systems used by investment clients in the UAE and beyond., * Ingest structured and unstructured data from APIs, Snowflake, Oracle, documents, and market data providers

  • Develop production-quality Python services and data workflows
  • Orchestrate pipelines using Kubernetes and workflow tools
  • Apply clean architecture and strong engineering design patterns
  • Ensure data quality, reliability, and security
  • Design schemas and transformation layers for analytics and AI agents
  • Prepare data for AI and RAG systems (chunking, embeddings, retrieval pipelines)

Requirements

Do you have experience in Spark?, Do you have a Master's degree?, * Strong Python (advanced, production-grade)

  • Advanced SQL
  • ETL/ELT pipeline design and orchestration (Airflow, ADF, Databricks or similar)
  • Experience with RAG systems, embeddings, and vector databases
  • Hands-on experience with Cloud providers (Microsoft Azure desired)
  • Document parsing and unstructured data processing
  • Experience with data lakehouse architectures
  • API and database integrations
  • Kubernetes-based workloads

Nice to Have Experience:

  • Experience with Snowflake and Oracle
  • Streaming systems (Kafka, Event Hubs)
  • Data Lakehouse architectures
  • LLM evaluation and prompt engineering
  • Experience building AI or data platforms

Benefits & conditions

  • The chance to join an organization with triple-digit growth that is changing the paradigm on how software products are built.
  • The opportunity to form part of an amazing, multicultural community of tech experts.
  • A highly competitive compensation package.
  • Medical insurance.

Come and join our #ParserCommunity.

Apply for this position