Data Engineer - AI Platform Engineer
Ebury
Municipality of Madrid, Spain
yesterday
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English, SpanishJob location
Municipality of Madrid, Spain
Tech stack
Artificial Intelligence
Audit Trail
Google BigQuery
Data Governance
Data Infrastructure
Data Transformation
Data Security
Data Warehousing
Python
Metadata
Automated Data Processing (ADP)
Large Language Models
AI Platforms
Api Design
Job description
- Design and deliver core components of the ADP, including agent-to-agent (A2A) communication, the Agent Tool Registry, and governed data access layers.
- Build platform primitives for secure tool use coordination, including "on behalf of" (OBO) patterns, centralized policy guardrails, and audit logging with full replayability.
- Provide end-to-end observability for agentic products: data dependencies, traces, evaluation signals, and accountability as a day-one requirement.
- Integrate the ADP with the Data Platform's governed foundations - catalog, metadata, data warehouse, and vector retrieval.
- Collaborate with domain teams to onboard pilot agents and help them adopt platform standards and runtime patterns.
- Drive innovation and explore emerging technologies (LLM evaluation, prompt safety, agent memory) to enhance our AI platform capabilities.
Requirements
- Self-motivation and curiosity, with a desire to learn and grow in a fast-paced environment.
- Platform engineering experience building internal platforms consumed by other engineering teams.
- Strong software engineering fundamentals: API design, reliability, testing, and operability.
- Experience building secure systems - authentication/authorization, audit logs, least-privilege access, and governance controls.
- Hands-on experience operating production services on GCP (Vertex AI, BigQuery, Cloud Run, Cloud Functions).
- Proficiency in Python for building platform services, data transformation, and tooling.
- Experience with agentic or LLM-based systems in production (evaluation, drift monitoring, prompt safety) is a strong plus.
- Familiarity with data governance concepts - lineage, traceability, access controls - and data platform ecosystems is encouraged.
- Fluency in English (Spanish a plus).
Benefits & conditions
- Competitive salary and benefits package.
- Discretionary bonus based on performance.
- Continued personal development through training and certification.
- Open-source friendly culture, encouraging contributions to external projects.