Databricks Platform Engineer
Role details
Job location
Tech stack
Job description
As a Databricks Platform Engineer within the Infrastructure Business Area, you will focus on the secure, scalable, and reliable operation of Axpo's Databricks platform in the Azure cloud. You'll take a lead role in automating infrastructure, integrating platform capabilities into broader enterprise services, and ensuring robust networking, storage, and governance alignment. You'll collaborate with platform, security, and data teams to provide a high-performing and compliant analytics environment., * Administer and operate Databricks workspaces, jobs, clusters, and Unity Catalog across multiple environments
- Automate infrastructure provisioning and platform operations using Terraform, CI/CD pipelines, and Databricks APIs
- Ensure robust network integration, including secure VNet peering, firewall rules, and private endpoint configurations to protect sensitive data flows
- Support integration of Azure Blob Storage, ensuring efficient, secure data access for both ingestion and analytics use cases
- Contribute to the configuration and troubleshooting of external database connections (e.g., via JDBC) and other downstream system integrations
- Ensure proper access control and identity management using SCIM, AAD, and role-based permissions across workspaces and Unity Catalog
- Support platform observability by implementing and managing telemetry pipelines (Datadog, Grafana, Dragster)
- Collaborate with security teams to ensure compliance with policies and frameworks (e.g., data encryption, audit logging, GDPR)
- Develop foundational knowledge of API Gateway capabilities and support interfacing Databricks workloads with internal or external services
- Contribute to platform documentation, reusable modules, and support runbooks
- Act as a technical reference for platform-related challenges and incidents
Requirements
Do you have experience in Unity?, Do you have a Bachelor's degree?, * A university degree in Computer Science, IT, or a related technical field
- Proven experience operating Databricks in enterprise or cloud-native environments
- Solid hands-on expertise in Azure networking, including VNet integration, firewall configuration, and network security controls
- Familiarity with integrating Databricks with Azure Blob Storage, external databases, and enterprise APIs
- Working knowledge of Azure API Management or similar gateways, and how APIs can be exposed or consumed securely by Databricks
- Proficiency in Terraform, Azure DevOps, and scripting languages like Python or Shell
- Good understanding of authentication, authorization, and identity federation within cloud platforms
- Awareness of cost monitoring and performance tuning within Databricks and Azure services
- Strong communication skills and a collaborative mindset
- Fluent in English
Technologies You'll Work With
- Cloud & Infra: Microsoft Azure, Azure VNet, Private Endpoints, Blob Storage, API Management
- Platform: Databricks, Delta Lake, Unity Catalog, Spark
- IaC & Automation: Terraform, Azure DevOps, Bitbucket/GitHub, CI/CD
- Scripting & Integration: Python, REST APIs, JDBC, SCIM
- Observability: Datadog, Grafana, Dragster
- Other: Docker, Linux, Azure Active Directory
Nice to Have
- Experience with multi-workspace governance and account-level Databricks configurations
- Familiarity with containerized workloads (e.g., AKS, Docker)
- Exposure to regulated environments (e.g., energy, finance)
- Knowledge of orchestration tools such as Airflow or Dagster, Access to the ESI (Enterprise Skills Initiative) program certifica- tion, provides hands-on training for learning and enhancing tech- nical skills and knowledge of Microsoft and Azure technologies.
Benefits & conditions
At our company, we strive to create a culture of continuous learning, personal growth, and international community involvement. We're passionate about providing our employees with the tools and resources they need to succeed, and we're confident that you'll love being part of our team!
-
Working Hours We offer flexible working hours to accommodate your work schedule. 60% on remote and 40% at our offices in Madrid, Torre Europa.
-
Meal allowances You can enjoy delicious meals on us, no matter if you are working remotely or on-site. Option to use it for public transportation or childcare instead.
-
Internet Compensation We cover the cost of your home internet connection, as we un- derstand how essential connectivity is in the modern workplace.