> Markdown version of [/jobs/ext/4634-senior-technical-architect-databricks](https://www.wearedevelopers.com/jobs/ext/4634-senior-technical-architect-databricks). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Technical Architect - Databricks - **Company:** Quantiphi - **Location:** Amsterdam, Netherlands (Remote available) - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Airflow, Amazon Web Services, Amazon S3, Cloud Engineering, Databases, Continuous Integration, Data Dictionary, Data Discovery, Data Integration, Extract Transform Load (ETL), Data Warehousing, Github, Python (Programming Language), Meta-Data Management, Metadata Repositories, Microsoft SQL Server, MySQL, NoSQL, Query Optimization, SQL Databases, Multi-Cloud, Data Lakes, Pyspark, Infrastructure Automation Frameworks, Data Lineage, Terraform, Data Pipelines, Databricks, Oracledb - **Published:** May 14, 2026 - **Apply:** https://nl.indeed.com/viewjob?jk=347f5603ac27c5a7 ## About the Role Do you have experience in Terraform?, * Experience: 12+ years of relevant experience in building cloud-native, hybrid, or multi-cloud solutions including Dababricks and AWS. * Experience with Databricks implementations - developing data pipelines using PySpark. * Experience in Databricks Workspaces,Notebooks, Delta Lake, APIs. * Expertise in production grade solutions using: AWS (Redshift, S3, Glue, Lambda, Airflow), Pyspark, Python, Data pipelines using Glue/Airflow/Sagemaker. * Hands-on experience in working on large cloud-based migration workloads involving SQL and NoSQL Databases. * Experience with migration of databases to AWS. Strong ability in creating roadmaps and architecture to execute migration workloads on AWS. * Exposure to ETL tools and Data warehouse. * Experience in SQL and Query optimisation. Proficient in SQL-based technologies (MySQL, Oracle DB,SQL Server etc.). * Experience in creation and maintenance of data dictionaries, metadata repositories, and data lineage documentation. * Experience building and supporting large-scale systems in a production environment. * Strong skills to mentor and manage teams of junior and senior data engineers and leading end to end delivery of technical workloads. * Experience using Github/codecommit for developmental activities. * Experience designing and optimizing orchestration frameworks using Apache Airflow / Amazon MWAA including DAG optimization, dependency management, retries, monitoring, and operationalization., * Experience with AWS services - S3,Redshift,Secrets Manager. * Exposure to SageMaker Unified Studio (SMUS) and modern business catalog/governance implementations for metadata management, data discovery, and governed analytics access. * Experience in implementing data integration projects using ETL. * Experience in using Airflow or Step Functions for orchestration. * Exposure to IaC tools like Terraform and to CI/CD tools. * Prior experience in migrating (on-prem to cloud) and processing large amounts of data. * Experience in implementing data lake and data warehouse on cloud. * Experience in implementing the industry's best practices. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Innovating Developer Tools with AI: Insights from GitHub Next](https://www.wearedevelopers.com/videos/1268-innovating-developer-tools-with-ai-insights-from-github-next) - [MySQL Protocol Features You Should Be Aware Of](https://www.wearedevelopers.com/videos/100267-mysql-protocol-features-you-should-be-aware-of) - [Leveraging Real time data in FSIs](https://www.wearedevelopers.com/videos/806-leveraging-real-time-data-in-fsis) - [Blueprints for Success: Steering a Global Data & AI Architecture](https://www.wearedevelopers.com/videos/1577-blueprints-for-success-steering-a-global-data-ai-architecture) - [Bringing AI Model Testing and Prompt Management to Your Codebase with GitHub Models](https://www.wearedevelopers.com/videos/1536-bringing-ai-model-testing-and-prompt-management-to-your-codebase-with-github-models) ## Related Articles - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [Software Developer Salary in The Netherlands [2023]](https://www.wearedevelopers.com/magazine/217-software-developer-salary-in-the-netherlands-2023)