Data Warehouse Architect
Role details
Job location
Tech stack
Job description
We are seeking an experienced Data Warehouse Architect to design, build, and modernize enterprise-scale data warehouse solutions supporting critical business and regulatory reporting initiatives. The ideal candidate will have strong hands-on expertise in Azure Databricks, Python, Spark, SQL, and Azure Data Services, along with experience in the banking, financial services, or capital markets domain.
This role involves architecting scalable cloud-based data platforms, developing high-performance ETL/ELT pipelines, implementing data governance best practices, and partnering with business and technology stakeholders to deliver reliable, secure, and compliant data solutions., * Design, develop, and optimize scalable enterprise data warehouse architectures using Azure cloud technologies.
- Build and maintain high-performance ETL/ELT pipelines using Azure Databricks, Python, PySpark, and SQL.
- Design robust data models to support analytics, reporting, and regulatory requirements.
- Migrate legacy data platforms and ETL processes to modern cloud-based architectures.
- Develop scalable data pipelines that process large volumes of structured and semi-structured data.
- Optimize data processing performance, storage, and query execution for enterprise workloads.
- Collaborate with business users, product owners, architects, and engineering teams to translate business requirements into technical solutions.
- Monitor, troubleshoot, and improve data pipeline reliability and performance.
- Provide technical leadership through architecture reviews, code reviews, mentoring, and best-practice guidance.
- Produce technical documentation, architecture diagrams, and implementation standards.
Data Governance & Compliance
- Design and implement enterprise data governance frameworks covering data ownership, stewardship, lineage, metadata, and data quality.
- Implement automated data lineage and audit capabilities to support regulatory and compliance requirements.
- Establish data quality standards and monitoring processes for completeness, accuracy, consistency, and timeliness.
- Support enterprise data cataloging and metadata management initiatives.
- Ensure compliance with financial industry regulations, security policies, and data privacy standards.
Requirements
- 10+ years of experience in Data Engineering, Data Warehouse Architecture, or related roles.
- Strong hands-on experience with Azure Databricks.
- Expertise in Python, PySpark, Apache Spark, and SQL.
- Experience with Azure Data Services, including Azure Data Factory (ADF), Azure Synapse Analytics, Azure Data Lake Storage (ADLS Gen2), Azure SQL, or similar services.
- Strong knowledge of data warehouse architecture, dimensional modeling, ETL/ELT frameworks, and performance tuning.
- Experience designing scalable cloud-native data platforms.
- Hands-on experience with Delta Lake and modern data lakehouse architectures.
- Strong understanding of data governance, metadata management, lineage, and data quality frameworks.
- Experience working within Banking, Financial Services, Capital Markets, Investment Banking, or Risk Management environments.
- Excellent communication and stakeholder management skills.
- Bachelor's degree in Computer Science, Information Systems, or a related field., * Microsoft Azure certifications (Azure Data Engineer Associate, Azure Solutions Architect, or Azure Data Scientist).
- Experience with Snowflake or other cloud data warehouse platforms.
- Knowledge of Microsoft Purview, Collibra, or similar governance tools.
- Experience with CI/CD pipelines and DevOps practices for data engineering.
- Familiarity with Scala, Java, or C#.
- Experience with BI and reporting tools such as Power BI or Tableau.