Data Warehouse Architect

Virtualan Software LLC
New York, United States of America
3 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
$ 120K

Job location

New York, United States of America

Tech stack

Java
Azure
C Sharp (Programming Language)
Code Review
Information Systems
Information Engineering
Data Governance
ETL
Data Systems
Data Warehousing
DevOps
Dimensional Modeling
Python
Metadata
Meta-Data Management
SQL Azure
Performance Tuning
Power BI
Cloud Services
Azure
SQL Databases
Tableau
Data Processing
Cloud Platform System
Azure
Snowflake
Spark
Data Lake
PySpark
Semi-structured Data
Information Technology
Data Lineage
Collibra
Data Management
Tools for Reporting
Azure
Data Pipelines
Databricks

Job description

We are seeking an experienced Data Warehouse Architect to design, build, and modernize enterprise-scale data warehouse solutions supporting critical business and regulatory reporting initiatives. The ideal candidate will have strong hands-on expertise in Azure Databricks, Python, Spark, SQL, and Azure Data Services, along with experience in the banking, financial services, or capital markets domain.

This role involves architecting scalable cloud-based data platforms, developing high-performance ETL/ELT pipelines, implementing data governance best practices, and partnering with business and technology stakeholders to deliver reliable, secure, and compliant data solutions., * Design, develop, and optimize scalable enterprise data warehouse architectures using Azure cloud technologies.

  • Build and maintain high-performance ETL/ELT pipelines using Azure Databricks, Python, PySpark, and SQL.
  • Design robust data models to support analytics, reporting, and regulatory requirements.
  • Migrate legacy data platforms and ETL processes to modern cloud-based architectures.
  • Develop scalable data pipelines that process large volumes of structured and semi-structured data.
  • Optimize data processing performance, storage, and query execution for enterprise workloads.
  • Collaborate with business users, product owners, architects, and engineering teams to translate business requirements into technical solutions.
  • Monitor, troubleshoot, and improve data pipeline reliability and performance.
  • Provide technical leadership through architecture reviews, code reviews, mentoring, and best-practice guidance.
  • Produce technical documentation, architecture diagrams, and implementation standards.

Data Governance & Compliance

  • Design and implement enterprise data governance frameworks covering data ownership, stewardship, lineage, metadata, and data quality.
  • Implement automated data lineage and audit capabilities to support regulatory and compliance requirements.
  • Establish data quality standards and monitoring processes for completeness, accuracy, consistency, and timeliness.
  • Support enterprise data cataloging and metadata management initiatives.
  • Ensure compliance with financial industry regulations, security policies, and data privacy standards.

Requirements

  • 10+ years of experience in Data Engineering, Data Warehouse Architecture, or related roles.
  • Strong hands-on experience with Azure Databricks.
  • Expertise in Python, PySpark, Apache Spark, and SQL.
  • Experience with Azure Data Services, including Azure Data Factory (ADF), Azure Synapse Analytics, Azure Data Lake Storage (ADLS Gen2), Azure SQL, or similar services.
  • Strong knowledge of data warehouse architecture, dimensional modeling, ETL/ELT frameworks, and performance tuning.
  • Experience designing scalable cloud-native data platforms.
  • Hands-on experience with Delta Lake and modern data lakehouse architectures.
  • Strong understanding of data governance, metadata management, lineage, and data quality frameworks.
  • Experience working within Banking, Financial Services, Capital Markets, Investment Banking, or Risk Management environments.
  • Excellent communication and stakeholder management skills.
  • Bachelor's degree in Computer Science, Information Systems, or a related field., * Microsoft Azure certifications (Azure Data Engineer Associate, Azure Solutions Architect, or Azure Data Scientist).
  • Experience with Snowflake or other cloud data warehouse platforms.
  • Knowledge of Microsoft Purview, Collibra, or similar governance tools.
  • Experience with CI/CD pipelines and DevOps practices for data engineering.
  • Familiarity with Scala, Java, or C#.
  • Experience with BI and reporting tools such as Power BI or Tableau.

Apply for this position