Data Warehouse Architect

Virtualan Software LLC
New York, NY, United States
about 1 month ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
10 years minimum
Compensation
$110,000.0 - $120,000.0
Working hours
Regular working hours
Job source

Tech stack

Java (Programming Language) Microsoft Azure C Sharp (Programming Language) Code Review Information Systems Information Engineering Data Governance Extract Transform Load (ETL) Data Systems Data Warehousing DevOps Dimensional Modeling
+26 more
Python (Programming Language) Metadata Meta-Data Management SQL Azure Performance Tuning Power BI Cloud Services Azure Data Lake SQL Databases Tableau (Software) Data Processing Cloud Platform System Azure Data Factory Snowflake Apache Spark Data Lakes Pyspark Semi-structured Data Information Technology Data Lineage Collibra Data Management Tools for Reporting Azure Synapse Analytics Data Pipelines Databricks

Job description

We are seeking an experienced Data Warehouse Architect to design, build, and modernize enterprise-scale data warehouse solutions supporting critical business and regulatory reporting initiatives. The ideal candidate will have strong hands-on expertise in Azure Databricks, Python, Spark, SQL, and Azure Data Services, along with experience in the banking, financial services, or capital markets domain.

This role involves architecting scalable cloud-based data platforms, developing high-performance ETL/ELT pipelines, implementing data governance best practices, and partnering with business and technology stakeholders to deliver reliable, secure, and compliant data solutions., * Design, develop, and optimize scalable enterprise data warehouse architectures using Azure cloud technologies.

  • Build and maintain high-performance ETL/ELT pipelines using Azure Databricks, Python, PySpark, and SQL.
  • Design robust data models to support analytics, reporting, and regulatory requirements.
  • Migrate legacy data platforms and ETL processes to modern cloud-based architectures.
  • Develop scalable data pipelines that process large volumes of structured and semi-structured data.
  • Optimize data processing performance, storage, and query execution for enterprise workloads.
  • Collaborate with business users, product owners, architects, and engineering teams to translate business requirements into technical solutions.
  • Monitor, troubleshoot, and improve data pipeline reliability and performance.
  • Provide technical leadership through architecture reviews, code reviews, mentoring, and best-practice guidance.
  • Produce technical documentation, architecture diagrams, and implementation standards.

Data Governance & Compliance

  • Design and implement enterprise data governance frameworks covering data ownership, stewardship, lineage, metadata, and data quality.
  • Implement automated data lineage and audit capabilities to support regulatory and compliance requirements.
  • Establish data quality standards and monitoring processes for completeness, accuracy, consistency, and timeliness.
  • Support enterprise data cataloging and metadata management initiatives.
  • Ensure compliance with financial industry regulations, security policies, and data privacy standards.

Requirements

  • 10+ years of experience in Data Engineering, Data Warehouse Architecture, or related roles.
  • Strong hands-on experience with Azure Databricks.
  • Expertise in Python, PySpark, Apache Spark, and SQL.
  • Experience with Azure Data Services, including Azure Data Factory (ADF), Azure Synapse Analytics, Azure Data Lake Storage (ADLS Gen2), Azure SQL, or similar services.
  • Strong knowledge of data warehouse architecture, dimensional modeling, ETL/ELT frameworks, and performance tuning.
  • Experience designing scalable cloud-native data platforms.
  • Hands-on experience with Delta Lake and modern data lakehouse architectures.
  • Strong understanding of data governance, metadata management, lineage, and data quality frameworks.
  • Experience working within Banking, Financial Services, Capital Markets, Investment Banking, or Risk Management environments.
  • Excellent communication and stakeholder management skills.
  • Bachelor’s degree in Computer Science, Information Systems, or a related field., * Microsoft Azure certifications (Azure Data Engineer Associate, Azure Solutions Architect, or Azure Data Scientist).
  • Experience with Snowflake or other cloud data warehouse platforms.
  • Knowledge of Microsoft Purview, Collibra, or similar governance tools.
  • Experience with CI/CD pipelines and DevOps practices for data engineering.
  • Familiarity with Scala, Java, or C#.
  • Experience with BI and reporting tools such as Power BI or Tableau.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:17 min

Mapping the maturity roadmap for scaled devops adoption

Dominik Krichbaum Dominik Krichbaum · WWC Europe 2026

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

1:46 min

Traditional data architecture before Microsoft Fabric

Dr. Alexander Wachtel Dr. Alexander Wachtel +1 · WWC 2025

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

3:18 min

Scaling global network engineering through DevOps culture

Stuart Clark · LIVE

3:38 min

Architecting a unified data and machine learning workbench

Kapil Gupta Kapil Gupta · WWC 2025

Videos

See all

Related articles

See all