Cloud Data Engineer

Brady Mainz Group Inc
San Francisco, CA, United States
24 days ago
Apply on mbg.com
Prepare application

Role details

Contract type
Temporary to permanent
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
10 years minimum
Working hours
Regular working hours
Job source

Tech stack

Query Performance Microsoft Windows Agile Methodology JIRA Automation of Tests Microsoft Azure Information Systems Continuous Delivery Data Centers Data Dictionary Information Engineering Data Governance
+27 more
Data Warehousing Software Design Patterns Dimensional Modeling Document-Oriented Databases System Center Configuration Manager Performance Tuning Scrum Methodology Query Optimization Role-Based Access Control Azure Data Lake Runbook Software Deployment Data Streaming Systems Integration Azure Data Factory Sql Optimization Snowflake Workday Security Change Data Capture Data Layers Git Flow Information Technology Apache Kafka Dynamic Data Physical Data Models Data Pipelines Workday

Job description

We are seeking an experienced, highly skilled Cloud Data Engineer to support an Investment Operations & Fund Treasury Data Engineering team. The ideal candidate will have a strong background in cloud data engineering and architecture, preferably within asset management or financial services, and will be comfortable both assessing architectural approaches and remaining hands-on in the development and delivery of solutions across modern data technology platforms., * Design and implement scalable cloud data warehouse architectures, including layer structures, schema design patterns, and partitioning/clustering strategies.

  • Architect physical and logical data models that balance query performance, storage efficiency, and business domain clarity, applying dimensional modeling techniques where appropriate.
  • Utilize modern cloud data frameworks to build modular, reusable SQL models across staging, intermediate, and mart layers with comprehensive documentation and lineage.
  • Build and maintain scalable data pipelines that ingest data from diverse sources, including Snowflake shares, databases, APIs, event streams, and flat files.
  • Implement batch and near-real-time ingestion patterns using cloud-native technologies, including incremental loads, CDC (Change Data Capture), and idempotent pipeline design.
  • Optimize warehouse and query performance through materialization strategies, clustering keys, and platform-specific query tuning.
  • Implement and maintain RBAC, column-level security, dynamic data masking, and row-level access policies to support least-privilege access and data privacy requirements.
  • Establish and maintain CI/CD pipelines for warehouse deployments, including automated testing and promotion of transformation code across development, UAT, and production environments.
  • Work within an Agile environment using JIRA, participating in sprint planning and delivering high-quality solutions on a consistent cadence.
  • Apply AI-assisted development tools where appropriate to accelerate transformation development, data quality automation, and documentation workflows.
  • Develop and maintain technical documentation, data models, pipeline runbooks, and data dictionaries.
  • Support platform reliability through monitoring, troubleshooting, backfill/reprocessing strategies, operational alerting, and performance optimization., Data Center Technician II We’re hiring a Data Center Technician II to support enterprise data center deployments and infrastructure operations. This is a hands-on role responsible for installing, cabling, validating, and maintaining server, storage, networking, and GPU hardware in a fast-paced data…, IT PMO Project Manager We’re looking for an experienced IT PMO Project Manager to lead complex enterprise technology initiatives and ensure successful delivery across scope, schedule, budget, quality, and compliance expectations. This role will work closely with business and IT stakeholders to…, Endpoint Operations Engineer - Remote 2 years Contract Position Summary We’re seeking an experienced Endpoint Operations Engineer to support enterprise endpoint management and Windows operations. This hands-on role focuses on SCCM/MECM software deployments, Windows troubleshooting, endpoint health,…, Senior Workday IT Engineer Location: Dallas, TX About the Role We are seeking an experienced Senior Workday IT Engineer to lead the design, development, and support of enterprise Workday solutions. This individual will be responsible for Workday security, integrations, reporting, application…

Requirements

This role requires deep expertise in Snowflake, Azure, SQL, dbt, data warehousing, and cloud-native data pipelines, along with the ability to design scalable, reliable, and secure data solutions., * 10+ years of data engineering experience, with a demonstrated track record of hands-on development and end-to-end solution delivery.

  • Proven experience designing scalable cloud data warehouse architectures, including layered architectures, schema design patterns, and physical data models.
  • Deep hands-on expertise with Snowflake, including data modeling, performance tuning, cost-efficient design, and secure vendor data shares.
  • Advanced SQL skills with strong knowledge of data warehousing concepts, including dimensional modeling, incremental processing, slowly changing dimensions, and semantic layers.
  • Strong hands-on experience building cloud data solutions on Microsoft Azure, particularly Azure Data Factory (ADF) and Azure Data Lake Storage (ADLS).
  • Hands-on experience with dbt, including modular model development across layered warehouse architectures.
  • Familiarity with streaming and near-real-time ingestion technologies such as Azure Event Hubs and Kafka, including CDC and incremental processing patterns.
  • Strong understanding of data platform reliability, including orchestration, backfill/reprocessing strategies, performance optimization, and operational support.
  • Experience developing and maintaining data quality frameworks, operational alerting, and runbooks in SLA-driven environments.
  • Experience implementing CI/CD pipelines for dbt and Snowflake, including Git-based workflows, automated testing, and environment promotion.
  • Strong written and verbal communication skills with the ability to clearly document data models, pipelines, technical processes, and data definitions.
  • Bachelor’s degree in Computer Science, Information Systems, or a related field.
  • Experience within asset management, investment management, financial services, Investment Operations, or Fund Treasury is strongly preferred.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on mbg.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:05 min

Integrating an assistant application with Jira software

Felix Augenstein · LIVE

6:22 min

Eliminating HR bureaucracy and trusting employees

Rudi Bauer Rudi Bauer +1 · Cappuccino with HR

2:50 min

Introduction and the value of runbooks

Hila Fish · World Congress 2023

2:57 min

Core technical practices for robust data engineering

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

1:32 min

Structuring automated incident workflows between runbooks and raw models

Aram Hakobyan Aram Hakobyan +1 · World Congress 2026 Europe

5:06 min

Primary reasons for capability gaps in modern recruitment systems

Rudi Bauer Rudi Bauer +1 · Cappuccino with HR

Videos

See all

Related articles

See all