> Markdown version of [/jobs/ext/1973015-data-platform-engineer-job](https://www.wearedevelopers.com/jobs/ext/1973015-data-platform-engineer-job). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Data Platform Engineer job

- **Company:** Greystar Real Estate Partners, LLC
- **Location:** United States
- **Experience:** Expert
- **Salary:** $125,000.0 - $150,000.0
- **Contract:** Permanent contract
- **Skills:** Unity 3d, Artificial Intelligence, Data Analysis, Computing Platforms, Automation of Tests, Microsoft Azure, Cloud Engineering, Configuration Management, Continuous Integration, Data Architecture, Data Governance, Data Infrastructure, Data Security, Domain Name System (DNS), Identity and Access Management, Python (Programming Language), Log Analysis, Machine Learning, Meta-Data Management, Microsoft SQL Server, SQL Azure, Operational Databases, Performance Tuning, Scrum Methodology, Role-Based Access Control, Release Management, Azure Active Directory, Azure DevOps Pipelines, Kusto Query Language, DataOps, Azure Data Lake, SQL Databases, User Provisioning Software, YAML, Cloud Platform System, Azure Data Factory, Cloud Monitoring, Delivery Pipeline, Large Language Models, Apache Spark, Data Lakes, Infrastructure Automation Frameworks, Data Lineage, Deployment Automation, Github Enterprise, Cosmos DB, Firewall Services Module, Terraform, Azure Synapse Analytics, Multiplatform, Data Pipelines, Azure Resource Manager, Key Vault, Databricks
- **Published:** August 7, 2026
- **Apply:** https://jobs.diversity.com/career/2443287/data-platform-engineer

## About the Role

Required &bull 5+ years of platform engineering, infrastructure engineering, or data operations experience in a production environment

&bull Expert-level Databricks administration: Unity Catalog, cluster policies, workspace management, compute configuration, and Delta Lake internals

&bull Strong command of the Azure data services ecosystem: ADLS Gen2, ADF, Azure Monitor, Log Analytics, Key Vault, Cost Management, and Event Hub

&bull Identity and access management: Azure Active Directory, service principals, RBAC, and Unity Catalog governance policies

&bull Hands-on experience with ADF pipeline design and orchestration at scale

&bull Spark performance tuning: partitioning, Z-ordering, compute spend optimization, and bottleneck profiling

&bull Proven CI/CD experience using GitHub Enterprise: environment promotion, rollback, and release management for data pipelines

&bull Python and/or SQL for automation scripts, compliance validation, and platform tooling

&bull Knowledge of medallion / lakehouse architecture patterns and multi-environment deployment discipline

&bull Terraform / Infrastructure-as-Code (IaC): provisioning and managing Databricks workspaces, Azure resources, Unity Catalog configurations, and environment-specific infrastructure through version-controlled IaC

&bull Azure DevOps Pipelines: build and release pipeline configuration, YAML pipeline authoring, and integration with GitHub Enterprise for end-to-end deployment automation

&bull Azure networking: VNet configuration, private endpoints for Databricks and ADLS Gen2, NSG rules, firewall policies, and DNS resolution for secure data platform connectivity

&bull Azure Monitor & Log Analytics: KQL query authoring, alert rule configuration, diagnostic settings, workbook creation, and cluster event monitoring for proactive platform health management

&bull Delta Lake internals: VACUUM, OPTIMIZE, ZORDER, time travel, table statistics, and transaction log management for production-grade Delta table lifecycle governance

Preferred

&bull Experience with Synapse Analytics, Cosmos DB, or Azure SQL Server in production data environments

&bull Familiarity with Databricks Mosaic AI, Genie, or AI-native platform observability capabilities

&bull Background in data lineage tooling, metadata management, and Unity Catalog governance frameworks

&bull Experience with ERP system integrations: Yardi, Entrata, or RealPage in multi-tenant environments

&bull Background in legacy BI migration or platform modernization programs

&bull Linear for engineering sprint and release management

## Description

Greystar is seeking a Platform Engineer to join the Data team. This is a senior, deeply technical platform operations role responsible for the reliability, governance, and cost efficiency of Greystar's enterprise data infrastructure - a Databricks-native medallion architecture (Bronze Silver Gold) running entirely on Microsoft Azure. You will work within the DataOps pod under the Analytics Engineering umbrella, owning Databricks workspace administration, Unity Catalog governance, Azure infrastructure operations, and multi-system platform support.

This role is platform-engineering-heavy. Most of your day lives inside Databricks workspace administration and the full Azure data services stack: ADLS Gen2, Azure Data Factory, Azure Monitor, Key Vault, Log Analytics, and beyond. You will enforce platform standards, govern identity and access, optimize compute and storage spend, and provide platform support for EDP, DALDW, ADF, Synapse, Cosmos DB, and SQL Server. Deep mastery of Databricks administration and the Azure platform is a baseline expectation., &bull Own Databricks workspace administration: upgrades, cluster policies, compute configurations, and Delta table lifecycle management

&bull Administer Unity Catalog: access controls, service principal (SP), group, and user provisioning, governance policies, and data lineage

&bull Tune Spark jobs for performance, reliability, and cost - profiling bottlenecks, optimizing partitioning, managing Z-ordering, and controlling compute spend

&bull Architect and enforce DMP platform standards: naming conventions, schema evolution policies, SLA tiers, and medallion layer contracts

&bull Leverage Databricks Mosaic AI and Genie to build AI-native DataOps capabilities including intelligent pipeline monitoring and anomaly detection

Azure Infrastructure & Integration

&bull Operate the full Azure data services stack: ADLS Gen2, Azure Data Factory (ADF), Azure Monitor, Log Analytics, Key Vault, and Event Hub

&bull Collaborate with Azure infrastructure and cloud engineering teams on networking, identity, security, and resource provisioning

&bull Drive cost governance through Azure Cost Management, Databricks DBU optimization, and storage lifecycle policies

Multi-Platform Support

&bull Provide platform support for various systems and platforms including access management, storage optimization, and compliance

&bull Support additional platforms including ADF, Synapse Analytics, Cosmos DB, and Azure SQL Server

&bull Manage storage allocation, cluster optimization, and resource provisioning across all supported platforms

&bull Support compliance, audit readiness, and Key Vault secret rotation and management

CI/CD & Environment Deployments

&bull Own the full deployment pipeline for DMP data workflows - promoting changes from development through staging to production

&bull Build and maintain CI/CD workflows using GitHub Enterprise: branch strategies, PR automation, environment-specific configuration management, and release gating

&bull Enforce deployment standards: automated testing gates, rollback procedures, change documentation, and environment parity controls

&bull Use Linear for sprint planning, release tracking, and issue management across deployment cycles

Identity, Access & Governance

&bull Manage Azure Active Directory (AAD) service principals, RBAC assignments, and Unity Catalog permission policies

&bull Partner with the Data Governance team to enforce data contracts, ownership standards, and quality SLAs within Unity Catalog

&bull Maintain data lineage, metadata management, and governance framework documentation

&bull Ensure platform configurations meet security, compliance, and audit requirements

Environment Parity & Dev/Staging/Prod Management

&bull Own workspace configuration parity across Dev, Staging, and Production Databricks environments - cluster policies, Unity Catalog hierarchy, access controls, and compute configurations

&bull Define and enforce environment promotion hygiene: configuration drift detection, environment-specific secret management, and pre-production validation gates

&bull Maintain infrastructure-as-code (IaC) scripts and configuration templates to ensure reproducible, auditable environment provisioning across all tiers

Documentation & Collaboration

&bull Produce thorough technical documentation: runbooks, deployment playbooks, incident post-mortems, ADRs, and platform specs

&bull Partner with analytics engineers, data governance, and product stakeholders on platform design and capacity planning

&bull Participate in on-call rotation and support SLA commitments for business-critical DMP data domains

AI-Driven Platform Observability & Self-Healing Infrastructure

&bull Build and maintain AI-powered platform observability infrastructure - using LLMs and ML models to detect pipeline drift, classify anomalies, predict SLA risk, and generate automated incident summaries at the platform layer

&bull Architect and deploy self-healing pipeline capabilities - automated retry logic, circuit breakers, and remediation triggers - as production-grade platform features, not experiments

&bull Integrate Databricks Mosaic AI and Genie into operational platform workflows for intelligent cluster management, anomaly detection, and natural language platform diagnostics

&bull Contribute to Greystar's 18-month agentic AI roadmap, leading near-term delivery of platform-level self-healing and proactive alerting capabilities

Data Pipeline Architecture & Platform Standards

&bull Own DMP pipeline architecture patterns from an infrastructure standpoint - Delta Live Tables (DLT) design standards, schema evolution enforcement, and medallion layer contracts

&bull Define and enforce platform-wide naming conventions, partitioning strategies, Z-ordering policies, and Delta table optimization schedules (VACUUM, OPTIMIZE)

&bull Partner with analytics engineers to ensure pipeline designs conform to platform infrastructure standards, SLA tiers, and compute budget constraints

Disaster Recovery & Business Continuity

&bull Design and maintain DR strategies for the DMP platform - including Delta table backup policies, ADLS Gen2 geo-redundancy configuration, and Databricks workspace recovery runbooks

&bull Define RTO and RPO targets for business-critical DMP data domains test and validate recovery procedures on a recurring basis

&bull Maintain business continuity plans aligned with Azure region failover capabilities and Greystar's enterprise SLA commitments, Many factors go into determining employee pay within the posted range including business requirements, prior experience, current skills and geographical location.

 * Corporate Positions: In addition to the base salary, this role may be eligible to participate in a quarterly or annual bonus program based on individual and company performance.
 * Onsite Property Positions: In addition to the base salary, this role may be eligible to participate in weekly, monthly, and/or quarterly bonus programs.


## Related Videos

- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Reality and Beyond: Coding a Drone Using {Unity 3D .NET} and ChatGPT AI!](https://www.wearedevelopers.com/videos/702-reality-and-beyond-coding-a-drone-using-unity-3d-net-and-chatgpt-ai)
- [CI/CD with Github Actions](https://www.wearedevelopers.com/videos/856-ci-cd-with-github-actions)
- [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering)
- [Coding an Immersive Copilot using Unity / .NET and Azure OpenAI!](https://www.wearedevelopers.com/videos/1204-coding-an-immersive-copilot-using-unity-net-and-azure-openai)
- [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered)

## Related Articles

- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering)
- [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk)