> Markdown version of [/jobs/ext/2124894-lead-data-engineer-edo-platform-engineering-lead-to-architect](https://www.wearedevelopers.com/jobs/ext/2124894-lead-data-engineer-edo-platform-engineering-lead-to-architect). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Lead Data Engineer / EDO Platform Engineering Lead to architect - **Company:** THE JUDGE GROUP, INC. - **Location:** Tustin, CA, United States - **Experience:** Expert - **Salary:** $180,000.0 - $190,000.0 - **Contract:** Permanent contract - **Skills:** Airflow, Amazon Web Services, Amazon S3, Microsoft Azure, Cloud Computing Security, Cloud Engineering, Data Architecture, Information Engineering, Data Governance, Data Infrastructure, DevOps, Github, Python (Programming Language), Release Management, Reliability Engineering, DataOps, Data Streaming, Enterprise Data Management, System Availability, AWS Lambda, Infrastructure as Code (IaC), Data Lakes, Gitlab-ci, Kubernetes, Infrastructure Automation Frameworks, Information Technology, Deployment Automation, AWS Glue, Data Management, Machine Learning Operations, Cloudwatch, Terraform, Software Version Control, Api Management, Docker, Jenkins, Databricks - **Published:** August 19, 2026 - **Apply:** https://www.dice.com/job-detail/de7c8d4c-e557-4fa1-9654-acfc15cc467e ## About the Role * Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field. * 10+ years of experience in Data Engineering, Platform Engineering, Cloud Engineering, or related disciplines. * Strong experience designing and supporting enterprise data platforms. * Hands-on expertise with: + Databricks + dbt + Apache Airflow + AWS Cloud Services + Terraform + Python + CI/CD pipelines + Docker & Kubernetes * Experience implementing Infrastructure as Code (IaC) and DevOps practices. * Strong understanding of data governance, security, and compliance controls. * Experience supporting large-scale enterprise data environments. * Excellent leadership, communication, and stakeholder management skills., * Experience within Asset Management, Wealth Management, Investment Management, or Financial Services organizations. * Expertise in Lakehouse Architecture and Data Platform Modernization. * Experience implementing Site Reliability Engineering (SRE) practices. * AWS Certifications preferred. * Databricks Certifications preferred. * Experience supporting enterprise-scale analytics and regulatory reporting platforms. Must-Have Skills * Databricks * dbt * Apache Airflow * AWS Cloud * Terraform * Python * Platform Engineering * DevOps * Infrastructure as Code (IaC) * Asset Management Industry Experience Preferred Skills * Delta Live Tables (DLT) * Unity Catalog * MLflow * Structured Streaming * Kubernetes * Docker * GitOps * Jenkins * GitHub Actions * GitLab CI/CD * Site Reliability Engineering (SRE) ## Description We are seeking an experienced Lead Data Engineer / EDO Platform Engineering Lead to architect, build, and manage enterprise-scale cloud-native data platforms supporting Asset Management business functions. This role will lead platform engineering, infrastructure automation, DevOps enablement, platform reliability, security, and operational excellence across the Enterprise Data Office (EDO). The ideal candidate will possess deep expertise in Databricks, dbt, Airflow, AWS Cloud, Terraform, Python, DevOps, Platform Engineering, and Data Operations, along with a strong background supporting Asset Management and Investment Management organizations. This position will be responsible for establishing and operating a secure, scalable, highly available enterprise data platform supporting analytics, reporting, regulatory compliance, portfolio management, risk management, and investment operations. Responsibilities Platform Engineering & Architecture * Lead the design, implementation, and management of enterprise-scale data platforms. * Define platform engineering strategy aligned with Enterprise Data Office (EDO) and enterprise architecture standards. * Establish reusable platform frameworks, accelerators, reference architectures, and engineering best practices. * Drive cloud-native modernization initiatives across data and analytics ecosystems. * Own platform lifecycle management, scalability, reliability, availability, and performance. Databricks Platform Leadership * Lead Databricks platform architecture, administration, and governance. * Design and implement modern Lakehouse architectures utilizing Delta Lake. * Manage and optimize: + Databricks Workflows + Delta Live Tables (DLT) + Unity Catalog + MLflow + Structured Streaming + Cluster Policies + Security & Access Controls * Optimize platform performance, scalability, and cost efficiency. * Establish governance controls across development, testing, and production environments. Cloud Engineering & Infrastructure * Lead cloud engineering initiatives utilizing AWS services including: + Amazon S3 + ECS + EKS + AWS Lambda + AWS Glue + CloudWatch * Design highly available and secure cloud-based data platform solutions. * Ensure platform resiliency, security, compliance, and operational excellence. Infrastructure as Code (IaC) * Develop and maintain reusable Terraform modules. * Automate environment provisioning and deployment processes. * Implement infrastructure standardization and governance. * Maintain infrastructure version control and change management. * Enforce compliance through Infrastructure-as-Code best practices. DevOps & Automation * Design and implement CI/CD pipelines for platform and data engineering teams. * Automate deployment, release management, and operational processes. * Enable GitOps and Infrastructure-as-Code methodologies. * Improve deployment speed, reliability, and operational efficiency. * Support self-service platform capabilities for engineering teams. Platform Reliability & Operations * Establish and implement Site Reliability Engineering (SRE) practices. * Define and monitor platform SLAs, SLOs, and key operational metrics. * Lead platform monitoring, observability, and incident management strategies. * Drive root cause analysis, remediation, and preventive action programs. * Support API integrations and operational workflows. Tools & Technologies * Databricks * Delta Lake * dbt * Apache Airflow * AWS Cloud * Terraform * Python * GitHub Actions * GitLab CI/CD * Jenkins * Azure DevOps * Docker * Kubernetes ## Related Videos - [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [Innovating Developer Tools with AI: Insights from GitHub Next](https://www.wearedevelopers.com/videos/1268-innovating-developer-tools-with-ai-insights-from-github-next) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) - [Docker build without Docker](https://www.wearedevelopers.com/videos/100114-docker-build-without-docker) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again) - [Best US AI Conferences for CTOs in 2026: Build vs. Buy, Vendor Evaluation, and Peer Intelligence](https://www.wearedevelopers.com/magazine/736-best-us-ai-conferences-for-ctos-in-2026-build-vs-buy-vendor-evaluation-and-peer-intelligence) - [A Guide to Green Tech and Green IT Careers](https://www.wearedevelopers.com/magazine/374-a-guide-to-green-tech-and-green-it-careers)