> Markdown version of [/jobs/ext/2161070-architect-data-engineering](https://www.wearedevelopers.com/jobs/ext/2161070-architect-data-engineering). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Architect- Data Engineering - **Company:** THE JUDGE GROUP, INC. - **Location:** Tustin, CA, United States - **Experience:** Expert - **Salary:** $200,000.0 - $220,000.0 - **Contract:** Permanent contract - **Skills:** Airflow, Amazon Web Services, Computing Platforms, Microsoft Azure, Cloud Computing, Cluster Analysis, Code Review, Information Engineering, Data Security, Data Vault Modeling, Data Warehousing, Dimensional Modeling, Distributed Systems, Github, Apache Hive, Python (Programming Language), DataOps, Data Streaming, Enterprise Data Management, Data Processing, Google Cloud, Apache Spark, Data Lakes, Pyspark, Gitlab-ci, Apache Kafka, Terraform, Data Pipelines, Databricks - **Published:** August 21, 2026 - **Apply:** https://www.dice.com/job-detail/271af31f-deda-4493-a343-bf732c5493af ## About the Role Overall 15+ Years of experience 10+ years of total experience in data engineering, data warehousing, and distributed systems. 4+ years of dedicated experience architecting production environments within the modern data stack. Technical Proficiencies Databricks: Advanced mastery of Photon engine, Unity Catalog, Delta Lake optimization (Z-order, Liquid Clustering), and DLT. dbt: Expert-level proficiency with compl ex macro development, custom materializations, and multi-project dbt mesh architectures. Airflow: Deep understanding of Airflow scheduling, custom operators, dynamic task mapping, and infrastructure scaling. Languages: Elite proficiency in Python (PySpark) and advanced SQL. Cloud Infrastructure: Strong experience with at least one major cloud ecosystem provider: AWS, Azure, or Google Cloud Platform. Soft Skills Strong technical communication skills to distill complex infrastructure designs for non-technical stakeholders. Natural ability to lead by influence and drive cross-functional engineering initiatives. Preferred Qualifications Official Databricks certifications (e.g., Databricks Certified Data Engineer Professional or Solutions Architect). Active contributor to open-source data communities (dbt, Airflow, or Apache Spark). Solid foundation in streaming data technologies like Apache Kafka or AWS ## Description We are seeking a visionary and hands-on Senior Data Engineering Architect to design, scale, and optimize our enterprise data platform. In this role, you will define the blueprints for our data estate, leveraging a modern stack centered on Databricks, dbt, and Apache Airflow. You will bridge the gap between complex business strategy and technical implementation, ensuring our data pipelines are scalable, resilient, and cost-effective. Key Responsibilities Architecture & Platform Design Design end-to-end lakehouse architectures on Databricks utilizing Delta Lake and Unity Catalog. Establish robust governance, schema evolution, and fine-grained data security patterns. Formulate standard frameworks for data modeling (e.g., Kimball dimensional modeling, Data Vault 2.0). Optimize infrastructure for optimal price-to-performance across batch and streaming workloads. Data Pipeline & Orchestration Engineering Architect modular, reusable transformation frameworks using dbt Core/Cloud integrated with Databricks. Standardize data processing patterns using PySpark, Delta Live Tables (DLT), and Spark SQL. Build highly observable, dynamic orchestration workflows using Apache Airflow. Design cross-DAG dependency models, custom providers, and robust error-handling mechanisms. DataOps & Engineering Excellence Drive DataOps maturity by implementing CI/CD pipelines via GitHub Actions, GitLab CI, or Azure DevOps. Deploy infrastructure-as-code patterns using Terraform and Databricks Asset Bundles (DABs). Embed automated data quality testing directly into the dbt and Airflow lifecycle. Define service-level indicators (SLIs) and objectives (SLOs) for pipeline uptime and data freshness. Leadership & Stakeholder Management Serve as the principal technical authority and escalation point for data engineering teams. Mentor senior and mid-level data engineers through code reviews and architectural workshops. Collaborate with product managers, data scientists, and business leaders to solve data gaps. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Innovating Developer Tools with AI: Insights from GitHub Next](https://www.wearedevelopers.com/videos/1268-innovating-developer-tools-with-ai-insights-from-github-next) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) ## Related Articles - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Best US AI Conferences for CTOs in 2026: Build vs. Buy, Vendor Evaluation, and Peer Intelligence](https://www.wearedevelopers.com/magazine/736-best-us-ai-conferences-for-ctos-in-2026-build-vs-buy-vendor-evaluation-and-peer-intelligence)