> Markdown version of [/jobs/ext/1551893-head-of-data-engineering](https://www.wearedevelopers.com/jobs/ext/1551893-head-of-data-engineering). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Head of Data Engineering - **Company:** All Views LLC - **Location:** Fort Lee, NJ, United States - **Experience:** Expert - **Salary:** $200,000.0 - **Contract:** Permanent contract - **Skills:** Unity 3d, Artificial Intelligence, Airflow, Amazon Web Services, Microsoft Azure, Cloud Engineering, Encodings, Information Engineering, Data Governance, Data Infrastructure, Extract Transform Load (ETL), Data Security, Data Systems, Distributed Systems, Python (Programming Language), PostgreSQL, Microsoft SQL Server, SQL Databases, Management of Software Versions, Large Language Models, Apache Spark, Cloudformation, Data Lakes, AI Platforms, Kubernetes, Infrastructure Automation Frameworks, Information Technology, Bicep, Terraform, Data Pipelines, Databricks - **Published:** July 16, 2026 - **Apply:** https://www.careerjet.com/job/usc2e1183d78da9355e20be92e6cb3311d/eaa ## About the Role * 10+ years in data engineering or related distributed systems; 4+ years leading and building data engineering teams. * Proven, hands-on experience leveraging AI to accelerate data engineering outcomes (e.g., AI coding assistants, agentic tooling, LLM-assisted pipeline development, testing, or operations). * Deep expertise with Databricks or equivalent (Lakehouse, Delta Lake, Spark, Unity Catalog) and PostgreSQL in production. * Demonstrated ownership of data governance and data security programs: cataloging, lineage, access control, data quality, and PII handling. * Strong engineering fundamentals in Python and SQL; experience designing scalable ETL/ELT and streaming architectures. * Track record of setting technical standards and delivering complex data initiatives from architecture through launch. * Excellent communicator and mentor, effective with stakeholders across technical and non-technical domains. * Bachelor's degree in Computer Science or related field required., * Master's degree in Computer Science, Data Engineering, or a related field. * Experience in insurance, healthcare, or other regulated, data-sensitive industries. * Experience with Apache Airflow (or comparable orchestration frameworks) and SQL Server in production. * Cloud-native experience on Azure and/or AWS, with strong infrastructure-as-code practices (e.g., Terraform, Bicep, CloudFormation). * Familiarity with data observability, dataset versioning, and approval/quality gates. * Exposure to ML/AI platform enablement (feature stores, model registries) supporting data science teams. ## Description We are hiring a hands-on data engineering leader to lead and scale TRANZACT's data engineering teams and pioneer a new AI-first data engineering discipline-accelerating the velocity, quality, and business impact of everything we build on data. You will own the architecture, delivery, governance, and security of our modern data platform built on Databricks and PostgreSQL, while embedding AI into how our teams design, build, and operate data systems. This role combines strategic platform ownership with sleeves-rolled-up execution and people leadership. What You'll Own (Systems-Level Outcomes) * Define and evolve the end-to-end data platform strategy across ingestion, transformation, storage, and serving-anchored on Databricks (Lakehouse, Delta, Unity Catalog) and PostgreSQL-with production-grade reliability and cost efficiency. * Establish an AI-first data engineering practice: standard patterns, SDKs, and golden paths that use AI to accelerate pipeline development, testing, documentation, and operations across teams. * Stand up enterprise-grade data governance and data security: cataloging, lineage, access controls, data quality, PII handling, and policy enforcement across the platform. * Build and lead high-performing data engineering teams-hiring, mentoring, and setting the technical bar-while driving measurable improvements in delivery velocity and platform trust. * Uplift the broader Engineering and Data organizations by sharing reusable components, best practices, and self-service capabilities that reduce bottlenecks and vendor dependency. * Serve as the accountable leader for critical data initiatives, driving requirements * architecture * implementation * launch * post-launch learning., * Architect scalable, reliable data pipelines and platform services on Databricks and PostgreSQL, supporting batch and streaming workloads across marketing, sales, and servicing domains. * Define and roll out an AI-first engineering workflow-leveraging AI coding assistants, agentic tooling, and automated eval/QA gates-to accelerate data engineering outcomes without compromising quality or security. * Establish data governance standards: Unity Catalog (or equivalent), lineage, data contracts, freshness and quality SLAs, and asset lifecycle management. * Own data security posture in partnership with Security and Compliance: role-based access, audit trails, encryption, PII/PHI handling, and regulatory alignment appropriate to insurance data. * Set engineering standards and review designs, PRs, data models, and architecture; drive adoption through documentation and enablement. * Lead vendor and tooling evaluation, and make build/buy/insource recommendations aligned to unit economics, reliability, and IP strategy. * Recruit, mentor, and develop engineers; host tech talks and cultivate a culture of ownership, experimentation, and continuous improvement. Success Profile (6-12 Months) * The data platform reliably supports key production use cases with clear SLOs, runbooks, and cost visibility. * An AI-first engineering practice is established, with reusable templates and golden paths measurably increasing delivery velocity across teams. * Data governance and data security controls are standardized, auditable, and enforced across the platform. * Teams are staffed, aligned, and performing, with healthy delivery and quality signals. * At least one critical data initiative is led to launch with documented business impact and a retrospective feeding the platform roadmap. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Reality and Beyond: Coding a Drone Using {Unity 3D .NET} and ChatGPT AI!](https://www.wearedevelopers.com/videos/702-reality-and-beyond-coding-a-drone-using-unity-3d-net-and-chatgpt-ai) - [Back(end) to the Future: Embracing the continuous Evolution of Infrastructure and Code](https://www.wearedevelopers.com/videos/440-back-end-to-the-future-embracing-the-continuous-evolution-of-infrastructure-and-code) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) - [Coding an Immersive Copilot using Unity / .NET and Azure OpenAI!](https://www.wearedevelopers.com/videos/1204-coding-an-immersive-copilot-using-unity-net-and-azure-openai) ## Related Articles - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift)