> Markdown version of [/jobs/ext/2007172-lead-data-engineer](https://www.wearedevelopers.com/jobs/ext/2007172-lead-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Lead Data Engineer - **Company:** Genworth Financial, Inc. - **Location:** Richmond, VA, United States - **Experience:** Expert - **Salary:** $120,900.0 - $187,000.0 - **Contract:** Permanent contract - **Skills:** Agile Methodology, Artificial Intelligence, Microsoft Azure, Cloud Computing, Code Review, Continuous Integration, Data Architecture, Information Engineering, Data Governance, Data Systems, Data Warehousing, Performance Tuning, Software Engineering, Apache Spark, Data Management, Software Coding, Databricks - **Published:** August 9, 2026 - **Apply:** https://www.careerboard.com/us/en/find-jobs-in-United-States/-0EE8B24C72A6BF58E3/ ## About the Role * 3-5 years of hands-on Databricks experience with other complementary technologies including data governance, reporting and dashboard, and source system technologies. * Proven experience in a Tech Lead role, including leading developers and distributing/decomposing work. * Strong communication skills with the ability to mentor, influence, and align cross functional functional stakeholders. * Ability to engage proactively with business leaders to recommend solutions aligned to strategy and support data self-service service capabilities. * Solid grounding in general analytics, data warehousing, and modern data engineering practices. * Experience working in Agile frameworks and writing high-quality user stories. * Ability to navigate ambiguity and provide clarity for your team and partners. Nice to have * Azure and Fabric cloud experience * Insurance industry business process and data knowledge. * Medical data experience. * Familiarity with data governance and data quality needs for business consumers and how they integrate with pipeline design. ## Description The Life, Annuity, and Long-Term Care Data Solutions team -responsible for end-to-end to end data architecture, data governance, and data engineering from source systems to data consumers-is seeking a Lead Data Engineer with strong Databricks expertise and proven experience in a Tech Lead capacity. In this role, you will lead and mentor data engineering tech leads across multiple build teams that use DataBricks and a data engineering CoE (Center of Excellence), guiding them through the full software development lifecycle including design, build, test, and run. You will lead the definition of best practices, establish common code frameworks, elevate engineering maturity, prove out and determine when new DataBricks features should be implemented, and ensure consistent delivery of high-quality quality data products and analytical solutions across build teams. You will be part of a high performing, performing, mission driven organization of 25 individuals across four agile teams. Collaboration will be central as you work closely with the solution architects, agile team tech leads, data product owner, and other partners across security, cloud, testing, and data modeling. The platform leverages a modern streaming architecture supporting both transactional and analytical pipelines, grounded in Medallion and OneLake design principles. A primary outcome for this role and others on the team is overseeing the implementation of DataBricks that will replace many Legacy analytical platforms that result in new and better business outcomes. What you will be doing * Leading 3-4 build teams, providing technical direction, coaching, mentoring, and technical governance. * May directly lead some data engineers for POCs, building coding frameworks that will be shared across teams, and other re-usable data assets. * May perform hands on designing, building, testing, and supporting analytical pipelines. * Establishing and enforcing design, engineering, and coding standards, including code reviews. * Leading CI/CD and designing reusable data tests for future releases. * Expanding your expertise into AI, ML, Lakebase, and other capabilities available in the DataBricks platform to these features are implemented as needed. * Driving Spark performance optimization and leading platform cost optimization opportunities. * Managing production monitoring, troubleshooting, and defect resolution. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source](https://www.wearedevelopers.com/videos/100151-cutting-llm-costs-without-cutting-quality-how-to-beat-proprietary-llms-with-fine-tuned-open-source) - [Are Code Reviews Worth It? Insights from 16 Years of Review Data](https://www.wearedevelopers.com/videos/1135-are-code-reviews-worth-it-insights-from-16-years-of-review-data) - [OLTP in the Lakehouse: Redefining Data for AI Workloads](https://www.wearedevelopers.com/videos/2038-oltp-in-the-lakehouse-redefining-data-for-ai-workloads) - [Let's Get Aggregated: Custom UDAFs in Spark ](https://www.wearedevelopers.com/videos/1649-let-s-get-aggregated-custom-udafs-in-spark) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)