> Markdown version of [/jobs/ext/2564609-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/2564609-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Data Engineer - **Company:** Amerilife Group, LLC - **Location:** United States - **Experience:** Expert - **Salary:** $142,500.0 - $160,000.0 - **Contract:** Permanent contract - **Skills:** Unity 3d, Artificial Intelligence, Data Analysis, Microsoft Azure, Code Review, Information Systems, Continuous Integration, Data Architecture, Information Engineering, Data Governance, Extract Transform Load (ETL), Data Systems, Data Vault Modeling, DevOps, Distributed Computing Environment, Metadata, Performance Tuning, SQL Databases, Enterprise Data Management, Apache Spark, Git, Data Lakes, Pyspark, Information Technology, Deployment Automation, Enterprise Integration, Data Management, Terraform, Data Pipelines, Databricks - **Published:** August 4, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=a12298937e96ea8b ## About the Role * Bachelor's degree in Computer Science, Engineering, Information Systems, or related field. * 7+ years of Data Engineering experience. * 3+ years of hands-on Databricks experience. * Strong expertise in Apache Spark (PySpark and SQL). * Deep knowledge of Delta Lake, Unity Catalog, Workflows, and Lakehouse architecture. * Advanced SQL development skills. * Experience building enterprise-scale ETL/ELT pipelines. * Experience with Azure cloud services. * Strong Git, CI/CD, and DevOps practices. * Experience with performance tuning and optimization. Preferred Qualifications * Insurance or Financial Services experience. * Data Vault 2.0 certification or implementation experience. * Experience with dbt, Terraform, and Azure DevOps. * Experience building metadata-driven frameworks. * Experience with Master Data Management (MDM). * Experience developing enterprise semantic models. * Familiarity with data quality frameworks and data governance. * Experience enabling AI and analytics through trusted enterprise data products. ## Description We are seeking an experienced Senior Data Engineer to design, build, and optimize enterprise data products and modern data pipelines on Databricks. This role is responsible for developing scalable, metadata-driven data solutions that power enterprise reporting, analytics, AI, operational applications, and business intelligence. The ideal candidate has deep expertise in Databricks, Apache Spark, Delta Lake, and modern Lakehouse architecture, with strong experience designing enterprise-grade data engineering solutions., * Design and develop scalable Spark-based ETL and ELT pipelines. * Build enterprise data products using Medallion Architecture. * Develop Bronze, Silver, Gold, and Semantic data layers. * Engineer reusable enterprise data assets for business consumption. * Optimize large-scale distributed data processing workloads. Databricks Platform Development * Build native Databricks solutions using Spark, Delta Lake, Unity Catalog, Workflows, SQL Warehouses, and Delta Live Tables. * Optimize cluster performance and workload efficiency. * Implement automated deployment pipelines and CI/CD practices. * Develop scalable Lakehouse solutions. Data Modeling * Design dimensional models for business consumption. * Build Data Vault 2.0 models for enterprise integration. * Develop semantic models and curated data products. * Support Master Data Management initiatives. Data Quality & Governance * Implement enterprise data quality validations. * Develop metadata-driven engineering solutions. * Enable lineage, governance, and traceability. * Ensure production-ready engineering standards. Collaboration * Partner with Architects, Product Owners, Business Analysts, and Data Scientists. * Participate in architecture reviews and code reviews. * Mentor junior engineers. * Drive engineering best practices across the organization. ## Related Videos - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)