> Markdown version of [/jobs/ext/1321557-sr-data-engineer-azure-databricks](https://www.wearedevelopers.com/jobs/ext/1321557-sr-data-engineer-azure-databricks). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Sr Data Engineer (Azure & Databricks) - **Company:** Distil Networks, Inc. - **Location:** United States (Remote available) - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Microsoft Excel, Artificial Intelligence, Microsoft Azure, Data Dictionary, Data Governance, Data Structures, Dimensional Modeling, Microsoft Dynamics, Microsoft SQL Server, SQL Azure, Power BI, Standard Sql, Azure Data Lake, Reverse Engineering, SQL Databases, Azure Data Factory, Large Language Models, Magento, Powerquery, Data Layers, Build Management, Data Lakes, Pyspark, Azure Synapse Analytics, Databricks - **Published:** July 17, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=5b7d4eb57846885a ## About the Role We're seeking for a Senior Data Analyst/Engineer to lead the migration of business logic from Power BI and Excel into a governed Databricks Lakehouse, embedded within the client's data team as the primary driver of that work. Work directly with business users to understand and reverse-engineer their existing reports, re-model and rebuild that logic in Databricks with performance and scalability in mind, validate the results, document definitions, and progressively transfer knowledge to the internal team., * Strong data modeling expertise: dimensional modeling, grain definition, star and snowflake schema design, SCD handling, and surrogate key strategy - able to assess whether an existing model reflects a reliable single source of truth and design the right replacement for performance and scale. * Hands-on Databricks experience: PySpark and SQL, Delta Lake, medallion architecture, incremental processing, and Unity Catalog. * Solid ability to reverse-engineer Power BI, including DAX, semantic model relationships, and Power Query, where much of the transformation logic typically lives. * Strong SQL and experience with the Azure data ecosystem (ADLS Gen2, Azure Synapse, Azure SQL / SQL Server). * Comfortable working directly with non-technical business users - eliciting requirements, validating logic, and translating between business needs and technical implementation. * Experience implementing data governance and handling sensitive / PII data in compliance with GDPR and CCPA requirements. * Self-directed, ownership-oriented mindset suited to an embedded staff-augmentation role with a clear delivery mandate. Nice to Have * Exposure to Dynamics 365 F&O data structures and Synapse Link - given the source architecture, this is a meaningful advantage. * Experience building semantic layers and enabling natural language querying (e.g. Databricks Genie). * Experience integrating ecommerce (Magento) and CRM data sources. * Retail, ecommerce, or consumer goods data experience. * Experience using LLM-based tools to document or reverse-engineer legacy DAX and SQL logic at scale. ## Description * Reverse-engineer logic embedded in Power BI (DAX, semantic model relationships, Power Query) and Excel-based workflows, tracing it back to silver and source layers. * Design and build clean, well-modeled silver and gold/reporting layers in Databricks - applying dimensional modeling principles, medallion architecture, and coding best practices - so the visualization layer consumes small, fast, pre-validated datasets. * Partner with business SMEs (data team, finance, and other functions) to understand existing reporting processes and the metrics that must be exactly correct. * Develop and optimize incremental pipelines, adding validation and reconciliation consistent with the team's existing practices. * Build and maintain a data dictionary and semantic layer to support self-service and Genie / AI-assisted querying. * Contribute to data governance using Unity Catalog (access control, PII protection) in compliance with GDPR and CCPA requirements. * Support onboarding of new sources (e.g. Magento, CRM) into the platform. * Pair with and upskill the client's internal engineers and analysts; document work for ongoing internal support. ## Related Videos - [Beyond Dashboards: Fixing Text-to-SQL with Semantic RAG](https://www.wearedevelopers.com/videos/2036-beyond-dashboards-fixing-text-to-sql-with-semantic-rag) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [Data Analytics with Microsoft Fabric: End-to-End Use Case with Data Agents](https://www.wearedevelopers.com/videos/1547-data-analytics-with-microsoft-fabric-end-to-end-use-case-with-data-agents) ## Related Articles - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)