> Markdown version of [/jobs/ext/2713507-senior-lead-data-engineering-consultant](https://www.wearedevelopers.com/jobs/ext/2713507-senior-lead-data-engineering-consultant). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior / Lead Data Engineering Consultant - **Company:** Beacon Hill Technologies - **Location:** Beacon Hill, United States (Remote available) - **Experience:** Expert - **Contract:** Temporary to permanent - **Skills:** Java (Programming Language), Cloud Database, Databases, Continuous Integration, Data Architecture, Information Engineering, Extract Transform Load (ETL), Data Systems, Database Design, Digital Architecture, Github, Mainframes, Software Tools, Standard Sql, DataOps, Enterprise Data Management, Data Ingestion, Technical Debt, Build Management, Data Lakes, Kubernetes, Storage Technologies, Deployment Automation, Enterprise Integration, Integration Frameworks, Apache Kafka, Tools for Reporting, Data Pipelines, Jenkins, Servicenow, Databricks - **Published:** September 4, 2026 - **Apply:** https://www.dice.com/job-detail/e735c255-8aa0-4506-a53c-17d1fc31c128 ## About the Role * Extensive senior-level Data Engineering experience * Data Architecture and Solution Design expertise * Enterprise Data Platform assessment and modernization experience * Strong background evaluating scalability and maintainability of existing data solutions * Database design and advanced data modeling experience * Proven ability to design and build enterprise data pipelines * Advanced SQL development and optimization skills * Experience with ETL/ELT platforms and integration solutions * Architecture review and future-state planning expertise __________________________________________________ Preferred Experience * ServiceNow platform or development experience * Understanding of ServiceNow data models and reporting capabilities * IT Service Management (ITSM) domain knowledge * Experience with Incident, Change, and Problem Management reporting * Financial Services, Banking, Insurance, Wealth Management, or other highly regulated industries * Fortune 500 or large enterprise environments * Enterprise governance and architecture frameworks * Operational analytics and service management reporting initiatives ## Description Duration: Initial 6-month engagement with strong potential for extension (12+ months anticipated based on project needs), * Conduct a comprehensive assessment of an existing enterprise data platform and reporting solution. * Evaluate data ingestion processes, transformation workflows, storage architecture, semantic models, and reporting layers. * Analyze scalability, maintainability, performance, security, supportability, and operational readiness. * Review database architecture, data models, and reporting structures. * Identify technical debt, architectural limitations, operational risks, and growth constraints. * Assess alignment with enterprise architecture standards, governance requirements, and future business needs. * Develop recommendations regarding enhancement, redesign, migration, or replacement strategies. * Define future-state architecture and modernization roadmaps. * Evaluate data lake and enterprise analytics integration opportunities. * Present findings and recommendations to engineering and business stakeholders. * Design and implement approved future-state solutions. * Build and optimize scalable data pipelines and integration frameworks. * Establish CI/CD pipelines, deployment automation, and DataOps best practices. * Support data catalog, semantic layer, and data publishing initiatives. * Collaborate with cross-functional technology and business teams. * Improve visibility into operational metrics, service performance trends, and enterprise reporting capabilities. * Document architecture decisions, standards, processes, and implementation approaches. * Provide technical leadership throughout assessment, design, and implementation phases., * Databricks * SQL * Data Lake Platforms * GitHub * GitHub Actions * Jenkins * Kubernetes * Kafka * Enterprise Analytics and Reporting Platforms, * ServiceNow * Java * Mainframe Technologies * Semantic Modeling Tools * Data Catalog Solutions * Dashboarding and Reporting Platforms * Cloud-Based Data Engineering Technologies ## Related Videos - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) - [The Road to MLOps: How Verivox Transitioned to AWS](https://www.wearedevelopers.com/videos/1050-the-road-to-mlops-how-verivox-transitioned-to-aws) - [Innovating Developer Tools with AI: Insights from GitHub Next](https://www.wearedevelopers.com/videos/1268-innovating-developer-tools-with-ai-insights-from-github-next) - [Enterprise-Cloud-Native - Fast-Paced Development & Deployment in a Highly Secure Banking Environment](https://www.wearedevelopers.com/videos/671-enterprise-cloud-native-fast-paced-development-deployment-in-a-highly-secure-banking-environment) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Our GitOps approach for deploying an Identity Provider and an API Gateway in a SaaS company](https://www.wearedevelopers.com/videos/776-our-gitops-approach-for-deploying-an-identity-provider-and-an-api-gateway-in-a-saas-company) ## Related Articles - [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Best Companies to work for in London: Top 25 Companies in 2023](https://www.wearedevelopers.com/magazine/187-best-companies-to-work-for-in-london-top-25-companies-in-2023) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs)