> Markdown version of [/jobs/ext/2036566-brief-overviewthe-senior-enterprise-data-engineer](https://www.wearedevelopers.com/jobs/ext/2036566-brief-overviewthe-senior-enterprise-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Brief OverviewThe Senior Enterprise Data Engineer - **Company:** Prudential Locations LLC - **Location:** United States - **Experience:** Expert - **Salary:** $138,362.0 - $183,331.0 - **Contract:** Permanent contract - **Skills:** Data Analysis, Microsoft Azure, Cloud Computing, Information Systems, Databases, Continuous Delivery, Continuous Integration, Data Governance, Extract Transform Load (ETL), Data Mart, Data Structures, Data Systems, Relational Databases, Database Design, Decision Support Systems, DevOps, Programming Tools, Github, Metadata, Performance Tuning, Cloud Services, Requirements Management, SQL Databases, Technical Data Management Systems, Enterprise Data Management, Data Processing, Data Ingestion, Data Lakes, Pyspark, Information Technology, Data Management, Data Pipelines, Databricks - **Published:** August 12, 2026 - **Apply:** https://www.careerbuilder.com/job-details/sr-enterprise-data-engineer-palo-alto-ca--af08e4b5-f655-46e2-b327-8a1b37d30aa0 ## About the Role * BS/BA DEGREE IN INFORMATION TECHNOLOGY, INFORMATION SYSTEMS, BUSINESS MANAGEMENT, BUSINESS ANALYTICS, BUSINESS ADMINISTRATION OR A DIRECTLY RELATED FIELD FROM AN ACCREDITED COLLEGE OR UNIVERSITY REQUIRED. Experience Qualifications * 7 (SEVEN) OR MORE YEARS' OF EXPERIENCE IN REPORTING, ANALYTICS, BUSINESS INTELLIGENCE OR HEALTHCARE TECHNOLOGY.OR 3 (THREE) OR MORE YEARS' DEVELOPMENT EXPERIENCE IN CLOUD DATALAKE TECHNOLOGIES (I.E., PYSPARK NOTEBOOKS/PIPELINES ON DATABRICKS) UTILIZING DEVOPS, CI/CD, ORCHESTRATION PROCESSES REQUIRED. Required Knowledge, Skills and Abilities * Advanced knowledge of relational database concepts and design * Advanced data modeling skills, ability to translate business requirements into logical and physical database designs for moderate to large complex projects. * Ability to develop solutions in cloud data platforms (i.e., Azure, DataBricks, etc.) and technologies (i.e., PySpark, Notebooks, GitHub, etc.) to deploy production solutions in a secure and highly automated manner. * Expert knowledge of SQL. Proficient with ability to relate and use data across multiple data domains. * Expert knowledge and skills in SHC's standard development and design tools and general DevOps concepts/practices. * Tune performance of moderately complex solutions. * Troubleshoots and performs root cause analysis of incidents and establishes countermeasures to improve supported solutions. * Able to work without direct supervision. Provides regular updates to supervisor on pending tasks, pain points, and potential roadblocks. * Demonstrated ability for completing complex projects. * Work is of good quality with only rare problems or defects with moderate to complex solutions. * Can successfully present moderately complex ideas and information to a variety of audiences, including senior managers and industry groups. Effective verbal, written, and interpersonal communication skills. * Helps fulfill SHC's vision. Understands how their work supports the vision and proposes better ways to achieve the vision., Analysis Skills, Best Practices, Business Administration, Business Analysis, Business Intelligence Software, Business Skills, Business Support, Cloud Computing, Communication Skills, Continuous Deployment/Delivery, Continuous Integration, Customer Relations, Data Analysis, Data Lake, Data Management, Data Mart, Data Modeling, Data Processing, Data Quality, Data Structures, Database Design, Database Technology, DevOps, GitHub, Healthcare, Identify Issues, Information Technology & Information Systems, Interpersonal Skills, Leadership, Medical Genetics, Metadata, Microsoft Windows Azure, Needs Assessment, Operational Strategy, Operations Processes, Operations Research, Patient Care, Performance Tuning/Optimization, Programming Tools, Project/Program Management, Regulatory Compliance, Requirements Management, Root Cause Analysis, SQL (Structured Query Language), Standards Development, Systems Administration/Management, Team Lead/Manager, Team Player, Test Plan/Schedule, Writing Skills ## Description This role will develop data ingestion processes to the SHC Enterprise Data Platform (Lake), create data pipelines and other solutions, and automate development and operational processes to enable Data Products and solutions that improve the patient experience, patient outcomes, research capabilities, and operational results.A Brief OverviewThe Senior Enterprise Data Engineer is responsible for designing and creating complex pipelines and curated data structures/products for use by data analysts across the organization. This position is also responsible consultation and support of other data engineers in the design, development and implementation of data movement processes to populate the data structures designed.This position exists to provide data solutions for broad and consistent use across the SHC enterprise.LocationsStanford Health CareWhat you will do * With advanced technical knowledge and skills, collaborates with leaders and users to create, test and implement complex stores , data pipelines, etc. based on understanding of business needs and requirements. * Responsible for the research, road mapping and maintaining performance of SHC's standard data modeling, DevOps and development tools and processes. * Explore and innovate with new technologies to create solutions, enhance development and/or operational efficiency, etc. * Without supervision, performs analysis, development, and testing of complex data marts, and support other data engineers in performing these tasks, and encourages use of the solutions for data-driven decision making. * Possesses an advanced understanding of many data domains across SHC and uses it to produce high quality solutions. * Build strong working relationships with users and team members, including Directors and above. Gains trust and respect of key users. * Understands advanced data governance principles and practices and actively participates as a technical data steward in metadata, data quality, and other data governance areas and activities. Assists in identification and resolution of data quality issues. * Manage multiple complex activities. Manage tasks, dependencies, and user/team expectations regarding scope and timeline of solution delivery. * Provides project management / project leadership as appropriate to drive timelines and deliverables of projects across multiple departments/functions * Participates in and contributes to project working groups with team members, users, analysts, clinicians, and SHC leadership. * Leads teams to define design and development standards and conduct peer reviews of solution designs for compliance with such standards. * Defines analytics standards and best practices and support business data analysts in training and adoption of these standards. * Participates in and actively contributes to SHC analytics community meetings * Tune performance of complex solutions. * Troubleshoots and performs root cause analysis of incidents and establishes countermeasures to improve supported solutions. ## Related Videos - [Innovating Developer Tools with AI: Insights from GitHub Next](https://www.wearedevelopers.com/videos/1268-innovating-developer-tools-with-ai-insights-from-github-next) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) ## Related Articles - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [What’s the Difference between a Junior, Mid, and Senior Developer?](https://www.wearedevelopers.com/magazine/238-what-s-the-difference-between-a-junior-mid-and-senior-developer)