Lead Data Engineer

• IT Management
• Data Integration
• Research
• Database
• Data Processing
• Optimization
• Amazon Web Services
• Data Extraction
• Data Quality
• Extract
• Transform
• Load
• ELT
• IaaS
• Microsoft Azure
• Databricks
• Cloud Computing
• Advanced Analytics, The Lead Data Engineer- People will be responsible for leading the design, development, and implementation of data engineering solutions to support our data-driven initiatives. This role requires a strong background in data engineering, cloud technologies, and technical leadership, with proven experience in delivering scalable and robust data platforms in a healthcare or research environment.

Responsibilities:

• Data Integration and Processing: Lead the design and architecture of scalable and reliable data pipelines to ingest, process, and transform large volumes of healthcare data from diverse sources, including electronic health records (EHR), clinical systems, research databases, and external data feeds. Evaluate and recommend appropriate data technologies, platforms, and tools to optimize data processing, performance, and cost-effectiveness.
• ETL/ELT Development: Coordinate and lead the build and optimization of ETL/ELT processes and work within Cloud technology such as AWS, Azure and/or Databricks to ensure efficient data extraction, transformation, and loading while maintaining data quality, consistency, and integrity. Collaborate with a variety of stakeholders across the organization, including senior leaders, to understand data requirements and translate them into effective ETL/ELT solutions that meet organizational goals.
• Cloud Infrastructure and Technologies: Implement and maintain cloud-based data platforms and services, leveraging technologies such as Azure and Databricks. Design and deploy data solutions using cloud-native services to support advanced analytics, machine learning, and data visualization initiatives.
• Data Governance and Security: Guide the establishment and enforcement of data standards, data governance policies, and best practices to ensure the accuracy, completeness, consistency and integrity of healthcare data. Implement data monitoring, validation, and lineage tracking mechanisms to ensure compliance with regulatory requirements and organizational data governance policies, including definitional and quality standards.
• Project Management: Independently manage moderately complex projects from concept to execution, coordinating with other PennDnA teams as needed.
• Collaboration: Build relationships with PennDnA and client stakeholders, including senior leaders. Collaborate with cross-functional teams to understand business needs and develop solutions that align with organizational goals. Help set the team’s direction, contributing to team strategy and roadmap.
• Continuous Improvement: Stay current with industry trends, best practices, and emerging technologies. Lead continuous improvement for data engineering. Contribute to a culture of performance excellence.

• Bachelor of Arts or Science Computer Science, Information Systems, or related field (Required)
• And 6+ years’ Experience in data engineering, database management, or related roles, with significant experience in managing complex projects. Proven track record of independently leading projects from concept to execution, coordinating with cross-functional teams, as needed. (Required)
• Master of Arts or Science Computer Science, Information Systems, or related field (Preferred)

Penn Medicine is dedicated to our tripartite mission of providing the highest level of care to patients, conducting innovative research, and educating future leaders in the field of medicine. Working for this leading academic medical center means collaboration with top clinical, technical and business professionals across all disciplines.

Today at Penn Medicine, someone will make a breakthrough. Someone will heal a heart, deliver hopeful news, and give comfort and reassurance. Our employees shape our future each day. Are you living your life’s work?, We believe that the best care for our patients starts with the best care for our employees. Our employee benefits programs help our employees get healthy and stay healthy. We offer a comprehensive compensation and benefits program that includes one of the finest prepaid tuition assistance programs in the region. Penn Medicine employees are actively engaged and committed to our mission. Together we will continue to make medical advances that help people live longer, healthier lives.