Senior Information Services Developer- Databricks

Indiana University of Pennsylvania
Indianapolis, IN, United States
about 2 months ago
Apply on www.indeed.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
1 year minimum
Working hours
Regular working hours
Job source

Tech stack

Agile Methodology Airflow Amazon Web Services Microsoft Azure Big Data BigQuery Cloud Computing Encodings Databases Information Engineering Data Infrastructure Data Integration
+21 more
Data Integrity Extract Transform Load (ETL) Data Systems Data Warehousing Software Debugging Information Management Metadata Microsoft Office Systems Development Life Cycle Standard Sql Reverse Engineering Microsoft SharePoint Talend Google Cloud Snowflake Apache Spark Information Technology Data Management Data Objects Physical Data Models Databricks

Job description

  • The Senior Data Engineer is critical in shaping the strategic data framework of the organization. This role demands a deep understanding of data systems and analytics, tasked with leading the development and integration of extensive business intelligence solutions. The Senior Data Engineer drives the design and maintenance of scalable data environments, ensures data integrity, and supports decision-making processes across the company with high-quality data insights. A Data Engineer Senior is responsible for designing, testing, and maintaining data management systems, developing complex data models, ensuring data integrity, participating in strategic planning, and supporting BI and analytics teams.
  • Design, construct, test, and maintain highly scalable data management systems.
  • Develop and optimize ETL processes, ensuring efficient data integration and transformation.
  • Implement data solutions that support significant, dynamic business requirements, collaborating closely with business intelligence and analytics teams.
  • Review, analyze, and modify systems including encoding, testing, debugging, and documenting programs.
  • Maintain and develop logical and physical data models, data management standards and conventions, and data naming standards and metadata.
  • Perform reverse engineering of physical data models from databases and SQL scripts.
  • Evaluate data models and physical databases for variances and discrepancies.
  • Ensure data objects and architecture support company-wide technology solutions, making adjustments as necessary. Mentor junior engineers, sharing knowledge and best practices, and guiding them in their professional development.

Requirements

  • At least 1 year experience in Databricks, * Bachelor’s Degree in Computer Science, Engineering, or related field A Master’s degree is preferred.
  • At least 5 years of relevant experience in a data engineering role, with a proven track record in sophisticated BI and data warehouse development projects.
  • Expert knowledge of SQL and experience with big data technologies such as Spark, Databricks, and modern data warehousing solutions like BigQuery, Snowflake or Redshift.
  • Strong familiarity with cloud platforms, such as AWS, Azure, or Google Cloud.
  • Experience with data integration tools (e.g., Apache Airflow, Talend) and understanding of data modeling principles.
  • Excellent problem-solving abilities, capable of tackling complex data challenges.
  • Strong communication skills and the ability to work collaboratively across team and department boundaries.
  • Healthcare industry experience preferred.
  • Fundamental understanding of the Information Management principles, IT processes, SDLC, architecture and technologies adopted by an organization.
  • Requires experience with SharePoint, and Office 365 products.
  • Experience working in an Agile environment with Azure DevOps is a plus.

About the company

Indiana University Health is unlike any other healthcare system and we’re looking for team members who share the things that matter most to us. IU Health leaders play a crucial role in advancing the mission of our organization and inspiring teams to make a meaningful difference in the lives of patients. As one of Indiana’s largest employers and the most comprehensive medical system in the state, our vision is to lead the transformation of healthcare through quality, innovation and education, and make Indiana one of the nation’s healthiest states.

IU Health is the largest health system in Indiana with nearly 40,000 team members, 15 hospitals, and $8.64 billion in operating revenue. The system’s programs in cancer, cardiovascular, neuroscience, orthopedics, pediatrics and transplants have received national recognition for quality patient care. IU Health, in partnership with the Indiana University School of Medicine, bring together highly skilled physicians, researchers, and educators into close collaboration to provide world-class care for children and adults and improve the health of patients and communities across Indiana.

Indiana University Health is dedicated to a fair hiring process and is committed to equal opportunity and nondiscrimination for all individuals, regardless of age, color, disability, ethnicity, marital status, national origin, race, religion, gender identity, expression, sexual orientation, or veteran status.

We are an equal opportunity employer. IU Health does not discriminate on the basis of race, color, religion, sex, sexual orientation, age, disability, genetic information, veteran status, national origin, gender identity and/or expression, marital status or any other characteristic protected by federal, state or local law. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.

Indiana University Health is Indiana’s most comprehensive health system, with 15 hospitals and nearly 40,000 team members serving Hoosiers across the state. Our partnership with the Indiana University School of Medicine gives our team members access to the very latest science and the very best training, advancing care for all. We’re looking for team members who share the things that matter most to us. People who are inspired by challenging and meaningful work for the good of every patient. People who are compassionate and serve with a purpose. People who aspire to excellence every day. People who are always ready to apply themselves.

You must create an Indeed account before continuing to the company website to apply

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

1:47 min

Comparing Egeria to alternative open metadata solutions

Ferd Scheepers · World Congress 2022

1:34 min

Bringing diverse skills to industrial data science roles

Katja Träumner

2:08 min

Creating standard APIs via the Egeria open metadata project

Ferd Scheepers · World Congress 2022

3:05 min

Audience questions on AI agents and pipeline vectorization

Joy Joy · World Congress 2024

Videos

See all

Related articles

See all