Data Engineer - Remote

Sentara Healthcare Inc
Virginia Beach, VA, United States
about 2 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
3 years minimum
Compensation
$80,205.0 - $133,682.0
Working hours
Shift work
Job source

Tech stack

Microsoft Azure Cloud Computing Extract Transform Load (ETL) Database Queries Software Debugging File Systems Metadata Git Data Lakes Pyspark Software Version Control Data Pipelines
+1 more
Databricks

Job description

We are looking for a Data Engineer to support a modern data platform built on Databricks. This role will focus on building scalable data pipelines, supporting a metadata-driven ingestion framework, and ensuring data quality and governance are embedded into the platform., * Develop and maintain data pipelines using PySpark and Databricks

  • Work within a metadata-driven ingestion framework to onboard new datasets
  • Implement data quality checks and validation rules within pipelines
  • Support ingestion from file-based sources and ingestion tools (e.g., Fivetran)
  • Handle schema changes, incremental loads, and file processing patterns
  • Contribute to data governance practices including tagging, metadata, and lineage
  • Troubleshoot and resolve pipeline failures and performance issues
  • Collaborate with architects and stakeholders on data onboarding and requirements
  • Follow and contribute to coding standards, reusable components, and best practices

Requirements

Do you have experience in Version control?, Do you have a Bachelor’s degree?, * Experience in lieu of a Bachelor’s Degree

  • 3+ years of relevant experience with a degree
  • 5+ years of relevant experience without a degree, * Required to 3 to 5 years of relevant experience
  • Hands-on experience with PySpark and Databricks
  • Strong SQL skills
  • Experience building ETL/ELT data pipelines
  • Understanding of Delta Lake concepts (merge, schema evolution, partitions)
  • Familiarity with cloud platforms (Azure preferred)
  • Basic experience with Git and version control
  • Exposure to data catalog or governance tools (e.g., DataHub)
  • Experience with Fivetran or similar ingestion tools
  • Understanding of data quality and validation concepts
  • Experience working with metadata-driven frameworks
  • Strong problem-solving and debugging skills
  • Ability to work in a structured, framework-driven environment
  • Focus on data quality, not just pipeline execution
  • Willingness to learn and adapt in a fast-evolving data ecosystem

Benefits & conditions

3.73.7 out of 5 stars Virginia Beach, VA 23454 Remote $80,204.80 - $133,681.60 a year - Full-time, Pulled from the full job description

  • 403(b) matching
  • Tuition reimbursement
  • Pet insurance
  • 403(b)
  • Paid parental leave
  • Parental leave
  • Health insurance, We provide market-competitive compensation packages, inclusive of base pay, incentives, and benefits. The base pay rate for Full Time employment is: $80,204.80 - $133,681.60. Additional compensation may be available for this role such as shift differentials, standby/on-call, overtime, premiums, extra shift incentives, or bonus opportunities.

Keywords: Data Engineer, Azure, ACP, Azure Cloud Platform, Fivetran, metadata, PySpark, Databricks

Benefits: Caring For Your Family and Your Career

  • Medical, Dental, Vision plans
  • Adoption, Fertility and Surrogacy Reimbursement up to $10,000
  • Paid Time Off and Sick Leave
  • Paid Parental & Family Caregiver Leave
  • Emergency Backup Care
  • Long-Term, Short-Term Disability, and Critical Illness plans
  • Life Insurance
  • 401k/403B with Employer Match
  • Tuition Assistance - $5,250/year and discounted educational opportunities through Guild Education
  • Student Debt Pay Down - $10,000
  • Reimbursement for certifications and free access to complete CEUs and professional development
  • Pet Insurance
  • Legal Resources Plan
  • Colleagues have the opportunity to earn an annual discretionary bonus if established system and employee eligibility criteria is met.

About the company

Sentara Health is an equal opportunity employer and prides itself on the diversity and inclusiveness of its close to an almost 30,000-member workforce. Diversity, inclusion, and belonging is a guiding principle of the organization to ensure its workforce reflects the communities it serves.

In support of our mission “to improve health every day,” this is a tobacco-free environment.

For positions that are available as remote work, Sentara Health employs associates in the following states

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer · Coffee With Developers

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

1:47 min

Comparing Egeria to alternative open metadata solutions

Ferd Scheepers · World Congress 2022

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

56 sec

Favorite git commands and the importance of patch commits

Eileen Uchitelle Eileen Uchitelle +1 · Coffee With Developers

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

Videos

See all

Related articles

See all