Data Engineer

Daniels
Chicago, United States of America
4 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
$ 149K

Job location

Chicago, United States of America

Tech stack

API
Artificial Intelligence
Data analysis
Automation of Tests
Software as a Service
Databases
Information Engineering
Data Governance
Data Infrastructure
ETL
Data Transformation
Data Normalization
Github
Python
Software Engineering
SQL Databases
Systems Integration
Technical Data Management Systems
Data Storage Technologies
Sql Optimization
Change Data Capture
PySpark
Software Version Control
Databricks

Job description

A technical Data Engineer who is responsible for designing, building, and implementing data infrastructure that powers the organization's analytics, system integrations, and AI initiatives. This role is responsible for architecting scalable pipelines that ingest data from a wide range of applications, APIs, databases, files, and SaaS platforms into Databricks. Why Daniels Health? Daniels Health is a mission-driven global innovator in healthcare waste management, operating across the U.S., Australia, Canada, Europe, and South Africa. We're experiencing significant global growth-expanding our U.S. footprint through key facility acquisitions, strengthening our presence in Europe, and growing operations in Australia, Canada, and South Africa. As a consistently recognized industry leader, we're scaling our data and AI capabilities to power smarter decision-making, seamless integrations, and sustainable innovation across our rapidly expanding global operations., * Architect, build, and maintain robust ELT/ETL pipelines ingesting data from custom applications, third-party APIs, databases, files, and SaaS platforms into Databricks.

  • Develop and maintain reverse ETL pipelines to move curated data from Databricks back into operational or application systems.
  • Transform raw data into structured and governed bronze and silver datasets using PySpark, SQL, Databricks notebooks/jobs and similar languages.
  • Implement schema management, data normalization, change-data-capture processing, and incremental load strategies.
  • Optimize ETL performance, data storage, and job execution costs., At Daniels Health, we are committed to supporting our employees' well-being, work-life balance, and career growth through a comprehensive benefit package. Eligible employees enjoy benefits such as medical, dental, and vision insurance, retirement savings plans with company match contributions, paid vacation and sick time, wellness resources, life insurance, and professional development opportunities." Be Part of Daniels Health's Global Growth Story If you want to build high-quality data products that drive meaningful outcomes-and you're energized by the idea of supporting a company scaling worldwide-we'd love to meet you. Apply now and help shape the future of analytics at Daniels Health. Candidates must currently reside in the United States and be authorized to work without sponsorship. Daniels Health & Sharpsmart is an equal opportunity employer. In accordance with anti-discrimination law, it is the purpose of this policy to effectuate these principles and mandates. Daniels Health & Sharpsmart prohibit discrimination and harassment of any type and affords equal employment opportunities to employees and applicants without regard to race, color, religion, sex, age, national origin, disability status, protected veteran status, or any other characteristic protected by law. Daniels Health & Sharpsmart conforms to the spirit as well as to the letter of all applicable laws and regulations. We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.

Requirements

Do you have experience in Version control?, * 5+ years of data engineering or software engineering experience

  • Advanced SQL and Python expertise with proven ability to write efficient, scalable code
  • Expert level experience using Databricks
  • Familiarity with GitHub, version control workflows, and automated testing practices
  • Understanding of data quality frameworks and experience working in Agile/Scrum environments
  • Deep understanding of data modeling techniques, ETL/ELT, and medallion architecture.

Benefits & conditions

Pulled from the full job description

  • Health insurance
  • Retirement plan
  • Vision insurance
  • Dental insurance
  • Life insurance, "The pay range for this position is $117,555 to $149,025 salary. Actual compensation within this range will depend on factors unique to each candidate, such as prior experience, skill, certifications, and work location. Pay variations by location reflect local conditions and differences in the cost of labor.

Apply for this position