Senior Data Engineer

IDR, Inc.
Eagan, United States of America
15 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
$ 121K

Job location

Remote
Eagan, United States of America

Tech stack

Java
Airflow
Azure
Google BigQuery
Computer Programming
ETL
Data Security
Data Structures
Data Systems
Dimensional Modeling
Python
Microsoft SQL Server
Standard Sql
DataOps
SQL Databases
Data Streaming
Workflow Management Systems
Google Cloud Platform
GIT
Information Technology
Software Version Control
Data Pipelines

Job description

IDR is seeking a Senior Data Engineer to join one of our top clients for a remote contract opportunity. This role offers the chance to design and manage critical data pipelines on cloud platforms, supporting healthcare data analytics and ensuring reliable, scalable data operations., * Develop and maintain end-to-end ETL/ELT pipelines on cloud platforms like GCP and Azure to support healthcare data needs.

  • Collaborate with stakeholders to gather requirements and translate them into efficient data solutions.
  • Model data structures for analytical purposes, including dimensional modeling and handling slowly-changing dimensions.
  • Ensure pipelines are optimized for performance, reliability, and security, adhering to healthcare compliance standards.
  • Lead technical direction for data projects, especially when requirements are unclear or evolving.
  • Use orchestration tools such as Airflow, Cloud Composer, or Prefect to automate workflows.
  • Drive continuous improvement by exploring new tools and techniques to enhance data processes.

Requirements

  • Bachelor's degree in Computer Science, Information Technology, or a related field, or equivalent experience with at least 5 years in data engineering.
  • Over 5 years of practical experience working with SQL in a production environment.
  • At least 3 years of building and maintaining automated data pipelines using batch or streaming methods.
  • Proficiency in programming with SQL, Java, or Python for pipeline development.
  • Hands-on experience working with cloud platforms such as GCP, Azure, BigQuery, and SQL Server.
  • Deep understanding of designing scalable, high-performance ETL/ELT pipelines.
  • Familiarity with orchestration tools like Airflow, Cloud Composer, or Prefect.
  • Strong knowledge of data modeling techniques, including dimensional modeling and handling slowly-changing dimensions.
  • Working knowledge of HIPAA regulations and PHI data security practices.
  • Experience with version control systems like Git and CI/CD pipelines.
  • Ability to independently manage projects from requirements to deployment, prioritizing operational stability.
  • Skilled in translating business needs into technical solutions and communicating effectively with stakeholders.
  • Proactive in exploring new data tools and trends, with a focus on continuous learning.

Benefits & conditions

Pulled from the full job description

  • Health insurance
  • Vision insurance
  • Dental insurance
  • Life insurance, * Competitive hourly pay rate of $55-58.
  • Fully remote work environment with flexible scheduling.
  • Opportunity to work on impactful healthcare data projects on enterprise cloud platforms.
  • Collaborate with a team committed to innovation and continuous improvement.
  • Gain experience with modern data engineering tools and practices.
  • Potential for contract extension or conversion based on performance.

Why IDR?

  • 25+ Years of Proven Industry Experience in 4 major markets
  • Employee Stock Ownership Program
  • Medical, Dental, Vision, and Life Insurance
  • ClearlyRated's Best of Staffing® Client and Talent Award winner 12 years in a row

Compensation Range: $55-58/hr

#LI-Remote

Apply for this position