Data Engineer

The Nhs

United States

3 days ago

Apply on www.careerbuilder.com

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Compensation

$120,640.0

Working hours

Regular working hours

Job source

www.careerbuilder.com

Tech stack

Agile Methodology Amazon Web Services Amazon S3 Data Analysis Cloud Computing Cloud Database Databases Continuous Delivery Continuous Integration Data Distribution Service Extract Transform Load (ETL) Data Mapping

+17 more

Data Mining Data Warehousing Apache Hive Python (Programming Language) Performance Tuning Query Optimization Standard Sql SQL Databases Data Processing Scripting Fast Healthcare Interoperability Resources Snowflake Gitlab Star Schema Amazon Simple Queue Service (SQS) Terraform Databricks

Job description

Work with clients & implementation team and understand the data distribution requirements
Perform data analysis and data mapping required to produce client output.
Build the data distribution extracts and scripts
Optimize the performance of the data extract scripts

Requirements

Proficient with Python and SQL
Build and manage efficient ETL pipelines using Databricks workflows or other orchestration framework
Familiarity with both structured and semi structured data and ingesting and processing this data using spark
Fundamental AWS services (S3, SQS) or similar services for other clouds
Terraform and GitLab CICD
Query tuning and performance optimization in SQL and/or Spark SQL
Familiarity with data warehousing (snowflake or similar)
Spark SQL
AWS, Databricks, Snowflake
Experience working for a cloud-based data services provider to large healthcare clients.
FHIR experience
Communicate with technical and non-technical stakeholders
Experience handling large volume of data.
Root Cause Analysis
Organizational skills
Agile development methodology, Agile Programming Methodologies, Amazon Simple Storage Service (S3), Amazon Web Services (AWS), Cloud Computing, Continuous Deployment/Delivery, Continuous Integration, Data Analysis, Data Mapping, Data Processing, Data Warehousing, Database Extract Transform and Load (ETL), Healthcare Providers, Organizational Skills, Performance Tuning/Optimization, Python Programming/Scripting Language, Root Cause Analysis, SQL (Structured Query Language), Sales Pipeline, Scripting (Scripting Languages), Simple Queue Service (SQS), Snowflake Schema, Structured Data