Data Engineer
Role details
Job location
Tech stack
Job description
We are currently seeking a Data Engineer to be part of the Data Engineering team. This position will design and develop an ingestion process for big data processing.
General Duties/R esponsibilities (May include but are not limited to):
-
Translate s business requirements into specifications that will be used to implement the Data ingestion process.
-
Understand s the requirements, development and delivery of data solutions and lead end to end delivery .
-
Develops and implements data pipelines to support organizational initiatives.
-
Builds and maintains ETL (Extract, Transform, Load) or ELT (Extract, Load, Transform) pipelines to move data from various sources into a usable format.
-
Implements processes and tools to ensure data accuracy, consistency, and compliance with relevant policies and regulations.
-
Work s closely with data scientists , analysts, and other stakeholders to understand their data needs and provide them with the necessary data infrastructure and tools.
-
Ensur es data systems are efficient, scalable, and performant to meet the demands of data-intensive applications.
-
Creates functional and technical design documents and maintains documentation for all data processes created or modified .
Requirements
To perform this job successfully, an individual must be able to perform each essential duty satisfactorily . The requirements listed below are representative of the knowledge, skill, and/or ability required . Reasonable accommodation may be made to enable individuals with disabilities to perform the essential functions.
-
Minimum Experience:
-
5 + years of experience building data ingestion processes and tools.
-
5 + years of experience with DataBricks , Scala, Azure Data Factory ( ADF ) and SQL Server.
-
5 + years' database experience with MS SQL Server.
-
5+ years of experience in healthcare industry with proven understanding of data terminology.
-
Healthcare experience and clear understanding and working knowledge of HIPAA protocols.
-
Experience with Microsoft's Power-BI/SSRS/SSAS/Azure Data Factory and other cloud based BI and reporting services is a plus.
-
Education/Licensure:
-
BS in Computer Science, IT or equivalent or 4 additional years of relevant experience.
-
Microsoft Azure Certification is a plus.
-
Specialized Skills:
-
Excellent verbal and written communication skills .
-
Ability to effectively present information and respond to questions from groups of managers and customers.