Senior Cloud Data Engineer

The Smart

Marlborough, MA, United States

10 days ago

Apply on www.indeed.com

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Experience required

3 years minimum

Working hours

Regular working hours

Job source

www.indeed.com

Tech stack

Airflow Amazon Web Services Cloud Computing Cloud Database Cloud Engineering Continuous Integration Data Architecture Information Engineering Data Governance Data Infrastructure Data Integration Extract Transform Load (ETL)

+24 more

Data Transformation Data Systems Data Warehousing Linux Document-Oriented Databases Github Python (Programming Language) Metadata Performance Tuning Power BI Cloud Services Standard Sql Shell Script SQL Databases Tableau (Software) Enterprise Data Management Cloud Platform System Data Ingestion Informatica Powercenter Snowflake Storage Technologies Enterprise Integration Data Management Data Pipelines

Job description

Mass DPH is seeking a Senior Cloud Data Engineer to support its Data Modernization Initiative (DMI), focused on building a modern Enterprise Data Platform utilizing AWS, Snowflake, Informatica, and related cloud technologies. This role will lead cloud data architecture, data pipeline development, data integration, and modernization efforts supporting public health analytics and decision-making across the Commonwealth. Key Responsibilities

Design, develop, and maintain cloud-based data platforms and data pipelines.
Architect and implement centralized and decentralized data solutions, including Data Mesh architectures.
Develop scalable data ingestion, transformation, and integration solutions using AWS, Snowflake, Informatica IICS, SQL, and Python.
Collaborate with business and technical stakeholders to define and implement data engineering solutions.
Ensure compliance with data governance, security, HIPAA, and privacy requirements.
Implement data management, metadata, and governance best practices.
Monitor, optimize, and troubleshoot data platform performance.
Develop ETL/ELT workflows and orchestration processes using Airflow.
Lead solution design sessions, architecture reviews, and technical discussions.
Document data architecture, processes, standards, and best practices.
Review ETL requirements and provide technical leadership to data engineering teams.

Requirements

5+ years of experience in Data Engineering, Data Warehousing, Data Architecture, ETL, and Enterprise Data Platforms.
Strong experience designing and implementing enterprise data pipelines.
Experience with decentralized architectures such as Data Mesh.
3-5 years of AWS cloud platform experience.
5+ years of Snowflake experience.
Experience building end-to-end data pipelines.
Strong SQL and Python development skills.
Experience with Informatica Intelligent Cloud Services (IICS).
Experience with Airflow orchestration and workflow automation.
Experience with GitHub and CI/CD processes.
Strong Unix/Linux and shell scripting experience.
Experience working with large-scale, multi-terabyte cloud data platforms.
Knowledge of system administration, database administration, networking, and storage architectures.
Experience working with healthcare data and HIPAA compliance requirements., * AWS Certification.
Snowflake Certification.
Cloud Data Engineering Certification.
Tableau and/or Power BI experience.
Advanced Informatica IICS expertise.
Public Health or Healthcare industry experience.

Core Skills AWS * Snowflake * Informatica IICS * Airflow * Python * SQL * Data Engineering * ETL/ELT * Data Warehousing * Data Mesh * Cloud Architecture * Data Modeling * Data Governance * GitHub * CI/CD * Linux * Shell Scripting * HIPAA * Enterprise Data Platforms * Performance Optimization