Senior Data Engineer - Cloud Data Products & Analytic Enablement

Highmark Inc.
Montgomery, United States of America
yesterday

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
$ 165K

Job location

Remote
Montgomery, United States of America

Tech stack

Airflow
Data analysis
Apache HTTP Server
Google BigQuery
Cloud Database
Information Systems
Databases
Computer Engineering
Data Architecture
Information Engineering
Data Governance
ETL
Data Masking
Data Transformation
Data Structures
Data Systems
Data Virtualization
Data Warehousing
IBM DB2
Software Design Patterns
Distributed Data Store
Data Flow Control
Python
PostgreSQL
Meta-Data Management
MongoDB
MySQL
Oracle Applications
Cloud Services
DataOps
Cloudera
SQL Databases
Teradata
Data Processing
Scripting (Bash/Python/Go/Ruby)
Google Cloud Platform
Snowflake
Data Build Tool (dbt)
Data Lake
Information Technology
Collibra
Data Management
Data Pipelines
Redshift

Job description

As a Senior Data Engineer - Cloud Data Products & Analytic Enablement, you will be instrumental in transforming diverse data sources into actionable intelligence, empowering critical business decisions across our organization and within our application ecosystem.

This pivotal role demands a strong foundation in data engineering principles, combined with a keen focus on analytical engineering to unlock the full potential of our data assets.

You will leverage your deep expertise in Google Cloud Platform (GCP) technologies, including Managed Airflow (Cloud Composer), BigQuery, Cloud Run Functions, DataFlow, DataProc, and DataPlex, to design, build, and optimize scalable data pipelines.

Your work will encompass the entire data lifecycle from ingestion and processing to modeling and orchestration, ensuring the highest standards of data quality, performance, and governance.

A core aspect of this role involves translating complex engineered data into readily consumable, business-ready insights. You will achieve this by developing curated datasets and robust analytical assets., * Design, develop, and maintain robust data processes and solutions to ensure the efficient movement and transformation of data across multiple systems

  • Develop and maintain data models, databases, and data warehouses to support business intelligence and analytics needs
  • Collaborate with stakeholders across IT, product, analytics, and business teams to gather requirements and provide data solutions that meet organizational needs
  • Monitor work against production schedule,provide progress updates, and report any issues or technical difficulties to lead developers regularly
  • Implement and manage data governance practices, ensuring data quality, integrity, and compliance with relevant regulations.
  • Collaborate on the design and implementation of data security measures, including access controls, encryption, and data masking
  • Mentor other associate and intermediate data engineers as needed
  • Perform data analysis and provide insights to support decision-making across various departments
  • Stay current with industry trends and emerging technologies in data engineering, recommending new tools and best practices as needed
  • Other duties as assigned or requested.

Requirements

Success in this position requires exceptional proficiency in SQL and Python, coupled with the ability to strategically partner with diverse stakeholders, translating intricate business requirements into impactful, scalable data products., * 5 years of experience in design and analysis of algorithms, data structures, and design patterns in the building and deploying of scalable, highly available systems

  • 5 years of experience in a data engineering, ETL development, or data management role.
  • 5 years of experience in SQL and experience with database technologies (e.g., MySQL, PostgreSQL, MongoDB).
  • 5 years of experience in data warehousing concepts and experience with data warehouse solutions (e.g., Snowflake, Redshift, BigQuery)

Preferred

  • 7+ years of experience in designing, developing, and meticulously implementing robust data solutions, encompassing sophisticated structuring and transformation of data from diverse, complex source systems.
  • 7+ years of experience in producing high-quality, efficient, and maintainable data-related code that underpins critical stakeholder applications.
  • 7+ years of experience working across a multitude of technology systems, consistently designing innovative solutions or developing impactful data solutions specifically within the complex healthcare or insurance industry.
  • 7+ years of experience in strategically translating intricate business requirements, design mockups, prototypes, and user stories into precise technical designs and highly impactful, scalable data solutions.
  • 7+ years of experience with both SQL and Python, utilizing these languages for sophisticated data manipulation, advanced analytical insights, and the development of resilient data pipelines.
  • 5+ years of experience leveraging core GCP data services, including BigQuery, DataFlow, Cloud Composer (Managed Airflow), DataProc, and Cloud Run, optimizing their use for cloud-native data architectures.
  • 5+ years of experience with traditional on-premise database systems, including Oracle, Teradata, and DB2, bridging legacy and modern data landscapes.
  • 5+ years of experience operating within Unix/Linux environments, including scripting and system-level data operations.
  • Possesses proven, hands-on experience with dbt (data build tool) for advanced data transformation and the development of sophisticated analytical data models.
  • Experienced with cutting-edge data virtualization tools such as Starburst (Trino) or other composable data platforms, enabling unified access to distributed data assets.
  • Skilled in leveraging advanced data quality engines (e.g., Monte Carlo, Soda) to ensure proactive data observability, integrity, and reliability across the data landscape.
  • Familiar with sophisticated data catalog systems (e.g., Atlan, Collibra) for comprehensive metadata management, discovery, and robust data governance.
  • Holds practical experience with Lakehouse technologies and modern open table formats (e.g., Apache Iceberg, Delta Lake), contributing to scalable and flexible data architectures., * Demonstrated ability to achieve stretch goals in a highly innovative and fast-paced environment
  • Adaptability: Strong ability to take on diverse tasks and projects, adapting to the evolving needs of the organization
  • Analytical Thinking: Strong analytical skills with a focus on detail and accuracy
  • Interest and ability to learn other data development technologies/languages as needed
  • Technical Proficiency: Comfortable with a range of data tools and technologies, with a willingness to learn new skills as needed
  • Strong track record in designing and implementing large-scale data sources
  • Strong sense of ownership, urgency, and drive
  • Demonstrated passion for user experience and improving usability
  • Team Collaboration: A team player who can work effectively in cross-functional environments
  • Experience and willingness to mentor junior data engineers and help develop their skills and leadership

EDUCATION

Required

  • Bachelor's degree in Computer Science, Information Systems, Data Science, Computer Engineering or related field

Preferred

  • Master's degree in Computer Science, Information Systems, Data Science, Computer Engineering or related field

LICENSES or CERTIFICATIONS, Lifting: up to 10 pounds

Constantly

Lifting: 10 to 25 pounds

Occasionally

Lifting: 25 to 50 pounds

Benefits & conditions

As a component of job responsibilities, employees may have access to covered information, cardholder data, or other confidential customer information that must be protected at all times. In connection with this, all employees must comply with both the Health Insurance Portability Accountability Act of 1996 (HIPAA) as described in the Notice of Privacy Practices and Privacy Policies and Procedures as well as all data security guidelines established within the Company's Handbook of Privacy Policies and Practices and Information Security Policy.

Furthermore, it is every employee's responsibility to comply with the company's Code of Business Conduct. This includes but is not limited to adherence to applicable federal and state laws, rules, and regulations as well as company policies and training requirements.

Pay Range Minimum:

$102,700.00

Pay Range Maximum:

$164,600.00

About the company

Highmark Health

Apply for this position