Data Engineer II

Icw Group
San Diego, CA, United States
3 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
3 years minimum
Working hours
Regular working hours

Tech stack

Query Performance Amazon Web Services Amazon Elastic Compute Cloud Amazon S3 Code Review Databases Continuous Integration Data Architecture Information Engineering Data Governance Data Integration Data Integrity
+22 more
Extract Transform Load (ETL) Data Warehousing Decision Support Systems Amazon DynamoDB Apache Hadoop Python (Programming Language) PostgreSQL Microsoft SQL Server Scala (Programming Language) SQL Server Integration Services System Testing Talend Data Processing Snowflake Apache Spark Apache Kafka Functional Programming Data Delivery Data Pipelines Alteryx Amazon Redshift Databricks

Job description

Experteer Overview In this role you design, build, and optimize data pipelines and storage solutions to enable data-driven decision making across ICW Group. You collaborate with IT, BI, Data Governance and Data Science teams to ensure data integrity and scalable analytics. You will work with cloud and traditional platforms to deliver real-time and batch data processing, supporting the company’s digital evolution. This is a chance to shape data architecture in a growth-focused insurer and contribute to high-impact data initiatives. Compensation / Benefits * Build and maintain scalable data pipelines and solutions (batch and streaming) across cloud and traditional platforms * Develop and optimize data models, ETL/ELT mappings, and transformation logic * Design and review data warehouse schemas and integration with new/existing sources * Perform unit, integration, and system testing to validate data against sources and optimize query performance * Collaborate with BI, Data Science, and Enterprise Architecture teams to ensure data quality and governance * Contribute to data governance practices, code reviews, and CI/CD for data pipelines * Partner with stakeholders to implement enterprise data solutions and improve data delivery architecture * Support troubleshooting and root-cause analysis for data issues and opportunities for improvement * Engage in cross-team collaboration to standardize tooling and data practices Tasks * Minimum 3 years of experience in data integration engineering (cloud or traditional) * Bachelor’s degree in a technology-related field or equivalent * Insurance experience is a plus * Data architecture or data engineering certifications strongly desired * AWS fundamentals or advanced certification preferred * Experience with data warehousing and databases (MS-SQL, PostgreSQL) * Hands-on experience with AWS services (Redshift, S3, EC2, Glue, EMR, Kinesis, Lambda, DynamoDB) * Experience with Snowflake, Databricks, Hadoop, Spark, Kafka, Python, Scala, Talend; data movement tools like SSIS, Profisee, Alteryx, Informatica * Strong analytical, communication, and self-motivation in a fast-paced environment Key requirements * competitive benefits package * medical, dental, and vision plans * 401K retirement plans with company match * paid time off * paid holidays * bonus potential

Requirements

Enterprise Architecture teams to ensure data quality and governance * Contribute to data governance practices, code reviews, and CI/CD for data pipelines * Partner with stakeholders to implement enterprise data solutions and improve data delivery architecture * Support troubleshooting and root-cause analysis for data issues and opportunities for improvement * Engage in cross-team collaboration to standardize tooling and data practices Tasks * Minimum 3 years of experience in data integration engineering (cloud or traditional) * Bachelor’s degree in a technology-related field or equivalent * Insurance experience is a plus * Data architecture or data engineering certifications strongly desired * AWS fundamentals or advanced certification preferred * Experience with data warehousing and databases (MS-SQL, PostgreSQL) * Hands-on experience with AWS services (Redshift, S3, EC2, Glue, EMR, Kinesis, Lambda, DynamoDB) * Experience with Snowflake, Databricks, Hadoop, Spark, Kafka, Python, aaaa to Talend; data movement tools like SSIS, Profisee, Alteryx, Informatica * Strong analytical, communication, and self-motivation in a fast-paced environment Key requirements * competitive benefits package * medical, dental, and vision plans * 401K retirement plans with company match * paid time off * paid holidays * bonus potential

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on us.experteer.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:43 min

The enduring legacy of the amazon S3 storage API

Chris Heilmann +3 · LIVE

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

5:08 min

Automating data collection and managing crowdsourced training image sets

Kris Howard · LIVE

5:19 min

Executing queries and scheduling pipeline jobs within DataWorks

Qiyang Duan · LIVE

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

3:44 min

Automating storage savings with S3 intelligent tiering

Sébastien Stormacq · WWC 2021

Videos

See all

Related articles

See all