Data Engineer Only W2

The Bridge Ltd
Malvern, United States of America
yesterday

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Malvern, United States of America

Tech stack

Agile Methodologies
Amazon Web Services (AWS)
Big Data
Cloud Computing
Cloud Database
Code Review
Computer Programming
Data Validation
Data Cleansing
Information Engineering
Data Integration
ETL
Data Transformation
Data Warehousing
Database Development
Hadoop
Hive
Identity and Access Management
JSON
Python
PostgreSQL
MySQL
Oracle Applications
Scrum
SQL Databases
XML
Data Ingestion
Spark
AWS Lambda
Information Technology
Amazon Web Services (AWS)
Enterprise Integration
Data Management
Cloudwatch
REST
Stream Processing
Data Pipelines
Redshift

Job description

We are seeking an experienced Data Engineer with strong expertise in Python, AWS Glue, ETL development, and Annuity/Insurance domain knowledge. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines, ETL workflows, and cloud-based data integration solutions. Candidates with experience in financial services, insurance, or annuity products are highly preferred., Design, develop, and maintain scalable ETL pipelines using Python and AWS Glue. Build and optimize data ingestion, transformation, and processing workflows. Develop data integration solutions for structured and unstructured data sources. Collaborate with business stakeholders to understand data requirements and translate them into technical solutions. Work with large datasets to ensure data quality, consistency, and integrity. Optimize ETL jobs for performance, scalability, and cost efficiency. Develop and maintain data models and data warehouse solutions. Perform data validation, troubleshooting, and root cause analysis. Support production environments and resolve data-related issues. Create technical documentation, data flow diagrams, and operational procedures. Follow Agile methodologies and participate in sprint planning, code reviews, and testing. Required Skills Programming & ETL Python AWS Glue ETL Development PySpark SQL Data Transformation Data Cleansing Data Validation Cloud Technologies AWS Glue Amazon S3 AWS Lambda Amazon Redshift AWS IAM CloudWatch Databases SQL Server Oracle PostgreSQL MySQL Big Data (Preferred) Apache Spark Hadoop Hive Data Integration REST APIs JSON XML Batch & Real-Time Data Processing Domain Experience Annuity Insurance Financial Services Retirement Products Policy Administration Systems

Requirements

Bachelor''s degree in Computer Science, Information Technology, Engineering, or a related field. 5+ years of experience in Data Engineering or ETL Development. Strong hands-on experience with Python and AWS Glue. Experience building cloud-based ETL pipelines and data integration solutions. Solid SQL and database development experience. Strong understanding of data warehousing concepts and ETL best practices. Experience working in Agile/Scrum environments. Excellent analytical, communication, and problem-solving skills.

Apply for this position