Data Engineer Only W2
Role details
Job location
Tech stack
Job description
We are seeking an experienced Data Engineer with strong expertise in Python, AWS Glue, ETL development, and Annuity/Insurance domain knowledge. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines, ETL workflows, and cloud-based data integration solutions. Candidates with experience in financial services, insurance, or annuity products are highly preferred., Design, develop, and maintain scalable ETL pipelines using Python and AWS Glue. Build and optimize data ingestion, transformation, and processing workflows. Develop data integration solutions for structured and unstructured data sources. Collaborate with business stakeholders to understand data requirements and translate them into technical solutions. Work with large datasets to ensure data quality, consistency, and integrity. Optimize ETL jobs for performance, scalability, and cost efficiency. Develop and maintain data models and data warehouse solutions. Perform data validation, troubleshooting, and root cause analysis. Support production environments and resolve data-related issues. Create technical documentation, data flow diagrams, and operational procedures. Follow Agile methodologies and participate in sprint planning, code reviews, and testing. Required Skills Programming & ETL Python AWS Glue ETL Development PySpark SQL Data Transformation Data Cleansing Data Validation Cloud Technologies AWS Glue Amazon S3 AWS Lambda Amazon Redshift AWS IAM CloudWatch Databases SQL Server Oracle PostgreSQL MySQL Big Data (Preferred) Apache Spark Hadoop Hive Data Integration REST APIs JSON XML Batch & Real-Time Data Processing Domain Experience Annuity Insurance Financial Services Retirement Products Policy Administration Systems
Requirements
Bachelor''s degree in Computer Science, Information Technology, Engineering, or a related field. 5+ years of experience in Data Engineering or ETL Development. Strong hands-on experience with Python and AWS Glue. Experience building cloud-based ETL pipelines and data integration solutions. Solid SQL and database development experience. Strong understanding of data warehousing concepts and ETL best practices. Experience working in Agile/Scrum environments. Excellent analytical, communication, and problem-solving skills.