Data Engineer

EXL SERVICE

United States

28 days ago

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Working hours

Regular working hours

Job source

www.indeed.com

Tech stack

Clean Code Principles Amazon Elastic Compute Cloud Amazon S3 Big Data Code Review Extract Transform Load (ETL) Software Debugging Software Design Patterns DevOps Python (Programming Language) Cloud Services Standard Sql

+15 more

Software Engineering Data Logging Data Processing Delivery Pipeline Snowflake Git Pyspark Information Technology Non-relational Database Functional Programming Api Gateway Software Coding Software Version Control Data Pipelines Microservices

Job description

Design, develop, and maintain scalable data pipelines, applications, and utilities using Python and PySpark.
Build robust ETL/ELT frameworks and data processing solutions for large-scale datasets.
Develop reusable components, libraries, and automation solutions following coding standards and best practices.
Write clean, maintainable, and efficient code with proper error handling and logging.
Participate in code reviews and ensure adherence to development standards.

Requirements

Strong hands-on development experience in Python .
Experience with PySpark and large-scale data processing.
Strong understanding of software engineering principles, coding standards, design patterns, and best practices.
Experience with AWS Cloud services such as Glue, Lambda, S3, EC2, API Gateway, ECS, etc.
Hands-on experience with Snowflake or other cloud data platforms.
Solid understanding of relational and non-relational databases.
Experience developing Microservices .
Knowledge of CI/CD pipelines, Git, version control, and DevOps practices.
Strong SQL and data modeling skills.
Excellent analytical, debugging, and problem-solving skills.
Strong communication and stakeholder management skills, * Strong hands-on development experience in Python .
Experience with PySpark and large-scale data processing.
Strong understanding of software engineering principles, coding standards, design patterns, and best practices.
Experience with AWS Cloud services such as Glue, Lambda, S3, EC2, API Gateway, ECS, etc.
Hands-on experience with Snowflake or other cloud data platforms.
Solid understanding of relational and non-relational databases.
Experience developing Microservices .
Knowledge of CI/CD pipelines, Git, version control, and DevOps practices.
Strong SQL and data modeling skills.
Excellent analytical, debugging, and problem-solving skills.
Strong communication and stakeholder management skills