Data Engineer

Octans Group Llc
Malvern, United States of America
2 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Malvern, United States of America

Tech stack

Amazon Web Services (AWS)
Big Data
Unix
Data as a Services
Data Validation
ETL
DevOps
Python
NumPy
Oracle Applications
Performance Tuning
SQL Databases
Enterprise Data Management
Snowflake
Pandas
PySpark
Amazon Web Services (AWS)
Functional Programming
Terraform
Data Pipelines
Sql Tuning
Docker
Jenkins
Redshift

Requirements

We are seeking an experienced Senior Data Engineer with strong expertise in Python, PySpark, AWS Glue, and SQL to design and develop scalable ETL/ELT data pipelines and modernize enterprise data platforms. The ideal candidate will have hands-on experience with AWS data services, complex SQL performance tuning, data quality, and large-scale data processing., * Python, PySpark, Pandas, NumPy

  • AWS Glue, S3, Lambda, Redshift, Athena
  • SQL (Oracle/Snowflake) with performance tuning
  • ETL/ELT pipeline development
  • Data validation and data quality
  • Unix scripting and automation
  • Experience with DevOps tools (Jenkins, Docker, Terraform) is a plus
  • Investment/Financial domain experience preferred

Apply for this position