ETL & Data Quality Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+9 more
Job description
Data Engineer Job Description We are seeking a Data Engineer with strong expertise in SQL, Python, and cloudbased data processing. The ideal candidate will be responsible for developing, optimizing, and maintaining scalable data pipelines and supporting analytics initiatives., Develop and optimize complex SQL queries, including query tuning and use of window functions. Build and maintain data processing workflows using Python Pandas, PySpark.Create automation scripts using BashShell scripting. Work with AWS services, including S3 and EC2, for data storage and processing. Design and implement efficient data models to support reporting and analytics requirements. Collaborate with crossfunctional teams to ensure data quality, performance, and scalability.
Requirements
Quality Engineering, Data Quality, Database Extract Transform and Load (ETL), Performance Tuning/Optimization, Query Optimization, Python Programming/Scripting Language, SQL (Structured Query Language), Amazon Simple Storage Service (S3), Amazon Elastic Compute Cloud (EC2), Amazon Web Services (AWS), Strong SQL skills with experience in query optimization and performance tuning. Handson experience with Python, Pandas, and PySpark.
Proficiency in BashShell scripting for automation. Experience working with AWS (S3, EC2)
Solid understanding of data modeling principles and ETL processes
Nice to have skills
Experience with largescale data platforms and distributed data processing.
Familiarity with data warehousing and cloudnative architectures., Must Have Skills Strong SQL skills with experience in query optimization and performance tuning. Handson experience with Python, Pandas, and PySpark. Proficiency in Bash Shell scripting for automation. Experience working with AWS S3, EC2.Solid understanding of data modeling principles and ETL processes.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦