ETL & Data Quality Engineer

Tech3pillars Technologies
Englewood, CO, United States
10 days ago
Apply on www.careerbuilder.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours

Tech stack

Amazon Web Services Amazon Elastic Compute Cloud Amazon S3 Bash Shell Databases Extract Transform Load (ETL) Data Warehousing Database Queries Distributed Computing Environment Python (Programming Language) Performance Tuning Query Optimization
+9 more
SQL Databases Data Processing Scripting Freeform SQL Data Storage Technologies Pandas Pyspark Data Management Data Pipelines

Job description

Data Engineer Job Description We are seeking a Data Engineer with strong expertise in SQL, Python, and cloudbased data processing. The ideal candidate will be responsible for developing, optimizing, and maintaining scalable data pipelines and supporting analytics initiatives., Develop and optimize complex SQL queries, including query tuning and use of window functions. Build and maintain data processing workflows using Python Pandas, PySpark.Create automation scripts using BashShell scripting. Work with AWS services, including S3 and EC2, for data storage and processing. Design and implement efficient data models to support reporting and analytics requirements. Collaborate with crossfunctional teams to ensure data quality, performance, and scalability.

Requirements

Quality Engineering, Data Quality, Database Extract Transform and Load (ETL), Performance Tuning/Optimization, Query Optimization, Python Programming/Scripting Language, SQL (Structured Query Language), Amazon Simple Storage Service (S3), Amazon Elastic Compute Cloud (EC2), Amazon Web Services (AWS), Strong SQL skills with experience in query optimization and performance tuning. Handson experience with Python, Pandas, and PySpark.

Proficiency in BashShell scripting for automation. Experience working with AWS (S3, EC2)

Solid understanding of data modeling principles and ETL processes

Nice to have skills

Experience with largescale data platforms and distributed data processing.

Familiarity with data warehousing and cloudnative architectures., Must Have Skills Strong SQL skills with experience in query optimization and performance tuning. Handson experience with Python, Pandas, and PySpark. Proficiency in Bash Shell scripting for automation. Experience working with AWS S3, EC2.Solid understanding of data modeling principles and ETL processes.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerbuilder.com
Prepare application

Good distractions

Loading talks and stories from around this role…