ETL/Data Engineer

BOGART AND ASSOCIATES INC

Huntsville, United States of America

1 month ago

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Working hours

Regular working hours

Languages

English

Experience level

Senior

Huntsville, United States of America

Java

Amazon Web Services (AWS)

Databases

Data Validation

Data Integration

ETL

Data Storage Technologies

Spark

Information Technology

Amazon Web Services (AWS)

Data Lakehouse

Data Pipelines

Redshift

Databricks

8+ years of IT experience

Strong proficiency in programming languages such as Scala, or Java.
Experience with data validation, cleansing, and enrichment techniques to improve the accuracy and completeness of data.
Experience monitor and troubleshoot ETL processes to identify and resolve issues in a timely manner.
Experience in designing and developing ETL workflows using tools like Apache Spark or AWS Glue.
In-depth knowledge of ETL best practices, data integration techniques, and data quality management.
Familiarity with different data storage technologies and databases, such as Amazon S3 or Amazon Redshift
Build and optimize data pipelines to extract data from various sources, transform it into the required format, and load using Databricks and AWS services.
Bachelor's degree Preferred:
Understanding of concepts of Data Lakehouse architecture is a plus
Experience monitoring and troubleshooting ETL processes to identify and resolve issues in a timely manner.