Data Engineer

IQZ Systems, LLC
Alpharetta, United States of America
2 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Junior

Job location

Alpharetta, United States of America

Tech stack

Amazon Web Services (AWS)
Information Systems
Data Files
Data Integrity
ETL
Hadoop
MapReduce
Hive
SQL Databases
Data Storage Technologies
Snowflake
Spark
Information Technology
Kafka
Data Delivery
Stream Processing
Apache Storm

Job description

  • Design, develop, and maintain data solutions, pipelines and analytics applications using various tools and technologies including Hadoop, Spark, Hive, Kafka, SQL, MapReduce, Apache Kafka, Apache Storm, AWS, Snowflake etc.
  • Gather & analyze requirements.
  • Identify and implement process improvements.
  • Assemble large, complex data sets to meet requirements.
  • Implement methods to improve data reliability and data quality.
  • Design and develop frameworks to stream data.
  • Optimize data delivery and re-design infrastructure for greater scalability.
  • Perform troubleshooting and provide issue resolution and similar duties.

Requirements

Do you have experience in Real-time data processing implementation?, * MS or foreign equivalent in Computer Science or Engineering (any) or Information Systems or Data Science or Related

  • 1 year experience in data storage, analysis and pipelines, ETL, Apache Kafka and Apache Storm.

Full Time. Travel involved to client locations within the US.

Apply for this position