Big Data Engineer

Apptad Inc.

Plano, TX, United States

3 days ago

Apply on www.careerjet.com

Prepare application

Role details

Contract type

Temporary to permanent

Employment type

Full-time (> 32 hours)

Working hours

Regular working hours

Job source

www.careerjet.com

Tech stack

Agile Methodology Data Analysis CA Workload Automation Ae Big Data Databases Continuous Integration Extract Transform Load (ETL) Linux Apache Hadoop Hadoop Distributed File System MapReduce Apache Hive

+10 more

Apache Oozie Ansible Standard Sql Shell Script SQL Databases Sqoop Apache Spark Data Pipelines Jenkins Artifactory

Job description

We are seeking an experienced Big Data Engineer to design, develop, and support scalable solutions using the Hadoop ecosystem., * Design and develop solutions using Hadoop, HDFS, Hive, Spark, Pig, and MapReduce.

Develop ETL and data processing workflows using Oozie and Sqoop.
Write and optimize SQL/Hive queries for large datasets.
Develop Linux/Unix shell scripts and manage batch jobs using Autosys.
Troubleshoot production issues and perform data analysis and root-cause investigation.
Support CI/CD, testing, and deployments using Jenkins, Ansible, and Artifactory.
Participate in Agile development, POCs, and process improvements.

Requirements

Strong hands-on Hadoop/Big Data experience.
Experience with HDFS, Hive, Spark, Pig, Oozie, Sqoop, and MapReduce.
Strong SQL and database skills.
Strong Linux/Unix and shell scripting experience.
Experience with Autosys.
Familiarity with Jenkins, Ansible, Artifactory, and CI/CD.
Strong troubleshooting, communication, and production support skills.

Preferred Skills:

Experience in large enterprise Big Data environments.
Experience with Agile teams and POCs.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerjet.com

Prepare application

Good distractions

Loading talks and stories from around this role…