Senior Data Engineer

TWO95 International, Inc
Sunnyvale, United States of America
1 month ago

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Sunnyvale, United States of America

Tech stack

Big Data
Computer Programming
Databases
ETL
Software Debugging
Distributed Systems
Hadoop
MapReduce
Hive
Performance Tuning
Shell Script
Teradata
Scripting (Bash/Python/Go/Ruby)
Sql Optimization
Spark
Information Technology
Data Lineage
Real Time Data
Kafka
Physical Design

Job description

Provide business insights, while leveraging internal tools and systems, databases and industry data

Requirements

  • Ability to document requirements, data lineage, subject matter in both business and technical terminology.

  • Guide and learn from other team members.

  • Demonstrated ability to transform business requirements to code, specific analytical reports and tools

  • This role will involve coding, analytical modeling, root cause analysis, investigation, debugging, testing and collaboration with the business partners, product managers other engineering team.

Minimum Qualifications

  • Very Strong engineering skills. Should have an analytical approach and have good programming skills.

  • Minimum of 5+ years' experience. Experience in retail business will be a plus.

  • Excellent written and verbal communication skills for varied audiences on engineering subject matter

Must Have

  • Strong analytical background

  • Self-starter

  • Must be able to reach out to others and thrive in a fast-paced environment.

  • Strong background in transforming big data into business insights

Technical Requirements

  • Knowledge/experience on Teradata Physical Design and Implementation, Teradata SQL Performance Optimization

  • Experience with Teradata Tools and Utilities (FastLoad, MultiLoad, BTEQ, FastExport)

  • Advanced SQL (preferably Teradata)

  • Experience working with large data sets, experience working with distributed computing (MapReduce, Hadoop, Hive, Pig, Apache Spark, etc.).

  • Strong Hadoop scripting skills to process petabytes of data

  • Experience in Unix/Linux shell scripting or similar programming/scripting knowledge

  • Experience in ETL/ processes

  • Real time data ingestion (Kafka)

  • BS degree in specific technical fields like computer science, math, statistics preferred

Education

Apply for this position