Senior Data Engineer
Role details
Job location
Tech stack
Job description
Provide business insights, while leveraging internal tools and systems, databases and industry data
Requirements
-
Ability to document requirements, data lineage, subject matter in both business and technical terminology.
-
Guide and learn from other team members.
-
Demonstrated ability to transform business requirements to code, specific analytical reports and tools
-
This role will involve coding, analytical modeling, root cause analysis, investigation, debugging, testing and collaboration with the business partners, product managers other engineering team.
Minimum Qualifications
-
Very Strong engineering skills. Should have an analytical approach and have good programming skills.
-
Minimum of 5+ years' experience. Experience in retail business will be a plus.
-
Excellent written and verbal communication skills for varied audiences on engineering subject matter
Must Have
-
Strong analytical background
-
Self-starter
-
Must be able to reach out to others and thrive in a fast-paced environment.
-
Strong background in transforming big data into business insights
Technical Requirements
-
Knowledge/experience on Teradata Physical Design and Implementation, Teradata SQL Performance Optimization
-
Experience with Teradata Tools and Utilities (FastLoad, MultiLoad, BTEQ, FastExport)
-
Advanced SQL (preferably Teradata)
-
Experience working with large data sets, experience working with distributed computing (MapReduce, Hadoop, Hive, Pig, Apache Spark, etc.).
-
Strong Hadoop scripting skills to process petabytes of data
-
Experience in Unix/Linux shell scripting or similar programming/scripting knowledge
-
Experience in ETL/ processes
-
Real time data ingestion (Kafka)
-
BS degree in specific technical fields like computer science, math, statistics preferred
Education