Abinitio Data Engineer

MK SOFTWARE SOLUTIONS INC
United States
3 months ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source

Tech stack

Agile Methodology Amazon Web Services Amazon Elastic Compute Cloud Amazon S3 Microsoft Azure Unix Data Warehousing DevOps Apache Hive Identity and Access Management Korn Shell Standard Sql
+16 more
Shell Script Amazon Simple Notification Service (SNS) SQL Stored Procedures SQL Databases Teradata SQL Apache Spark Ab Initio Git Data Lakes Atlassian Tools Functional Programming Cloudwatch Amazon Simple Queue Service (SQS) Jenkins Databricks Artifactory

Requirements

  • Strong development experience in Spark, Py-Spark, Shell scripting, Teradata, and DataBricks.
  • Experience of Ab Initio is required.
  • Strong experience in writing complex and effective SQLs (using Teradata SQL, Hive SQL and Spark SQL) and Stored Procedures.
  • Excellent work experience on DataBricks as data warehouse/Data Lake implementations.
  • Experience in Agile and working knowledge on DevOps tools (Git, Jenkins, Artifactory) Unix/Linux Shell scripting (KSH) and basic administration of Unix servers CA7 Enterprise Scheduler AWS (S3, EC2, SNS, SQS, Lambda, ECS, Glue, IAM, and CloudWatch) Databricks (Delta lake, Notebooks, Pipelines, cluster management, Azure/AWS integration).
  • Experience in Jira and Confluence Exercises considerable creativity, foresight, and judgment in conceiving, planning, and delivering initiatives.
  • Health care domain knowledge is a plus

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Loading talks and stories from around this role…