Azure Data Engineer

Shrive Technologies Llc

Jackson, MS, United States

13 days ago

Apply on www.careerjet.com

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Working hours

Regular working hours

Job source

www.careerjet.com

Tech stack

Application Programming Interfaces (APIs) Microsoft Azure Software Debugging Python (Programming Language) Key Management MySQL NumPy Oracle (Applications) Power BI SQL Stored Procedures SQL Databases Data Streaming

+8 more

Azure Data Factory Apache Spark Git Pandas Pyspark Azure Synapse Analytics Serverless Computing Databricks

Requirements

Hands on Experience in Azure Synapse Analytics, Azure Data Factory and Data Bricks, Azure Storage, Azure Key Vault, SQL Pools CI/CD Pipeline Designing and other Azure services like functions, logic apps - Linked services, Various Runtimes, Datasets, Pipelines, Activities
Strong Hands-on Experience in Various Activities like Control flow logic and conditions (For Each, if, switch, until), Lookup, Stored procedure, scripts, validations, Copy Data, Data flow, Azure functions, Notebooks, SQL Pool Stored procedures etc.
Strong hands on exp in deployment of code throughout landscape (Dev -> QA -> Prod), Git Hub, CI/CD pipelines etc.
Strong hands on creating the SQL stored procedures - Functions, Stored Procedures, how to call one SP into another, how to process record-by-record - Dynamic SQL - Data Bricks - Must have
Strong background about the Python libraries like PySpark, Pandas, NumPy, MySQL, Oracle, PySpark libraries
Must have strong hands on to get data through APIs
Must be able to install libraries and help users to troubleshoot issues
Must have knowledge to get the data through stored procedures via Python
Should be able to debug the Python code Hands on experience in Spark Pools, Spark
Should be able to merge data/delta loads through Notebooks
Must have strong background about the Python libraries and PySpark - Hands on Exp on Power BI