Data Engineer

IBA InfoTech Inc.

Charlotte, NC, United States

about 2 months ago

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Experienced

Experience required

3 years minimum

Working hours

Regular working hours

Job source

ibainfotech.com

Tech stack

.NET Framework Application Programming Interfaces (APIs) Data Analysis Microsoft Azure C Sharp (Programming Language) Databases Data Infrastructure Extract Transform Load (ETL) Data Mapping Data Profiling Data Warehousing Database Models

+27 more

Software Debugging Apache Hive JSON Python (Programming Language) Microsoft Visual Studio Microsoft SQL Server SQL Azure Visual Basic .NET (Programming Language) Windows PowerShell Power BI Simple Object Access Protocol (SOAP) SQL Stored Procedures SQL Databases Transact-SQL Web Services Scripting Microsoft Power Automate Azure Data Factory Powerquery Data Lakes Pyspark Information Technology Star Schema Integration Frameworks Restful APIs Ssas Tabular Databricks

Job description

Develop extract, transform, and load processes using Azure Data Factory, Databricks (PySpark and Spark SQL), and SQL (Azure SQL Data Warehouse)
Developing data load and transformation processes using integration tools such as Azure Logic Apps, Chiapas EDI, and MirthConnect.
Responsible for designing, developing, testing and troubleshooting SSAS Tabular Models
Strong knowledge with Microsoft SQL Server database fundamentals (SQL queries, stored procedures, indexes, triggers, functions)
Strong Knowledge of DAX
Knowledge of Power Query
Reviews and explores source data as it relates to business concepts as well as how it relates to other data elements
Translate business requirements into technical designs to map and load data from source systems to Cardinal Innovations Data Platform
Ensure quality and accuracy of the data mapped from staging environments to the target reporting environments
Provide support to existing ETL jobs
Develop ETL audits and controls to ensure the quality of data meets or exceeds defined standards and thresholds
Ability to perform simple-to-moderately complex tasks with minimal assistance
Maintaining data repository with data definitions, relationships, linkages and sources

Requirements

Knowledge of Kimball Star Schema database model
Knowledge of Azure Data Factory, Azure Databricks (PySpark and Spark SQL), Azure SQL Data Warehouse, Azure Analysis Services, and Microsoft Azure Logic Apps
Knowledge of Data Lake Architecture
Familiarity with PowerBI data models, DAX Studio, and Tabular Editor
3-5 years of experience with Visual Studio
Self-driven with the desire to achieve measurable, specific results within tight time frames
5+ years experience with Microsoft T-SQL
Knowledge of .Net / Scripting Languages (C#,VB.NET, Python, Powershell)
Familiarity with JSON, Restful API, SOAP WS, EDI
Understanding of API/Web services
Good problem solving, design, coding, and debugging skills
Quick learner
Excellent communication skills and strong presentation skills
Analytical, Problem solving, creative thinking and design skills
Ability to maintain a thorough understanding of the business

Required Education, Training and Experience:

Bachelor’s Degree in Computer Science, Computer Information Systems, and Information Technology
Experience with data modeling, data analysis, data profiling, and data mapping