Data Engineer

IBA InfoTech Inc.
Charlotte, United States of America
2 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Intermediate

Job location

Charlotte, United States of America

Tech stack

.NET
API
Data analysis
Azure
C Sharp (Programming Language)
Databases
Data Infrastructure
ETL
Data Mapping
Data Profiling
Data Warehousing
Database Models
Software Debugging
Hive
JSON
Python
Microsoft Visual Studio
Microsoft SQL Server
SQL Azure
Visual Basic
Powershell
Power BI
Simple Object Access Protocol (SOAP)
SQL Stored Procedures
SQL Databases
T-SQL
Web Services
Scripting (Bash/Python/Go/Ruby)
Microsoft Power Automate
Azure
Powerquery
Data Lake
PySpark
Information Technology
Star Schema
Integration Frameworks
REST
Ssas Tabular
Databricks

Job description

  • Develop extract, transform, and load processes using Azure Data Factory, Databricks (PySpark and Spark SQL), and SQL (Azure SQL Data Warehouse)
  • Developing data load and transformation processes using integration tools such as Azure Logic Apps, Chiapas EDI, and MirthConnect.
  • Responsible for designing, developing, testing and troubleshooting SSAS Tabular Models
  • Strong knowledge with Microsoft SQL Server database fundamentals (SQL queries, stored procedures, indexes, triggers, functions)
  • Strong Knowledge of DAX
  • Knowledge of Power Query
  • Reviews and explores source data as it relates to business concepts as well as how it relates to other data elements
  • Translate business requirements into technical designs to map and load data from source systems to Cardinal Innovations Data Platform
  • Ensure quality and accuracy of the data mapped from staging environments to the target reporting environments
  • Provide support to existing ETL jobs
  • Develop ETL audits and controls to ensure the quality of data meets or exceeds defined standards and thresholds
  • Ability to perform simple-to-moderately complex tasks with minimal assistance
  • Maintaining data repository with data definitions, relationships, linkages and sources

Requirements

  • Knowledge of Kimball Star Schema database model
  • Knowledge of Azure Data Factory, Azure Databricks (PySpark and Spark SQL), Azure SQL Data Warehouse, Azure Analysis Services, and Microsoft Azure Logic Apps
  • Knowledge of Data Lake Architecture
  • Familiarity with PowerBI data models, DAX Studio, and Tabular Editor
  • 3-5 years of experience with Visual Studio
  • Self-driven with the desire to achieve measurable, specific results within tight time frames
  • 5+ years experience with Microsoft T-SQL
  • Knowledge of .Net / Scripting Languages (C#,VB.NET, Python, Powershell)
  • Familiarity with JSON, Restful API, SOAP WS, EDI
  • Understanding of API/Web services
  • Good problem solving, design, coding, and debugging skills
  • Quick learner
  • Excellent communication skills and strong presentation skills
  • Analytical, Problem solving, creative thinking and design skills
  • Ability to maintain a thorough understanding of the business

Required Education, Training and Experience:

  • Bachelor's Degree in Computer Science, Computer Information Systems, and Information Technology
  • Experience with data modeling, data analysis, data profiling, and data mapping

Apply for this position