Data Engineer

Community United Federal Credit Union
Lenexa, United States of America
6 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Intermediate

Job location

Lenexa, United States of America

Tech stack

Amazon Web Services (AWS)
Azure
Big Data
Cloud Database
Software Quality
Code Review
Computer Programming
Continuous Integration
Data Architecture
Information Engineering
Data Integration
Data Mart
Data Systems
Data Warehousing
Python
Microsoft Visual Studio
Microsoft SQL Server
Scrum
Software Engineering
SQL Stored Procedures
SQL Databases
SQL Server Integration Services
Test Data
Data Processing
Azure
Spark
Information Technology
Kafka
Physical Data Models
Software Version Control
Data Pipelines
Jenkins
Databricks

Job description

Responsibilities: Work with product owners to understand and translate business requirements into technical specifications and physical data model requirements. Build, implement and test data pipelines using Databricks, Azure Data Factory, SSIS and other data integration tools. Support other software developer team members with troubleshooting and resolving complex technical issues and challenges. Follow proper coding standards, conduct code reviews to ensure proper code quality level. Follow effective source code management and Cl/CD best practices to ensure data pipelines are automatically tested, integrated and deployed to production. Learn and contribute to continuously improving existing software development, data architecture and frameworks.

Requirements

  • Bachelor's degree in Computer Science or related and five years progressive experience, which must include the following, concurrently:
  • 5 years of experience in data engineering and data warehousing.
  • 5 years of data engineering experience in SSIS and/or other data integration technologies, including designing and implementing full and incremental data loads"
  • 2 years of cloud data engineering and big data experience.
  • 2 years with building/using data warehouse and data marts.
  • Experience with the following:
  • cloud data engineering and data warehouse technologies in Microsoft Azure, Google or AWS.
  • Big data and Data integration technologies including Spark, Kafka, Databricks, Azure Data Factory, SSIS and SQL.
  • Development in Microsoft SQL Server, including writing SQL scripts, queries, and stored procedures, as well as tuning queries to optimize performance.
  • CI/CD and Jenkins.
  • Delivering data solutions iteratively using the Agile Scrum framework and development processes.
  • Solving business problems through using data and creating analytical solutions.
  • Position also requires the following:
  • Strong demonstrated programming skills in python and SQL for data processing and automation.
  • Demonstrated skills in Visual Studio with the use of source control applications such as Azure DevOps.
  • Demonstrated ability to troubleshoot and resolve complex technical issues related to data processing in a cloud big data infrastructure.

Applicants must have legal authority to work in the United States.

Apply for this position