Data Engineer

Koch Business Solutions, LP
Arlington, United States of America
10 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Intermediate

Job location

Arlington, United States of America

Tech stack

Java
API
Aspect-Oriented Programming
Computer Programming
Databases
Computer Engineering
Information Engineering
ETL
Data Warehousing
Relational Databases
Database Development
Software Debugging
DevOps
Elasticsearch
Github
Information Sciences
Java Persistence API
Spring
Python
PostgreSQL
NoSQL
Query Optimization
DataOps
SQL Databases
Data Streaming
Enterprise Software Applications
Cloud Platform System
Snowflake
Spark
Keras
GIT
Gitlab-ci
Scikit Learn
Information Technology
Data Management
Functional Programming
Software Coding
REST
Data Pipelines

Job description

i360 is seeking a Data Engineer to join its Data Engineering team. With your technical expertise, you will architect, implement, and improve end to end pipelines, processes, procedures, and automation for all database-centric processes. You will maintain our relational and NoSQL systems for performance and reliability. You are responsible for tuning and configuring our databases and data platforms, as well as building tools and scripts to monitor, troubleshoot and automate our systems.

Our Team

The Data Engineering team plays a central role in our organization, given our focus on data. We collaborate closely with both our internal departments and external clients. Our primary responsibility involves designing, building, and upkeeping data pipelines and APIs to provide data to other teams, enabling them to create their products on that data.

What You Will Do

  • Manage multiple projects simultaneously, balancing priorities and maintaining clear communication with stakeholders and team members.
  • Design, architect, and build end to end SQL and NoSQL database solutions. This includes determining business requirements, recommending technologies, architecting, developing code, mentoring team members, and overseeing QA and deployment processes.
  • Load and process disparate data sets using technologies including but not limited to PostgreSQL, Elasticsearch, Snowflake, Spark, Java, and Python.
  • Work with business users to translate requirements into system flows, data flows, data mappings etc., and develop solutions to complex business problems.
  • Code applications that adhere to enterprise design patterns.
  • Resolve technical issues through debugging, research, and investigation.

Requirements

  • BA/BS or Master's degree in Computer Science, Computer Engineering, Information Science or Data Science/Statistics
  • At least 3 years of hands-on experience in data engineering, business intelligence, data modeling, building ETL pipelines and multi-dimensional data warehouses.
  • Experience managing multiple projects simultaneously with competing priorities
  • Hands-on experience with and strong understanding of RDBMS concepts and query optimization.
  • Strong coding experience in developing enterprise applications using Java or Python
  • Understanding of DevOps/DataOps and CI/CD toolset such as git, GitLab CI, GitHub Actions.
  • Experience building, scaling, and maintaining high volume systems.
  • Experience analyzing large complex data sets to resolve data quality and performance issues.

What Will Put You Ahead

  • Experience with Cloud system architecture and design, large scale streaming data processing
  • Experience with Spring framework, AOP, JPA and REST
  • Experience with building RESTful web services
  • Experience with libraries like scikit-learn, keras and functional programming concepts.

About the company

All Koch companies value diversity of thought, perspectives, aptitudes, experiences, and backgrounds. We are Military Ready and Second Chance employers. Learn more about our hiring philosophy here., As a Koch company, i360 works across industry lines to bring unique data, technology and analytics solutions to help our customers win. Our analysts and data scientists build and refine proven, sophisticated models that help customers understand and reach their target audience, visualize data and expand their reach. At Koch, employees are empowered to do what they do best to make life better. Learn how our business philosophy helps employees unleash their potential while creating value for themselves and the company.

Apply for this position