Data Engineer

AGRI SOLUTIONS, LLC
Grand Rapids, United States of America
yesterday

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Compensation
$ 80K

Job location

Grand Rapids, United States of America

Tech stack

Agile Methodologies
Amazon Web Services (AWS)
Bash
Big Data
Cloud Database
Code Review
Computer Programming
Data Architecture
Information Engineering
Data Integration
ETL
Dataspaces
Data Systems
Data Warehousing
Dimensional Modeling
Hadoop
Hive
Python
Linked Data
Shell
Machine Learning
Microsoft SQL Server
Oracle Applications
Scrum
Azure
Shell Script
Software Engineering
SQL Databases
Data Streaming
Talend
Freeform SQL
Cloud Platform System
Informatica Powercenter
System Availability
Spark
Data Strategy
Vba Programming Language
REST
Looker Analytics
Data Pipelines

Job description

  • Design, develop, and maintain robust ETL (Extract, Transform, Load) pipelines to facilitate efficient data flow from diverse sources such as cloud databases, SQL servers, and big data systems.
  • Build and optimize data models using dimensional modeling techniques to support enterprise data warehousing and analytics initiatives.
  • Collaborate with cross-functional teams to understand business requirements and translate them into scalable data solutions utilizing tools like Informatica, Talend, Apache Hive, Spark, and Hadoop.
  • Manage large-scale data storage solutions in cloud environments such as Azure Data Lake and AWS Public Cloud, ensuring high availability and security.
  • Develop and implement data management strategies that incorporate linked data principles for enhanced interoperability across datasets.
  • Write complex SQL queries using Microsoft SQL Server, Oracle, or other SQL databases to extract insights and support reporting needs.
  • Support business intelligence tools like Looker by creating dashboards and reports that provide meaningful insights for stakeholders.
  • Contribute to agile development cycles by participating in sprint planning, code reviews, and continuous improvement efforts related to data engineering processes.
  • Automate routine tasks through shell scripting (Bash/Unix shell), Python programming, or VBA to improve efficiency.
  • Assist in model training and analysis activities by preparing datasets that enable machine learning initiatives.

Requirements

We are seeking a dynamic and innovative Data Engineer to join our team and drive the development of scalable, high-performance data solutions. In this role, you will harness the power of cloud platforms, big data systems, and advanced data modeling techniques to enable insightful analytics and business intelligence. Your expertise will help shape our data architecture, optimize data pipelines, and support strategic decision-making across the organization. If you are passionate about transforming complex data into actionable insights and thrive in a fast-paced environment, this opportunity is for you!, * Proven experience in software development with a focus on data engineering or related fields.

  • Strong proficiency in SQL programming with experience in SQL databases such as Microsoft SQL Server or Oracle.
  • Hands-on experience with big data technologies including Hadoop, Spark, Apache Hive, and cloud-based platforms like Azure Data Lake or AWS Public Cloud.
  • Familiarity with ETL tools such as Informatica or Talend for data integration workflows.
  • Knowledge of cloud databases and data warehousing design principles including dimensional modeling and query management techniques.
  • Experience developing ETL pipelines using Python or Shell Scripting for automation purposes.
  • Understanding of business intelligence tools such as Looker for creating dashboards and reports.
  • Ability to design scalable data models that support analytics and reporting needs across diverse datasets.
  • Strong analysis skills with the ability to interpret complex datasets and communicate findings effectively.
  • Familiarity with RESTful APIs for integrating external systems into the data ecosystem is a plus.
  • Experience working within an Agile environment to deliver iterative improvements efficiently.

Join us if you're eager to leverage your technical expertise in a collaborative setting that values innovation and continuous learning!

Benefits & conditions

Pulled from the full job description

  • Referral program
  • Professional development assistance
  • Health insurance
  • Paid time off
  • Flexible schedule, * Flexible schedule
  • Health insurance
  • Paid time off
  • Professional development assistance
  • Referral program

Apply for this position