Data Engineer

Properfood, LLC
Berwyn, United States of America
yesterday

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English

Job location

Berwyn, United States of America

Tech stack

Agile Methodologies
Airflow
Amazon Web Services (AWS)
Amazon Web Services (AWS)
JIRA
Bash
Big Data
Continuous Integration
Information Engineering
ETL
Amazon DynamoDB
Graph Database
Identity and Access Management
Python
NoSQL
SQL Databases
Scripting (Bash/Python/Go/Ruby)
Snowflake
Gitlab
Cloudformation
PySpark
Scikit Learn
Data Analytics
Cloudwatch
Data Pipelines

Job description

The Data Engineer will play a critical implementation role on the Data Engineering and Data Products team and be responsible for data pipeline solutions design and development, troubleshooting, and optimization tuning on the next generation data and analytics platform being developed with leading edge big data technologies in a highly secure cloud infrastructure. The Data Engineer will serve as a liaison to platform user groups ensuring successful implementation of capabilities on the new platform.

Requirements

Experience in the following Should have: - SQL, Python, PySpark, Python ML libraries. Data and analytics technologies including SQL/NoSQL/Graph databases, ETL Knowledge of CI/CD and related tools such as Gitlab, AWS services including EMR, Glue, Athena, Batch, Lambda CloudWatch, DynamoDB, EC2, CloudFormation, IAM Snowflake and Airflow. DBT Canonical Data Models and Medallion Architecture. Solid scripting skills (e.g., bash/shell scripts, Python) Candidate should be able to gather and interpret business requirements Experience with agile delivery methodologies using Jira or similar tools Experience working with remote teams

Apply for this position