Senior Big Data Engineer*

Insight Global
Bentonville, AR, United States
2 days ago
Apply on dejobs.org
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
2 years minimum
Working hours
Regular working hours
Job source

Tech stack

Artificial Intelligence Airflow Microsoft Azure Big Data Data Visualization Relational Databases Distributed Systems Power BI Cloudera SQL Databases Tableau (Software) Unstructured Data
+7 more
Google Cloud Sql Optimization Apache Spark Pyspark Looker Analytics Data Pipelines Databricks

Job description

One of our largest national retail clients is looking for a Big Data Engineer to support an ongoing rebuild project. This individual will design, build, and optimize scalable data pipelines using PySpark and SQL. They will also modify pipeline logic, move and transform data across sources, and develop new features within the existing system.

Requirements

6+ years of experience as a Data Engineer (Big data technology, open table formats) -Proficiency in PySpark -Advanced SQL skills with experience querying relational databases -Strong hands-on experience with Apache Spark (must have an in-depth understanding of Spark & distributed computing) -Hands-on experience in building pipelines using Dataproc & orchestrating it on Airflow -2+ years of hands-on experience with Google Cloud Platform (GCP) -2+ years of experience with Databricks (Azure) -Exposure to AI / ML building blocks within GCP -Experience with data visualization tools such as Tableau, PowerBI, or Looker -Experience working with structured and unstructured datasets

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on dejobs.org
Prepare application

Good distractions

Loading talks and stories from around this role…