Senior Big Data Engineer*
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+7 more
Job description
One of our largest national retail clients is looking for a Big Data Engineer to support an ongoing rebuild project. This individual will design, build, and optimize scalable data pipelines using PySpark and SQL. They will also modify pipeline logic, move and transform data across sources, and develop new features within the existing system.
Requirements
6+ years of experience as a Data Engineer (Big data technology, open table formats) -Proficiency in PySpark -Advanced SQL skills with experience querying relational databases -Strong hands-on experience with Apache Spark (must have an in-depth understanding of Spark & distributed computing) -Hands-on experience in building pipelines using Dataproc & orchestrating it on Airflow -2+ years of hands-on experience with Google Cloud Platform (GCP) -2+ years of experience with Databricks (Azure) -Exposure to AI / ML building blocks within GCP -Experience with data visualization tools such as Tableau, PowerBI, or Looker -Experience working with structured and unstructured datasets
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦