Senior Big Data Engineer

Grid Dynamics
Málaga, Spain
3 days ago

Role details

Contract type
Contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English

Job location

Remote
Málaga, Spain

Tech stack

Big Data
Data Infrastructure
ETL
Distributed File Systems
Distributed Data Store
Hadoop Distributed File System
Python
Scala
SQL Databases
Data Processing
Scripting (Bash/Python/Go/Ruby)
Spark
Kubernetes
Performance Monitor
Functional Programming
Data Pipelines
Docker

Job description

Join the Media Products Analytics Engineering division focused on building platforms and tools to manage and process terabytes of data for both internal and external stakeholders. Our team is responsible for developing robust data infrastructure and high-performance pipelines that power critical media analytics and projection datasets., We're looking for a Senior Big Data Engineer who can work independently and proactively to design, implement, and maintain scalable data processing pipelines. You will contribute to a high-performing team that owns infrastructure critical to analytics, modeling, and media performance reporting., * Design and develop large-scale data pipelines and infrastructure to process high-volume datasets

  • Build and maintain scalable, production-grade ETL/ELT workflows using Apache Spark, Scala, and SQL
  • Work with distributed file systems (HDFS) and optimize data processing performance
  • Write and test reusable and reliable code using functional programming libraries like Cats and fs2
  • Develop and test solutions in containerized environments (e.g., Docker, Kubernetes)
  • Collaborate with analysts, platform teams, and product stakeholders to deliver data-driven solutions
  • Take ownership of services with minimal supervision, demonstrating initiative and autonomy

Requirements

  • Strong programming experience with Scala and distributed data frameworks like Apache Spark
  • Proficiency in SQL and experience handling large datasets in HDFS environments
  • Working knowledge of Python for scripting and data manipulation tasks
  • Hands-on experience developing and testing in Docker and/or Kubernetes environments
  • Familiarity with Cats, fs2, or other advanced Scala functional programming libraries
  • Ability to work autonomously in a dynamic, fast-paced environment and take full ownership of projects

We offer

  • Opportunity to work on bleeding-edge projects
  • Work with a highly motivated and dedicated team

About the company

Grid Dynamics (NASDAQ: GDYN) is a leading provider of technology consulting, platform and product engineering, AI, and advanced analytics services. Fusing technical vision with business acumen, we solve the most pressing technical challenges and enable positive business outcomes for enterprise companies undergoing business transformation. A key differentiator for Grid Dynamics is our 8 years of experience and leadership in enterprise AI, supported by profound expertise and ongoing investment in data, analytics, cloud & DevOps, application modernization, and customer experience. Founded in 2006, Grid Dynamics is headquartered in Silicon Valley with offices across the Americas, Europe, and India.

Apply for this position