Software Engineer (Data Engineering)
Role details
Job location
Tech stack
Job description
You will join our core engineering team, a collaborative group of experienced engineers responsible for enabling complex data to be available in the real-time bidding platform for the Machine Learning models to use. We foster a fast-paced, supportive environment where knowledge sharing is key. We value autonomy and will provide the platform for you to grow your career while solving complex engineering challenges., You will dive into a dynamic environment, tackling short-cycle tasks such as implementing complex data ingestion services and assisting with Spark aggregation pipelines, following a "you build it, you run it" philosophy. You will be expected to participate in code reviews, learn from technical and architectural decisions, and collaborate in a fast-paced environment where every opinion counts., * System Architecture & Design: Design and build scalable, highly available data pipelines and serving layers bridging big data storage and real-time machine learning inference.
- Feature Ownership: Develop and optimize features using Scala and Java to process massive amounts of data, aggregate it, and efficiently write it to our Redis Cluster.
- Pipeline Orchestration: Design and manage complex data workflows and DAGs using Apache Airflow.
- Mentorship: Guide and support junior members of the team, fostering a culture of engineering excellence and best practices.
- Quality Assurance: Write clean, efficient, testable code and thoroughly test work locally and in a sophisticated staging environment.
- Operational Excellence: Monitor deployments and help ensure the stability, reliability and performance of production systems.
- Agile Collaboration: Collaborate with the team in an agile environment, participating in planning and reporting on progress.
Requirements
We're looking for a highly skilled Senior Software / Data Engineer who is passionate about big data architectures and excited by extreme performance challenges. Your success will be measured by your ability to design robust data pipelines, ensure ultra-low latency data serving, deliver high-quality features, and mentor the team while sharing and applying your knowledge effectively., * 4+ years of experience in a software engineering or data engineering role building high-throughput distributed systems.
- Deep Java or Scala Knowledge
- Proven track record of designing, building, and optimizing batch pipelines using Apache Spark.
- Advanced SQL knowledge and experience optimizing complex queries for performance
- Strong analytical mindset with the ability to debug and monitor complex distributed systems in production.
- Excellent communication skills in English (written and spoken)
What Will Make You Stand Out (Bonus Points):
- Previous experience in the AdTech industry or working with Real-Time Bidding (RTB) ecosystems.
- Experience working closely with Data Science or Machine Learning teams (understanding of Feature Stores and the ML lifecycle).
- Familiarity with cloud environments, particularly AWS.
- Experience with containerization and orchestration (Docker, Kubernetes).
Our Tech Stack
- Languages: Java, Python, Scala and bash.
- Frameworks: Spark
- Databases: MySQL, Redis
- Cloud & DevOps: AWS, Jenkins, Docker, Airflow
- Tools: Git, Jira, Notion
Benefits & conditions
What We Offer
- Join a highly motivated and talented team in a fun and friendly work environment.
- Opportunity to work in a complex environment and gain experience from it.
- Directly add value to the business with the projects that you are assigned.
- Great compensation package.
- Top location at the heart of Barcelona with a rooftop terrace, Barbeque, and a fully stocked fridge.
- Great work-life balance: work from home (2 days per week) and flexible hours.
- Professional development with a LinkedIn Learning subscription and other training opportunities.
- Meal vouchers - Ticket Restaurant monthly allowance.
- Monthly gym allowance: Choose between DiR and Wellhub
- Monthly TGIF (Thank God It's Friday) events and regular team-building activities.
- Ping-pong table and arcade machine.
- And more!
