Software Engineer (Data Engineering)
Role details
Job location
Tech stack
Job description
We're looking for a highly skilled Senior Software / Data Engineer who is passionate about big data architectures and excited by extreme performance challenges. Your success will be measured by your ability to design robust data pipelines, ensure ultra-low latency data serving, deliver high-quality features, and mentor the team while sharing and applying your knowledge effectively. What will you do at Smadex? You will dive into a dynamic environment, tackling short-cycle tasks such as implementing complex data ingestion services and assisting with Spark aggregation pipelines, following a "you build it, you run it" philosophy. You will be expected to participate in code reviews, learn from technical and architectural decisions, and collaborate in a fast-paced environment where every opinion counts., + System Architecture & Design: Design and build scalable, highly available data pipelines and serving layers bridging big data storage and real-time machine learning inference.
- Feature Ownership: Develop and optimize features using Scala and Java to process massive amounts of data, aggregate it, and efficiently write it to our Redis Cluster.
- Pipeline Orchestration: Design and manage complex data workflows and DAGs using Apache Airflow.
- Mentorship: Guide and support junior members of the team, fostering a culture of engineering excellence and best practices.
- Quality Assurance: Write clean, efficient, testable code and thoroughly test work locally and in a sophisticated staging environment.
- Operational Excellence: Monitor deployments and help ensure the stability, reliability and performance of production systems.
- Agile Collaboration: Collaborate with the team in an agile environment, participating in planning and reporting on progress.
Requirements
-
4+ years of experience in a software engineering or data engineering role building high-throughput distributed systems.
-
Deep Java or Scala Knowledge
-
Proven track record of designing, building, and optimizing batch pipelines using Apache Spark.
-
Advanced SQL knowledge and experience optimizing complex queries for performance
-
Strong analytical mindset with the ability to debug and monitor complex distributed systems in production.
-
Excellent communication skills in English (written and spoken) What Will Make You Stand Out (Bonus Points):
-
Previous experience in the AdTech industry or working with Real-Time Bidding (RTB) ecosystems.
-
Experience working closely with Data Science or Machine Learning teams (understanding of Feature Stores and the ML lifecycle).
-
Familiarity with cloud environments, particularly AWS.
-
Experience with containerization and orchestration (Docker, Kubernetes). Our Tech Stack
-
Languages: Java, Python, Scala and bash.
-
Frameworks: Spark
-
Databases: MySQL, Redis
-
Cloud & DevOps: AWS, Jenkins, Docker, Airflow
Benefits & conditions
What We Offer
- Join a highly motivated and talented team in a fun and friendly work environment.
- Opportunity to work in a complex environment and gain experience from it.
- Directly add value to the business with the projects that you are assigned.
- Great compensation package.
- Top location at the heart of Barcelona with a rooftop terrace, Barbeque, and a fully stocked fridge.
- Great work-life balance: work from home (2 days per week) and flexible hours.
- Professional development with a LinkedIn Learning subscription and other training opportunities.
- Meal vouchers - Ticket Restaurant monthly allowance.
- Monthly gym allowance: Choose between DiR and Wellhub
- Monthly TGIF (Thank God It's Friday) events and regular team-building activities.
- Ping-pong table and arcade machine.
- And more! If you want to know more about us visit our website Smadex.com, and for a sneak peek of the cool stuff we build check this video out! And, if you are ready to take your career to the next level and tackle engineering challenges at a global scale, we encourage you to apply! Please note that we do NOT provide VISA sponsorship. Candidates without a legal permit to work in Spain won't be considered. QTQeoXzHOD Inscribirse en esta oferta Recibir ofertas similares por correo electrónico Al crear una alerta, aceptas nuestros Términos y condiciones y Política de privacidad, y el uso de cookies.