Ai-Powered Pyspark Developer For Ml Insights

About the Role

Our client, a leading financial technology firm based in Madrid, ES, is seeking a highly skilled Senior Data Engineer to join their growing Big Data team. This hybrid role offers the opportunity to work on complex data challenges, designing and implementing scalable data pipelines and infrastructure on cloud platforms. You will be instrumental in enabling data-driven decision-making across the organization by ensuring the availability, quality, and performance of our data assets. We are looking for a candidate with a strong background in data architecture, ETL processes, and experience with various big data technologies and cloud environments. This is a crucial role where you will contribute significantly to our data strategy and innovation initiatives within the bustling tech hub of Madrid.

Key Responsibilities

• Design, build, and maintain robust, scalable, and efficient data pipelines using ETL/ELT processes.
• Develop and optimize data models for large-scale data warehouses and data lakes.
• Implement and manage data solutions on cloud platforms (e.g., AWS, Azure, GCP).
• Work with big data technologies such as Spark, Hadoop, Kafka, and distributed databases.
• Ensure data quality, integrity, and reliability across all data systems.
• Collaborate with data scientists, analysts, and business stakeholders to understand data needs and deliver solutions.
• Develop and maintain data infrastructure, including monitoring, alerting, and performance tuning.
• Automate data processes and implement CI/CD practices for data pipelines.
• Ensure data security and compliance with relevant regulations.
• Mentor junior data engineers and contribute to the team’s technical growth.
• Stay abreast of emerging trends and technologies in data engineering and big data.

Requirements

• Proven experience as a Data Engineer or similar role, with a strong focus on big data and cloud platforms.
• Proficiency in SQL and experience with various database technologies (relational and NoSQL).
• Hands-on experience with big data processing frameworks like Apache Spark, Hadoop, or Flink.
• Experience with cloud data services (e.g., AWS S3, Redshift, EMR; Azure Data Lake, Databricks; GCP BigQuery, Dataflow).
• Strong programming skills in Python, Scala, or Java.
• Experience in designing and implementing ETL/ELT pipelines.
• Familiarity with data warehousing concepts and dimensional modeling.
• Knowledge of data pipeline orchestration tools (e.g., Airflow, Luigi).
• Understanding of data governance, security, and compliance best practices.
• Excellent problem-solving skills and the ability to work independently and in a team.
• Strong communication skills, with the ability to explain complex technical concepts to non-technical audiences.
• Relevant Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.

Benefits

• Competitive salary and bonus structure.
• Comprehensive health, dental, and vision insurance.
• Generous paid time off and holidays.
• Hybrid work model offering flexibility between office and remote work.
• Opportunities for professional development, training, and certifications.
• Collaborative and innovative work environment in the heart of Madrid.
• Access to cutting-edge technologies and large-scale data projects.
• Pension scheme and other employee benefits.

Contract type: Full time. Locations: Bucharest, Romania; Madrid, Spain; Prague, Czech Republic; Business Office - Boulogne, France; Spain (Remote); Bratislava, Slovak Republic.

• Proven experience as a Data Engineer or similar role, with a strong focus on big data and cloud platforms.
• Proficiency in SQL and experience with various database technologies (relational and NoSQL).
• Hands-on experience with big data processing frameworks like Apache Spark, Hadoop, or Flink.
• Experience with cloud data services (e.g., AWS S3, Redshift, EMR; Azure Data Lake, Databricks; GCP BigQuery, Dataflow).
• Strong programming skills in Python, Scala, or Java.
• Experience in designing and implementing ETL/ELT pipelines.
• Familiarity with data warehousing concepts and dimensional modeling.
• Knowledge of data pipeline orchestration tools (e.g., Airflow, Luigi).
• Understanding of data governance, security, and compliance best practices.
• Excellent problem-solving skills and the ability to work independently and in a team.
• Strong communication skills, with the ability to explain complex technical concepts to non-technical audiences.
• Relevant Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.

• Competitive salary and bonus structure.
• Comprehensive health, dental, and vision insurance.
• Generous paid time off and holidays.
• Hybrid work model offering flexibility between office and remote work.
• Opportunities for professional development, training, and certifications.
• Collaborative and innovative work environment in the heart of Madrid.
• Access to cutting-edge technologies and large-scale data projects.
• Pension scheme and other employee benefits.

Contract type: Full time. Locations: Bucharest, Romania; Madrid, Spain; Prague, Czech Republic; Business Office - Boulogne, France; Spain (Remote); Bratislava, Slovak Republic.