> Markdown version of [/jobs/ext/2724458-hq-barcelona-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/2724458-hq-barcelona-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # HQ BARCELONA - Senior Data Engineer - **Company:** Jobandtalent Data - **Location:** Madrid, Spain (Remote available) - **Salary:** €55,000.0 - €70,000.0 - **Contract:** Side job - **Skills:** Java (Programming Language), Artificial Intelligence, Airflow, Amazon S3, Android Software Development, Apple IOS, JIRA, Big Data, Data Architecture, Information Engineering, Extract Transform Load (ETL), Data Warehousing, Apache Hadoop, JSON, Python (Programming Language), Machine Learning, Message Broker, RabbitMQ, Salesforce.Com, Data Streaming, Systems Integration, Parquet, Data Storage Technologies, Apache Spark, Backend, Data Lakes, Apache Flink, Avro, Production Code, Data Analytics, AWS Fargate, Apache Kafka, Spark Streaming, Front End Software Development, Data Pipelines, Docker, Programming Languages - **Published:** September 5, 2026 - **Apply:** https://startup.jobs/hq-barcelona-senior-data-engineer-jobandtalent-company-8271202 ## About the Role You need to have proven experience in these areas, being eager to learn and improve, while enjoying taking responsibility. You need to be very hands-on, able to explore different solutions to our problems and needs. Requirements and Skills * Technical degree preferably in Engineering or Quantitative field. * Experience managing ETL or similar Data Workflows * Experience in leading data architecture decisions and similar responsibilities. * Previous practical experience with Big Data technologies knowledge, batch and real-time (Hadoop, Spark, Hudi, Spark Streaming, Flink, etc.). * Extensive experience with production-ready code (not scripting code). * Extremely skilled programmer (e.g., unittest, production/staging experience). * Python proficiency, and ideally experience with other programming languages such as Java, Scala. * Strong knowledge of different data storages (knows pros and cons, understand and investigate the best solution for each use-case). * Strong knowledge of different storage formats (JSON, Parquet, Avro, etc.), understand and investigate the best solution for each use-case. * Streaming data queue platforms knowledge (Kinesis, Kafka, RabbitMQ, etc.). * Excellent verbal and written communication skills; ability to communicate effectively with different levels of management, as well as the business and technical communities. * A valid work permit to be employed in Spain. * Fluent in English is a must. ## Description * Our Impact on Society: Our vision is to create a long-term job security condition for our workers while providing flexible solutions to our clients. We can do this by concatenating different short-term contracts and minimizing-or completely removing-their unemployed time. We want to remove the need for finding a job ever again. * Data-Driven: Being the owner of the entire hiring funnel, workforce management, and working experience, give us very unique data that we transform in powerful knowledge to make better decisions, improve job-candidate matches, estimate quality and affinity, and share performance feedback with our workers and clients. We are the most advanced workforce on-demand company thanks to our data and the way we use it. * Great Challenges for the Data Team: Integrating very different AI solutions to improve the experience for both our workers and employers (Shift Optimization, Machine Learning algorithms, Quality Score Estimations, Document recognition, etc.), relying on a very powerful ETL that permits endless automatizations while keeping the focus on data quality. * Growth Overview: An annual growth of 170%, available in multiple countries: the UK, Spain, Germany, Sweden, Mexico, Colombia, France, and more are coming. HQ in Madrid with a second big presence in Barcelona and some remote workers in the UK, The Netherlands, and the USA. And finally, some of our great clients are Amazon, XPOLogistics, Cabify, Santander, Just Eat, etc. You will be the main referent of our data architecture, leading the design and implementation decisions of our data pipelines. The Data Team is very independent of the rest of the Tech and Product teams. We build and manage our services that run our AI models as well as our data storages to quickly process the data we need, and let the Data Scientist performing the "Time Travel" to properly train our algorithms. A quick insight about our architecture and tools: * We are building our new data lake and data warehouse directly in AWS S3, synchronizing the data via DMS, and consolidate it via Hudi. This data will be accessible by multiple Redshift clusters via Spectrum that allows us to quickly scale up across all the countries. In addition, as data is stored in S3 this could be exploited via Athena or an ad-hoc Spark job. * We have multiple queue systems from which we consume data coming from the Jobandtalent Message brokers while filling up our data storage. * We use Airflow as our ETL which allows us to break down any complex problem/process into smaller ones. Each component can be implemented directly in Python, or any other language since we could execute any docker container in AWS Fargate. * We are integrating different 3rd party data (Kustomer, Salesforce, etc.). We keep iterating in the best way to incorporate this data into our Datalake which allows our users to exploit this data., * Product & Design all the Product Owners and Designers that belong to the different Product Features teams (cross-functional teams that take care of some specific parts of the product). * Tech includes all the main engineering profiles and guilds, such as Backend, Frontend, Android, iOS, and Platform. The majority of them are embedded into the Product Features teams to create our extremely independent and cross-functional teams. * Data includes three different teams, namely Data Analytics, Data Science, and Data Engineering. How the Jobandtalent Data team is organized? * The Data team includes three different teams that work very closely together. + The Data Engineering one owns the data pipelines and processes that generate the data needed by our Data Warehouse, and thus by the entire Jobandtalent. + The Data Science team, which owns all the models used by the Product teams + The Data Analytics team is composed of two types of profiles: (i) Product Data Analysts, which work embedded in the Product Team following a Hub'n'Spoke approach, and (ii) Data Partners, which are working closely with other departments such as Finance, Sales, Marketing, etc. How do we organize the tasks and the planning? * We are very data-driven, we have clear KPIs for each project, team, and goal. * We define strong OKRs for every quarter, we work with bi-weekly Sprint (each team has its own JIRA Project), and a Data PM is leading the delivery processes and metrics. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Tips and Tricks for Working with JSON](https://www.wearedevelopers.com/videos/1229-tips-and-tricks-for-working-with-json) - [From event streaming to event sourcing 101](https://www.wearedevelopers.com/videos/91-from-event-streaming-to-event-sourcing-101) - [Improving quality with Agentic AI with Rovo Dev and Xray](https://www.wearedevelopers.com/videos/2005-improving-quality-with-agentic-ai-with-rovo-dev-and-xray) - [Introducing JSON Structure](https://www.wearedevelopers.com/videos/100219-introducing-json-structure) - [Collaboration Quantified: Lessons from Open Source Developer Networks](https://www.wearedevelopers.com/videos/1422-collaboration-quantified-lessons-from-open-source-developer-networks) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Spanish Business Culture and Etiquette](https://www.wearedevelopers.com/magazine/353-spanish-business-culture-and-etiquette) - [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs) - [Find a Developer Job: 12 Best Job Sites For Developers](https://www.wearedevelopers.com/magazine/165-find-a-developer-job-12-best-job-sites-for-developers) - [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk)