Senior Data Engineer

INNOCV Solutions
1 month ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Shift work
Languages
English

Job location

Tech stack

Java
API
Amazon Web Services (AWS)
Azure
Cloud Computing
Continuous Integration
Couchbase
Data Governance
ETL
Data Security
Data Warehousing
DevOps
Distributed Data Store
Monitoring of Systems
Python
Microsoft SQL Server
MongoDB
SAP Applications
Scala
Data Streaming
Grafana
Spring-boot
Data Lake
Apache Flink
Real Time Data
Kafka
Non-relational Database
Dynatrace
Confluent
Databricks
Programming Languages
Microservices

Job description

We are a company expert in helping others grow through our technological expertise, solving complex technological challenges, and focusing on operational excellence. Since 2012, we have grown annually at an average rate of 30%, and for three consecutive years, we have been one of the fastest-growing companies in Europe according to the Financial Times. We are digital natives and technology-neutral thanks to our rapid adaptation capabilities and problem-solving skills in any business situation. We are passionate about technology challenges that have a significant impact on business. To address these, we have high-performance teams and the ability to quickly and effectively combine technologies. We support our clients in their digital evolution to achieve maximum efficiency in their businesses, leveraging our extensive multi-sector experience. What will you do? The work focuses on designing and building scalable architectures for Data Lakes and Data Warehouses to centralize and ensure the quality and accessibility of data. It involves implementing and managing ETL processes to extract, transform, and load data from multiple sources, including platforms like Sitetracker, SAP, and Smartmeters. Advanced techniques are applied to transform and enrich data, ensuring alignment with business requirements. The infrastructure is primarily cloud-based, utilizing AWS, Azure, and DataBricks for distributed data processing. Data security measures such as encryption, access controls, and threat monitoring are implemented to protect sensitive information. Additionally, the work encompasses managing both relational and non-relational databases (e.g., SQL Server, Couchbase, MongoDB) and implementing real-time data processing technologies like Kafka Streams, Apache Flink, and ksqlDB. Event streaming platforms, such as Kafka and Confluent, are designed to enable real-time data integration. APIs are developed to facilitate efficient data flow between systems, while microservices architecture using frameworks like Spring Boot ensures scalability. Monitoring systems like Dynatrace and Grafana are set up to track the health and performance of platforms, with error-handling mechanisms, such as DLQ, ensuring data reliability. Data governance policies are defined to maintain data quality, integrity, and compliance with regulations. What do we value? Experience with ETL tools and techniques. Advanced knowledge in cloud computing, especially AWS, Azure, and DataBricks. Design and modeling of relational and non-relational databases. Proficiency in programming languages such as Python, Java, and Scala. Experience with Kafka Streams, Apache Flink, and ksqlDB. Knowledge of data governance principles and practices. Familiarity with DevOps tools and CI/CD. Development and integration of APIs. If you are someone who likes to stay updated on the latest trends, is eager to try new technologies, and enjoys finding alternative ways to do things, this is the place for you. If you consider yourself a team player who advocates for Fair Play above all, a team is waiting for you What do we offer you? In this company, you can be yourself and work with colleagues equally passionate about technology and innovation, ready to support you at all times. We want to see you evolve and grow with us. To that end, we invest in your professional development with training, tech breakfasts, and attendance at forums. We are advocates of continuous learning, which is why we provide a personal budget for staying up to date with market trends. We care about well-being and happiness at work, which is why we listen to needs to offer the best working conditions in a unique human environment. Due to the emphasis we place on flexibility and work-life balance, we won the Madrid Flexible Company Award in 2020 and received an honorable mention in 2022. This is a WIN-WIN, and we have 42 benefits to offer you, but here are some highlights: Flexible hours Special timetable: Fridays and summer 7h. Individual budget for attending forums and training Health insurance Every three years, 6 extra days off. Day off on your birthday Bring a friend and benefit from it Flexible compensation Wellness - Gympass Volunteering opportunities Company events and team buildings To learn more about us, the protagonists of INNOCV will share more about the company. If you identify with our work philosophy and share our passion for INNOvation and Code Vocation, we want to meet you We are committed to supporting the LGTBIQ+ community and invite individuals with disabilities to apply for this position. We value diversity and are committed to inclusion in our team.

Requirements

Since 2012, we have grown annually at an average rate of 30%, and for three consecutive years, we have been one of the fastest-growing companies in Europe according to the Financial Times. We are digital natives and technology-neutral thanks to our rapid adaptation capabilities and problem-solving skills in any business situation. We are passionate about technology challenges that have a significant impact on business. To address these, we have high-performance teams and the ability to quickly and effectively combine technologies. We support our clients in their digital evolution to achieve maximum efficiency in their businesses, leveraging our extensive multi-sector experience. What will you do? The work focuses on designing and building scalable architectures for Data Lakes and Data Warehouses to centralize and ensure the quality and accessibility of data. It involves implementing and managing ETL processes to extract, transform, and load data from multiple sources, including platforms like Sitetracker, SAP, and Smartmeters. Advanced techniques are applied to transform and enrich data, ensuring alignment with business requirements. The infrastructure is primarily cloud-based, utilizing AWS, Azure, and DataBricks for distributed data processing. Data security measures such as encryption, access controls, and threat monitoring are implemented to protect sensitive information. Additionally, the work encompasses managing both relational and non-relational databases (e.g., SQL Server, Couchbase, MongoDB) and implementing real-time data processing technologies like Kafka Streams, Apache Flink, and ksqlDB. Event streaming platforms, such as Kafka and Confluent, are designed to enable real-time data integration. APIs are developed to facilitate efficient data flow between systems, while microservices architecture using frameworks like Spring Boot ensures scalability. Monitoring systems like Dynatrace and Grafana are set up to track the health and performance of platforms, with error-handling mechanisms, such as DLQ, ensuring data reliability. Data governance policies are defined to maintain data quality, integrity, and compliance with regulations. What do we value? Experience with ETL tools and techniques. Advanced knowledge in cloud computing, especially AWS, Azure, and DataBricks. Design and modeling of relational and non-relational databases. Proficiency in programming languages such as Python, Java, and Scala. Experience with Kafka Streams, Apache Flink, and ksqlDB. Knowledge of data governance principles and practices. Familiarity with DevOps tools and CI/CD. Development and integration of APIs. If you are someone who likes to stay updated on the latest trends, is eager to try new technologies, and enjoys finding alternative ways to do things, this is the place for you. If you consider yourself a team player who advocates for Fair Play above all, a team is waiting for you

Benefits & conditions

In this company, you can be yourself and work with colleagues equally passionate about technology and innovation, ready to support you at all times. We want to see you evolve and grow with us. To that end, we invest in your professional development with training, tech breakfasts, and attendance at forums. We are advocates of continuous learning, which is why we provide a personal budget for staying up to date with market trends. We care about well-being and happiness at work, which is why we listen to needs to offer the best working conditions in a unique human environment. Due to the emphasis we place on flexibility and work-life balance, we won the Madrid Flexible Company Award in 2020 and received an honorable mention in 2022. This is a WIN-WIN, and we have 42 benefits to offer you, but here are some highlights: Flexible hours Special timetable: Fridays and summer 7h. Individual budget for attending forums and training Health insurance Every three years, 6 extra days off. Day off on your birthday Bring a friend and benefit from it Flexible compensation Wellness - Gympass Volunteering opportunities Company events and team buildings To learn more about us, the protagonists of INNOCV will share more about the company. If you identify with our work philosophy and share our passion for INNOvation and Code Vocation, we want to meet you We are committed to supporting the LGTBIQ+ community and invite individuals with disabilities to apply for this position. We value diversity and are committed to inclusion in our team.

Apply for this position