Vulnerability & Exposure Management Data Engineer

Schwarz Corporate Solutions
Barcelona, Spain
26 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Barcelona, Spain

Tech stack

Agile Methodologies
Airflow
Amazon Web Services (AWS)
JIRA
Azure
Big Data
Cloud Database
Computer Security
Data Visualization
Python
MongoDB
Neo4j
Redis
Power BI
Software Engineering
SQL Databases
Software Vulnerability Management
System Availability
Grafana
Backend
Containerization
Data Lake
PySpark
Kubernetes
Data Analytics
Non-relational Database
Front End Software Development
Data Pipelines
Docker

Job description

Join us and contribute to digital sovereignty in Europe. With us, you will work at the intersection of agility and security: You will benefit from fast decision-making processes, enjoy genuine creative freedom in your projects, and be able to build upon the stable foundation of the Schwarz Group., * Design and develop a solution that processes millions of data entries daily for the new Vulnerability Management Platform.

  • Build and maintain scalable data pipelines (batch and real-time) to ingest high volumes of data into the data lake.
  • Perform data modeling to optimize datasets and ease data consumption for stakeholders.
  • Bring data analytics to production at scale, participating in architecture design.
  • Collaborate with Backend and Frontend teams to implement and improve the product.
  • Ensure data availability and integrity for business stakeholders.

Requirements

  • 5+ years of experience in Software Development and Big Data Frameworks.
  • Strong proficiency in Python (must have) and advanced knowledge in PySpark.
  • Experience building data processing pipelines (ELT) using tools such as Airflow, dbt, or Airbyte.
  • Proficiency with Cloud data warehousing solutions (preferably STACKIT or AWS)
  • Experience with relational (SQL) and non-relational databases (MongoDB, Redis); Neo4j is a plus
  • Experience working in Agile environments
  • Strong English communication skills and ability to work in a collaborative, international environment.
  • Nice to Have: Cybersecurity and Vulnerability Management knowledge or experience.
  • Nice to Have: Familiarity with containerization (Docker, Kubernetes) and CI/CD pipelines (Azure DevOps, Jira).
  • Nice to Have:Familiarity with monitoring and visualization tools like Azure Monitoring, Grafana, and PowerBI.
  • Nice to Have: Contribution to open-source projects and a passion for learning new tools.

About the company

Schwarz Digits creates the technological foundation for digital sovereignty in Europe. As the IT and digital division of the Schwarz Group, we develop and manage the IT infrastructures for the retail divisions Lidl and Kaufland, as well as Schwarz Production and PreZero. At the same time, we operate as an independent provider in the external market to support companies across Europe in their digital transformation. We bundle our core services in the areas of Cloud, Cyber Security, Data & AI, Communication, and Workspace.

Apply for this position