Vulnerability & Exposure Management Data Engineer

Schwarz Gruppe
Barcelona, Spain
19 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Remote
Barcelona, Spain

Tech stack

Agile Methodologies
Airflow
Amazon Web Services (AWS)
JIRA
Azure
Big Data
Cloud Computing
Computer Security
Data Visualization
Data Warehousing
Python
MongoDB
Neo4j
Open Source Technology
Redis
Power BI
Software Engineering
SQL Databases
Software Vulnerability Management
Data Processing
Grafana
Backend
Containerization
Data Lake
PySpark
Kubernetes
Data Analytics
Non-relational Database
Data Management
Front End Software Development
Data Pipelines
Docker

Job description

  • Design and develop a solution that processes millions of data entries daily for the new Vulnerability Management Platform.
  • Build and maintain scalable data pipelines (batch and real-time) to ingest high volumes of data into the data lake.
  • Perform data modeling to optimize datasets and ease data consumption for stakeholders.
  • Bring data analytics to production at scale, participating in architecture design.
  • Collaborate with Backend and Frontend teams to implement and improve the product.
  • Ensure data availability and integrity for business stakeholders.

Requirements

  • 5+ years of experience in Software Development and Big Data Frameworks.
  • Strong proficiency in Python (must have) and advanced knowledge in PySpark.
  • Experience building data processing pipelines (ELT) using tools such as Airflow, dbt, or Airbyte.
  • Proficiency with Cloud data warehousing solutions (preferably STACKIT or AWS)
  • Experience with relational (SQL) and non-relational databases (MongoDB, Redis); Neo4j is a plus
  • Experience working in Agile environments
  • Strong English communication skills and ability to work in a collaborative, international environment.
  • Nice to Have: Cybersecurity and Vulnerability Management knowledge or experience.
  • Nice to Have: Familiarity with containerization (Docker, Kubernetes) and CI/CD pipelines (Azure DevOps, Jira).
  • Nice to Have:Familiarity with monitoring and visualization tools like Azure Monitoring, Grafana, and PowerBI.
  • Nice to Have: Contribution to open-source projects and a passion for learning new tools.

About the company

Get Immediate Access to 2,809,000 premium jobs * Direct Access to Top Employers Gain full access to exclusive job listings from leading companies worldwide. * Verified, High-Quality Jobs Only No ads, scams, or junk-just genuine opportunities. * Focus on Real Opportunities Explore thousands of open positions tailored to your lifestyle, including flexible remote jobs. * Exclusive Resume Review Receive expert feedback with personalized suggestions to enhance your resume. Join Schwarz IT Barcelona - IT Hub of Europe's Largest Retail Group. At Schwarz IT Barcelona, we provide high value IT services for the entire Schwarz Group, which includes Lidl, Kaufland, Schwarz Produktion, PreZero, Schwarz Digits, STACKIT, and XMCyber. As part of a top 5 global retail company, we serve 6 billion customers through 13,700 stores in 32 countries, supported by over 575,000 employees. We are looking for open-minded colleagues with passion for technology, who are willing to find diverse and exciting career opportunities in a dynamic work environment that stands for development and progress. Elevate your career with us, where development and progress are at the heart of everything we do.

Apply for this position