Data Engineer

BAD Gmbh
Wolfertschwenden, Germany
12 days ago
Apply on www.arbeitsagentur.de
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
German

Tech stack

HTML Optical Character Recognition (OCR) Data Cleansing Web Scraping Data Mining Relational Databases Document-Oriented Databases JSON Python (Programming Language) Natural Language Processing Named Entity Recognition Open Source Intelligence
+12 more
Parsing Regular Expressions Selenium Software Engineering Spatial Data Infrastructures Extensible Markup Language (XML) Multi-Agent Systems Data Lakes Information Technology Playwright Data Analytics Build Tools

Job description

Target Group: Software Engineers, Web Scrapers, OSINT Specialists, Opportunity Card Holders, and Master’s Graduates

About Project IRIS Project IRIS is an applied research and technology initiative dedicated to automated spatial data analysis, infrastructure mapping, and open-source data modeling. Because not all valuable data exists as clean spatial polygons, we build systems that extract hidden knowledge from texts, complex web registries, and unstructured documents. In this role, you will build the autonomous agents that feed our intelligence engine.

Your Focus & Responsibilities

  • Web Automation: Develop scalable web scrapers and autonomous agents to extract data from unstructured sources (public registers, official announcements, corporate portals).
  • Data Parsing: Parse unstructured web and document data (JSON, XML, HTML, PDF) into clean, relational database structures.
  • Entity Extraction: Apply OCR, regex, and NLP techniques to extract structured entities (addresses, capacities, corporate connections) from dense documents.
  • Pipeline Monitoring: Automate monitoring scripts to continuously feed fresh data into our central PostGIS Data Lake., Full-Time Permanent Employment: Long-term career stability with clear growth trajectories.
  • Dual Master / Trainee Track Available: Tailored tracks including academic coordination and complete tuition support.
  • Accommodation & Onboarding Package: Structured assistance with local accommodation, official registration, and comprehensive onboarding.
  • Visa & Administrative Backing: Dedicated employer support for Opportunity Card conversions and visa applications.
  • Direct Mentorship: Close collaboration with experienced technical architects and executive leadership.

Requirements

Technical Background: Degree in Computer Science, Software Engineering, Data Analytics, or equivalent practical industry experience.

  • Core Technical Skills: Proven experience in Web Scraping (Python, Playwright, Scrapy, Selenium, BeautifulSoup) and handling uncooperative web architectures.
  • Mindset: Analytical mindset with a drive for data cleaning, structural modeling, and robust automation.
  • Eligibility: Open to local applicants and international candidates (Chancenkarte / Opportunity Card supported).
  • Languages: Professional working proficiency in English (required); German language skills are a plus.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.arbeitsagentur.de
Prepare application

Good distractions

Loading talks and stories from around this role…