Data Extraction & Pipeline Engineer

IRIS Institut
Bad Grönenbach, Germany
1 day ago
Apply on www.jobfinder.de
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English

Tech stack

Software Quality Databases Data as a Services Data Deduplication Web Scraping Data Mining Data Normalization Python (Programming Language) PostgreSQL Linux System Administration MongoDB NoSQL
+14 more
Parsing Raw Data Redis DataOps Selenium Software Engineering Caching Puppeteer (Software) Rate Limiting Git Information Technology Playwright Graphql Docker

Job description

pipelines targeting property portals, public registers, municipal gazettes, and economic data sources. - Implement parsing, data normalization, deduplication, and quality-validation routines for incoming raw data. - Manage proxy rotation, anti-bot mechanisms, rate limiting, and headless browser workflows. - Store and organize structured information using PostgreSQL, Redis, and document stores. - Package data services into Docker containers and interface them with internal analytics engines via REST/GraphQL APIs. Requirements & Qualifications - Bachelor’s Degree in Computer Science, Software Engineering, or Information Technology (e.g., FAST-NUCES, NED University, or equivalent). - Hands-on experience developing web scraping frameworks in Python: Scrapy, Playwright, Selenium, BeautifulSoup, or Puppeteer. - Practical knowledge of relational (PostgreSQL) and NoSQL/caching databases (Redis, MongoDB). - Experience with Linux environments, Docker, and Git. -, Structured problem-solving

Requirements

mindset, persistence with complex web structures, and solid English skills. What We Offer & Career Pathways - Competitive Package: Excellent compensation package aligned with regional developer salaries. - Modern Workspace: Air-conditioned, reliable office in DHA Phase 1/2 with generator backup. - Local Leadership Path: Opportunities to scale into Engineering Lead / Data Operations Manager as the Karachi hub grows, supported by ongoing technical mentorship and European project workflows. - The International Research Track (§ 18d AufenthG): Top-performing engineers with consistent code quality and reliability over 3-6 months can transition to our research development institute in Germany under the § 18d researcher framework, complete with full visa sponsorship, relocation assistance, and housing / accommodation support. How to Apply: Send your CV by E-Mail: jobs-scraping@iris-institut.info

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.jobfinder.de
Prepare application

Good distractions

Loading talks and stories from around this role…