Data Extraction & Pipeline Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+14 more
Job description
pipelines targeting property portals, public registers, municipal gazettes, and economic data sources. - Implement parsing, data normalization, deduplication, and quality-validation routines for incoming raw data. - Manage proxy rotation, anti-bot mechanisms, rate limiting, and headless browser workflows. - Store and organize structured information using PostgreSQL, Redis, and document stores. - Package data services into Docker containers and interface them with internal analytics engines via REST/GraphQL APIs. Requirements & Qualifications - Bachelor’s Degree in Computer Science, Software Engineering, or Information Technology (e.g., FAST-NUCES, NED University, or equivalent). - Hands-on experience developing web scraping frameworks in Python: Scrapy, Playwright, Selenium, BeautifulSoup, or Puppeteer. - Practical knowledge of relational (PostgreSQL) and NoSQL/caching databases (Redis, MongoDB). - Experience with Linux environments, Docker, and Git. -, Structured problem-solving
Requirements
mindset, persistence with complex web structures, and solid English skills. What We Offer & Career Pathways - Competitive Package: Excellent compensation package aligned with regional developer salaries. - Modern Workspace: Air-conditioned, reliable office in DHA Phase 1/2 with generator backup. - Local Leadership Path: Opportunities to scale into Engineering Lead / Data Operations Manager as the Karachi hub grows, supported by ongoing technical mentorship and European project workflows. - The International Research Track (§ 18d AufenthG): Top-performing engineers with consistent code quality and reliability over 3-6 months can transition to our research development institute in Germany under the § 18d researcher framework, complete with full visa sponsorship, relocation assistance, and housing / accommodation support. How to Apply: Send your CV by E-Mail: jobs-scraping@iris-institut.info
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this role…