Data is Key: Scraping Metadata from Websites
Lars Kölker - 2 years ago
In most cases, the first way for a developer to get information or data for his project will be to look for a suitable API. For many scenarios (e.g. loading weather data, YouTube trends, etc.) there are ready-made interfaces.
But how do I proceed if I want to retrieve data on newspaper articles that do not provide a (public) API? This talk will present different approaches to reading metadata and structured data from websites and evaluating it further to extract useful information. Ryan Mitchell sums it up aptly with the quote "The internet is one giant API with a somewhat poor user interface."
Newest jobs

Senior Java Software Engineer (f/m/x)
Raiffeisen Bank International AG
·
yesterday
Vienna, Austria
Hybrid

DevOps Engineer (f/m/x)
Raiffeisen Bank International AG
·
yesterday
Vienna, Austria
Hybrid

Teamlead - Data Platform Produkte (m/w/d)
STACKIT
·
2 days ago
Heilbronn, Germany
Hybrid

Eclipse RCP Entwickler:in (m/w/d)
qualitype GmbH
·
2 days ago
Dresden, Germany
Hybrid
Related Videos