Crawling 101: Crawling a static web page

We will begin with building our first crawler. The goal is that the crawler takes a static web page as …

Crawling 104: Retrieving data from APIs

Next up, we will be dealing with probably the most convenient way of retrieving data for our research projects, that …

Quick tips: Friendly crawling

Data should be crawled responsibly so that it does not have a detrimental effect on the web site being scraped. …

Crawling 102: Collecting web data with Selenium and Python

Selenium is a powerful tool for collecting web-data. With the help of Selenium, we can collect data from pages that …

Quicktips: Merging CSV files

Say we have multiple csv files and we want to merge them into one big csv. How can we do …