Learn R Programming

ralger (version 2.3.0)

weblink_scrap: Website web links scraping

Description

This function is used to scrape web links from a website.

Usage

weblink_scrap(link, contain = NULL, case_sensitive = FALSE, askRobot = FALSE)

Value

a character vector.

Arguments

link

the link of the web page to scrape

contain

filter the web links according to the character string provided.

case_sensitive

logical. Should the contain argument be case sensitive ? defaults to FALSE

askRobot

logical. Should the function ask the robots.txt if we're allowed or not to scrape the web page ? Default is FALSE.

Examples

Run this code
# \donttest{
# Extracting the web links within the World Bank research and publications page

link <- "https://www.worldbank.org/en/research"

weblink_scrap(link)
# }

Run the code above in your browser using DataLab