spiderbar (version 0.2.5)

sitemaps: Retrieve a character vector of sitemaps from a parsed robots.txt object

Description

Retrieve a character vector of sitemaps from a parsed robots.txt object

Usage

sitemaps(xp)

Value

charcter vector of all sitemaps found in the parsed robots.txt file

Arguments

xp

A robxp object

Examples

imdb <- paste0(readLines(system.file("extdata", "imdb-robots.txt",
               package="rep")), collapse="\n")
rt <- robxp(imdb)
sitemaps(rt)