http_was_redirected

Provides functions to download and parse 'robots.txt' files.
Ultimately the package makes it easy to check if bots
(spiders, crawler, scrapers, ...) are allowed to access specific
resources on a domain.

Pedro Baltazar

robotstxt

A 'robots.txt' Parser and 'Webbot'/'Spider'/'Crawler'
Permissions Checker

Peter Meissner

Kun Ren

Oliver Keys

Rich Fitz John

http_was_redirected function

<dl><dt>response</dt>
<dd>an httr response object, e.g. from a call to httr::GET()</dd></dl>

Arguments

http_was_redirected — http_was_redirected

<dl>

<dt>response</dt>
<dd>an httr response object, e.g. from a call to httr::GET()</dd>

</dl>

http_was_redirected: http_was_redirected

Description

Usage

Value

Arguments