scrape

Scrape the content of authorized page/API

Be responsible when scraping data from websites by following polite principles: introduce yourself, ask for permission, take slowly and never ask twice.

Dmytro Perepolkin

polite

Be Nice on the Web

scrape function

<dl><dt>bow</dt>
<dd>host introduction object of class <code>polite</code>, <code>session</code> created by <code>bow()</code> or <code>nod()</code></dd>
<dt>query</dt>
<dd>named list of parameters to be appended to URL in the format <code>list(param1=valA, param2=valB)</code></dd>
<dt>params</dt>
<dd>deprecated. Use <code>query</code> argument above.</dd>
<dt>accept</dt>
<dd>character value of expected data type to be returned by host (e.g. <code>html</code>, <code>json</code>, <code>xml</code>, <code>csv</code>, <code>txt</code>, etc.)</dd>
<dt>content</dt>
<dd>MIME type (aka internet media type) used to override the content type returned by the server.
See http://en.wikipedia.org/wiki/Internet_media_type for a list of common types. You can add the <code>charset</code> parameter to override the server's default encoding</dd>
<dt>verbose</dt>
<dd>extra feedback from the function. Defaults to <code>FALSE</code></dd></dl>

Arguments

Scrape the content of authorized page/API — scrape

<dl>

<dt>bow</dt>
<dd>host introduction object of class <code>polite</code>, <code>session</code> created by <code>bow()</code> or <code>nod()</code></dd>


<dt>query</dt>
<dd>named list of parameters to be appended to URL in the format <code>list(param1=valA, param2=valB)</code></dd>


<dt>params</dt>
<dd>deprecated. Use <code>query</code> argument above.</dd>


<dt>accept</dt>
<dd>character value of expected data type to be returned by host (e.g. <code>html</code>, <code>json</code>, <code>xml</code>, <code>csv</code>, <code>txt</code>, etc.)</dd>


<dt>content</dt>
<dd>MIME type (aka internet media type) used to override the content type returned by the server.
See http://en.wikipedia.org/wiki/Internet_media_type for a list of common types. You can add the <code>charset</code> parameter to override the server's default encoding</dd>


<dt>verbose</dt>
<dd>extra feedback from the function. Defaults to <code>FALSE</code></dd>

</dl>

scrape: Scrape the content of authorized page/API

Description

Usage

Value

Arguments