Learn R Programming
⚠️There's a newer version (1.3) of this package.Take me there.

tm.plugin.webmining (version 0.9)

Retrieve structured, textual data from various web sources

Description

tm.plugin.webmining facilitates text retrieval from feed formats like XML (RSS, ATOM) and JSON. Also direct retrieval from HTML is supported. As most (news) feeds only incorporate small fractions of the original text tm.plugin.webmining even retrieves and extracts the text of the original text source.

Copy Link

Version

Install

install.packages('tm.plugin.webmining')

Monthly Downloads

15

Version

0.9

License

GPL-3

Maintainer

Mario Annau

Last Published

December 21st, 2012

Functions in tm.plugin.webmining (0.9)

NYTimesSource

Get feed data from NYTimes Article Search (http://developer.nytimes.com/docs/read/article_search_api).
TwitterSource

Get feed data from Twitter Search API (https://dev.twitter.com/docs/api/1/get/search).
WebSource

Read Web Content and respective Link Content from feedurls.
feedquery

Buildup string for feedquery.
parse

Wrapper/Convenience function to ensure right encoding for different Platforms
GoogleReaderSource

Retrieve feeds through the Google Reader API.
tm.plugin.webmining-package

Retrieve structured, textual data from various web sources
GoogleFinanceSource

Get feed Meta Data from Google Finance.
GoogleBlogSearchSource

Get feed data from Google Blog Search (http://www.google.com/blogsearch).
extract

Extract main content from TextDocuments.
GoogleNewsSource

Get feed data from Google News Search http://news.google.com/
removeNonASCII

Remove non-ASCII characters from Text.
YahooNewsSource

Get feed data from Yahoo! News (http://news.yahoo.com/).
encloseHTML

Enclose Text Content in HTML tags
yahoonews

WebCorpus retrieved from Yahoo! News for the search term "Microsoft" through the YahooNewsSource. Length of retrieved corpus is 20.
trimWhiteSpaces

Trim White Spaces from Text Document.
getEmpty

Retrieve Empty Corpus Elements through $postFUN.
YahooInplaySource

Get News from Yahoo Inplay.
readWeb

Read content from WebXMLSource/WebHTMLSource/WebJSONSource.
WebCorpus

WebCorpus constructor function.
rbloggers

WebCorpus retrieved from the Google Reader API for the R-Bloggers blog consisting only of meta data (no main content available). Length of retrieved corpus is 1000.
extractHTMLStrip

Simply strip HTML Tags from Document
getURL

Copy of RCurl:::getURL() including a little bugfix for the .encoding parameter.
auth.google.reader

Authentification and token retrieval from the Google Reader web service.
corpus.update

Update/Extend WebCorpus with new feed items.
source.update

Update WebXMLSource/WebHTMLSource/WebJSONSource
getLinkContent

Get main content for corpus items, specified by links.
extractContentDOM

Extract Main HTML Content from DOM
ReutersNewsSource

Get feed data from Reuters News RSS feed channels. Reuters provides numerous feed
YahooFinanceSource

Get feed data from Yahoo! Finance.