Learn R Programming
⚠️There's a newer version (1.3) of this package.Take me there.

tm.plugin.webmining (version 1.1)

Retrieve structured, textual data from various web sources

Description

tm.plugin.webmining facilitates text retrieval from feed formats like XML (RSS, ATOM) and JSON. Also direct retrieval from HTML is supported. As most (news) feeds only incorporate small fractions of the original text tm.plugin.webmining even retrieves and extracts the text of the original text source.

Copy Link

Version

Install

install.packages('tm.plugin.webmining')

Monthly Downloads

15

Version

1.1

License

GPL-3

Issues

8

Pull Requests

0

Stars

34

Forks

9

Maintainer

Mario Annau

Last Published

May 11th, 2014

Functions in tm.plugin.webmining (1.1)

feedquery

Buildup string for feedquery.
getLinkContent

Get main content for corpus items, specified by links.
NYTimesSource

Get feed data from NYTimes Article Search (http://developer.nytimes.com/docs/read/article_search_api).
yahoonews

WebCorpus retrieved from Yahoo! News for the search term "Microsoft" through the YahooNewsSource. Length of retrieved corpus is 20.
ReutersNewsSource

Get feed data from Reuters News RSS feed channels. Reuters provides numerous feed
trimWhiteSpaces

Trim White Spaces from Text Document.
readWeb

Read content from WebXMLSource/WebHTMLSource/WebJSONSource.
parse

Wrapper/Convenience function to ensure right encoding for different Platforms
GoogleFinanceSource

Get feed Meta Data from Google Finance.
getURL

Copy of RCurl:::getURL() including a little bugfix for the .encoding parameter.
source.update

Update WebXMLSource/WebHTMLSource/WebJSONSource
tm.plugin.webmining-package

Retrieve structured, textual data from various web sources
YahooFinanceSource

Get feed data from Yahoo! Finance.
extract

Extract main content from TextDocuments.
GoogleNewsSource

Get feed data from Google News Search http://news.google.com/
WebSource

Read Web Content and respective Link Content from feedurls.
encloseHTML

Enclose Text Content in HTML tags
YahooNewsSource

Get feed data from Yahoo! News (http://news.yahoo.com/).
extractHTMLStrip

Simply strip HTML Tags from Document
corpus.update

Update/Extend WebCorpus with new feed items.
GoogleBlogSearchSource

Get feed data from Google Blog Search (http://www.google.com/blogsearch).
getEmpty

Retrieve Empty Corpus Elements through $postFUN.
WebCorpus

WebCorpus constructor function.
YahooInplaySource

Get News from Yahoo Inplay.
removeNonASCII

Remove non-ASCII characters from Text.
extractContentDOM

Extract Main HTML Content from DOM