Learn R Programming

⚠️There's a newer version (1.3) of this package.Take me there.

tm.plugin.webmining (version 1.2.2)

Retrieve structured, textual data from various web sources

Description

tm.plugin.webmining facilitates text retrieval from feed formats like XML (RSS, ATOM) and JSON. Also direct retrieval from HTML is supported. As most (news) feeds only incorporate small fractions of the original text tm.plugin.webmining even retrieves and extracts the text of the original text source.

Copy Link

Version

Install

install.packages('tm.plugin.webmining')

Monthly Downloads

15

Version

1.2.2

License

GPL-3

Issues

Pull Requests

Stars

Forks

Repository

https://github.com/mannau/tm.plugin.webmining

Maintainer

Mario Annau

Last Published

November 3rd, 2014

Functions in tm.plugin.webmining (1.2.2)

WebCorpus constructor function.

Get feed data from NYTimes Article Search (http://developer.nytimes.com/docs/read/article_search_api_v2).

YahooNewsSource

Get feed data from Yahoo! News (http://news.yahoo.com/).

GoogleFinanceSource

Get feed Meta Data from Google Finance.

GoogleNewsSource

Get feed data from Google News Search http://news.google.com/

ReutersNewsSource

Get feed data from Reuters News RSS feed channels. Reuters provides numerous feed

Buildup string for feedquery.

Retrieve Empty Corpus Elements through $postFUN.

Enclose Text Content in HTML tags

Read content from WebXMLSource/WebHTMLSource/WebJSONSource.

Read Web Content and respective Link Content from feedurls.

Get main content for corpus items, specified by links.

YahooFinanceSource

Get feed data from Yahoo! Finance.

extractContentDOM

Extract Main HTML Content from DOM

Update WebXMLSource/WebHTMLSource/WebJSONSource

extractHTMLStrip

Simply strip HTML Tags from Document

WebCorpus retrieved from Yahoo! News for the search term "Microsoft" through the YahooNewsSource. Length of retrieved corpus is 20.

Remove non-ASCII characters from Text.

trimWhiteSpaces

Trim White Spaces from Text Document.

tm.plugin.webmining-package

Retrieve structured, textual data from various web sources

Wrapper/Convenience function to ensure right encoding for different Platforms

Update/Extend WebCorpus with new feed items.

YahooInplaySource

Get News from Yahoo Inplay.

Extract main content from TextDocuments.

GoogleBlogSearchSource

Get feed data from Google Blog Search (http://www.google.com/blogsearch).