dtmremovetfidf

Remove terms from a Document-Term-Matrix and documents with no terms based on the term frequency inverse document frequency.
Either giving in the maximum number of terms (argument <code>top</code>), the tfidf cutoff (argument <code>cutoff</code>)
or a quantile (argument <code>prob</code>)

Contains the development of a tool that provides a web-based graphical
user interface (GUI) to perform Biplots representations from a scraping of
news from digital newspapers under the Bayesian approach of Latent Dirichlet
Assignment (LDA) and machine learning algorithms. Contains LDA methods
described by Blei , David M., Andrew Y. Ng and Michael I. Jordan (2003)
<https://jmlr.org/papers/volume3/blei03a/blei03a.pdf>,
and Biplot methods described by Gabriel K.R(1971) <doi:10.1093/biomet/58.3.453>
and Galindo-Villardon P(1986) <https://diarium.usal.es/pgalindo/files/2012/07/Questiio.pdf>.

Luis Pilacuan-Bonete

LDABiplots

Biplot Graphical Interface for LDA Models

Purificacion Galindo-Villardón

Javier De La Hoz Maestre

Francisco Javier Delgado-Álvarez

dtmremovetfidf function

<dl><dt>dtm</dt>
<dd>an object class "dgCMatrix"</dd>
<dt>top</dt>
<dd>integer with the number of terms which should be kept as defined by the highest mean tfidf</dd>
<dt>cutoff</dt>
<dd>numeric cutoff value to keep only terms in <code>dtm</code> where the tfidf obtained by <code>dtmtfidf</code> is higher than this value</dd>
<dt>prob</dt>
<dd>numeric quantile indicating to keep only terms in <code>dtm</code> where the tfidf obtained by <code>dtmtfidf</code> is higher than
the <code>prob</code> percent quantile</dd>
<dt>remove_emptydocs</dt>
<dd>logical indicating to remove documents containing no more terms after the term removal is executed. Defaults to <code>TRUE</code>.</dd></dl>

Arguments

Remove terms from a Document-Term-Matrix and documents with no terms based on the term frequency inverse document frequency — dtmremovetfidf

<dl>

<dt>dtm</dt>
<dd>an object class "dgCMatrix"</dd>


<dt>top</dt>
<dd>integer with the number of terms which should be kept as defined by the highest mean tfidf</dd>


<dt>cutoff</dt>
<dd>numeric cutoff value to keep only terms in <code>dtm</code> where the tfidf obtained by <code>dtmtfidf</code> is higher than this value</dd>


<dt>prob</dt>
<dd>numeric quantile indicating to keep only terms in <code>dtm</code> where the tfidf obtained by <code>dtmtfidf</code> is higher than
the <code>prob</code> percent quantile</dd>


<dt>remove_emptydocs</dt>
<dd>logical indicating to remove documents containing no more terms after the term removal is executed. Defaults to <code>TRUE</code>.</dd>

</dl>

dtmremovetfidf: Remove terms from a Document-Term-Matrix and documents with no terms based on the term frequency inverse document frequency

Description

Usage

Value

Arguments