dtm_get_idf

<code>dgCMatrix</code> - Document-Term matrix.

function to use in idf calculation. Usually <a href="/link/log?package=text2vec&version=0.2.0" rd-options="" data-mini-rdoc="text2vec::log">log</a> used.
Also worth to try <a href="/link/log2?package=text2vec&version=0.2.0" rd-options="" data-mini-rdoc="text2vec::log2">log2</a>.

log_scale

<code>logical</code> smooth idf weights by adding one to document frequencies,
as if an extra document was seen containing every term in the collection exactly once.
Prevents zero divisions.

smooth_idf

Creates Inverse Document-Frequency (idf) scaling matrix from Document-Term matrix.
 For examples see <a href="/link/get_dtm?package=text2vec&version=0.2.0" rd-options="" data-mini-rdoc="text2vec::get_dtm">get_dtm</a>.
idf = log (# documents in the corpus) / (# documents where the term appears + 1)
For examples see  <a href="/link/get_dtm?package=text2vec&version=0.2.0" rd-options="" data-mini-rdoc="text2vec::get_dtm">get_dtm</a>

Very fast and memory-friendly tools for text vectorization and
    learning word embeddings (GloVe). Also package provides source-agnostic
    streaming API, which allows to perform analysis of collections
    of documents, which are much larger the available RAM.

dtm_get_idf: Inverse Document-Frequency scaling matrix construction

Description

Usage

Arguments

Value

See Also