lsh_add

This function adds buckets for one or more new documents to an existing
<code>lsh_buckets</code> object. Use the same <code>bands</code> value and minhash
function that were used to create the original buckets.

Tools for measuring similarity among documents and detecting
passages which have been reused. Implements shingled n-gram, skip n-gram,
and other tokenizers; similarity/dissimilarity functions; pairwise
comparisons; minhash and locality sensitive hashing algorithms; and a
version of the Smith-Waterman local alignment algorithm suitable for
natural language.

Yaoxiang Li

textreuse

Detect Text Reuse and Document Similarity

Lincoln Mullen

lsh_add function

<dl><dt>buckets</dt>
<dd>An <code>lsh_buckets</code> object created by <code>lsh</code>.</dd>
<dt>x</dt>
<dd>A <code>TextReuseCorpus</code> or
<code>TextReuseTextDocument</code> with minhashes.</dd>
<dt>bands</dt>
<dd>The number of bands to use for locality sensitive hashing. The
number of hashes in the documents in the corpus must be evenly divisible by
the number of bands. See <code>lsh_threshold</code> and
<code>lsh_probability</code> for guidance in selecting the number of bands
and hashes.</dd>
<dt>progress</dt>
<dd>Display a progress bar while comparing documents.</dd></dl>

Arguments

Add documents to a LSH cache — lsh_add

<dl>

<dt>buckets</dt>
<dd>An <code>lsh_buckets</code> object created by <code>lsh</code>.</dd>


<dt>x</dt>
<dd>A <code>TextReuseCorpus</code> or
<code>TextReuseTextDocument</code> with minhashes.</dd>


<dt>bands</dt>
<dd>The number of bands to use for locality sensitive hashing. The
number of hashes in the documents in the corpus must be evenly divisible by
the number of bands. See <code>lsh_threshold</code> and
<code>lsh_probability</code> for guidance in selecting the number of bands
and hashes.</dd>


<dt>progress</dt>
<dd>Display a progress bar while comparing documents.</dd>

</dl>

lsh_add: Add documents to a LSH cache

Description

Usage

Value

Arguments

See Also