controls_txt

Controls for text data used in the <code>blocking</code> function (if <code>representation = shingles</code>), passed to <a href="/link/tokenize_character_shingles?package=blocking&version=1.0.1" data-mini-rdoc="blocking::tokenize_character_shingles">tokenize_character_shingles</a>.

The goal of 'blocking' is to provide blocking methods for record linkage and deduplication using approximate nearest neighbour (ANN) algorithms and graph techniques. It supports multiple ANN implementations via 'rnndescent', 'RcppHNSW', 'RcppAnnoy', and 'mlpack' packages, and provides integration with the 'reclin2' package. The package generates shingles from character strings and similarity vectors for record comparison, and includes evaluation metrics for assessing blocking performance including false positive rate (FPR) and false negative rate (FNR) estimates. For details see: Papadakis et al. (2020) <doi:10.1145/3377455>, Steorts et al. (2014) <doi:10.1007/978-3-319-11257-2_20>, Dasylva and Goussanou (2021) <https://www150.statcan.gc.ca/n1/en/catalogue/12-001-X202100200002>, Dasylva and Goussanou (2022) <doi:10.1007/s42081-022-00153-3>.

Maciej Ber<c4><99>sewicz

blocking

Various Blocking Methods for Entity Resolution

Maciej Beręsewicz

Adam Struzik

controls_txt function

<dl><dt>n_shingles</dt>
<dd>length of shingles (default <code>2L</code>),</dd>
<dt>n_chunks</dt>
<dd>passed to (default <code>10L</code>),</dd>
<dt>lowercase</dt>
<dd>should the characters be made lower-case? (default <code>TRUE</code>),</dd>
<dt>strip_non_alphanum</dt>
<dd>should punctuation and white space be stripped? (default <code>TRUE</code>).</dd></dl>

Arguments

Author

Controls for text data used in the <code>blocking</code> function (if <code>representation = shingles</code>), passed to <a href='https://rdrr.io/pkg/tokenizers/man/shingle-tokenizers.html'>tokenize_character_shingles</a>.

Controls for processing character data — controls_txt

<dl>

<dt>n_shingles</dt>
<dd>length of shingles (default <code>2L</code>),</dd>


<dt>n_chunks</dt>
<dd>passed to (default <code>10L</code>),</dd>


<dt>lowercase</dt>
<dd>should the characters be made lower-case? (default <code>TRUE</code>),</dd>


<dt>strip_non_alphanum</dt>
<dd>should punctuation and white space be stripped? (default <code>TRUE</code>).</dd>

</dl>

controls_txt: Controls for processing character data

Description

Usage

Value

Arguments

Author