RecordLinkage (version 0.2-0)

getMinimalTrain: Create a minimal training set

Description

Samples a subset of the provided data set so that every comparison pattern in rpairs is represented in the subset at least once.

Usage

getMinimalTrain(rpairs, nEx = 1)

Arguments

rpairs

RecLinkData object. The data set from which to create a minimal training set.

nEx

The desired number of examples per comparison pattern.

Value

• A RecLinkData object representing the minimal training set. Component pairs represents the selected training pairs. The corresponding values of rpairs$prediction and rpairs$W are saved, if present. All other components are copied from rpairs.

Details

Our internal research has given indication that in the context of Record Linkage with supervised classification procedures small training sets are often sufficient, provided they cover the whole range of present comparison patterns. By default, this function creates a minimal training set, that is a subset of the record pairs to be classified in which every present comparison pattern is represented by exactly one training example. By this approach, the work to classify a training set by clerical review can be minimized while keeping a good classification performance. Larger training sets can be obtained by setting nEx to a higher number. Up to nEx examples for every comparison pattern are randomly selected, limited by the total number of record pairs with that pattern.

See Also

editMatch for manually setting the matching status of the training pairs.

Examples

data(RLdata10000)
p=compare.dedup(RLdata10000,blockfld=list(1,3),identity=identity.RLdata10000)
train=getMinimalTrain(p)
classif=trainSupv(train,method="bagging")
summary(classifySupv(classif,newdata=p))