read_matrix_blocks

Allows the user to carry out GLM on very large
data sets. Data can be created using the data_frame() function and appended
to the object with object$append(data); data_frame and data_matrix objects
are available that allow the user to store large data on disk. The data is
stored as doubles in binary format and any character columns are transformed
to factors and then stored as numeric (binary) data while a look-up table is
stored in a separate .meta_data file in the same folder. The data is stored in
blocks and GLM regression algorithm is modified and carries out a MapReduce-
like algorithm to fit the model. The functions bglm(), and summary()
and bglm_predict() are available for creating and post-processing of models.
The library requires Armadillo installed on your system. It may not
function on windows since multi-core processing is done using mclapply()
which forks R on Unix/Linux type operating systems.

Chibisi ChimaOkereke

bigReg

Generalized Linear Models (GLM) for Large Data Sets

read_matrix_blocks function

<dl><dt>filePaths</dt>
<dd>file paths from where the matrix blocks will be read</dd>
<dt>size</dt>
<dd>numeric vector containing the number of elements in each block</dd>
<dt>ncols</dt>
<dd>number of columns in the matrix</dd></dl>

Arguments

read matrix blocks from file — read_matrix_blocks

<dl>

<dt>filePaths</dt>
<dd>file paths from where the matrix blocks will be read</dd>


<dt>size</dt>
<dd>numeric vector containing the number of elements in each block</dd>


<dt>ncols</dt>
<dd>number of columns in the matrix</dd>

</dl>

read_matrix_blocks: read matrix blocks from file

Description

Usage

Arguments