DynamicPipeline

This <code><a rd-options="" href="/link/DynamicPipeline?package=bdpar&version=2.0.0" data-mini-rdoc="bdpar::DynamicPipeline">DynamicPipeline</a></code> class inherits from the
<code><a rd-options="" href="/link/GenericPipeline?package=bdpar&version=2.0.0" data-mini-rdoc="bdpar::GenericPipeline">GenericPipeline</a></code> class. Includes the execute method which
provides a dynamic pipelining implementation.


Provide a tool to easily build customized data flows to pre-process large volumes
of information from different sources. To this end, 'bdpar' allows to (i) easily use and
create new functionalities and (ii) develop new data source extractors according to the
user needs. Additionally, the package provides by default a predefined data flow
to extract and pre-process the most relevant information (tokens, dates, ... ) from some textual
sources (SMS, Email, tweets, YouTube comments).

Miguel Ferreiro-D<c3><ad>az

bdpar

Big Data Preprocessing Architecture

David Ruano-Ord<c3><a1>s

Tom<c3><a1>s R. Cotos-Ya<c3><b1>ez

University of Vigo 

DynamicPipeline function

<code>DynamicPipeline$new(pipeline = NULL)</code>

Constructor

This class inherits from <code><a rd-options="" href="/link/GenericPipeline?package=bdpar&version=2.0.0" data-mini-rdoc="bdpar::GenericPipeline">GenericPipeline</a></code> and implements the
<code>execute</code> abstract function.

Inherit

<ul>
<li>add:
adds a pipe or a pipe list to the pipeline
<ul>
<li>Usage:
<code>add(pipe, pos)</code></li>
<li>Arguments:
<ul>
<li>pipe:
(GenericPipe) pipe objects or a list of pipes to add</li>
<li>pos:
(numeric) the value of the pos to add. If it is NULL, pipe is appended to the pipeline</li>
</ul></li>
</ul></li>
<li>removeByPos:
removes pipes by the position on the pipeline
<ul>
<li>Usage:
<code>removeByPos(pos)</code></li>
<li>Arguments:
<ul>
<li>pos:
(numeric) the pipe positions to remove.</li>
</ul></li>
</ul></li>
<li>removeByPipe:
removes pipes by its name on the pipeline
<ul>
<li>Usage:
<code>removeByPipe(pipe.name)</code></li>
<li>Arguments:
<ul>
<li>pipe.name:
(character) the pipe name to remove.</li>
</ul></li>
</ul></li>
<li>removeAll:
removes all pipes included on pipeline
<ul>
<li>Usage:
<code>removeAll()</code></li>
</ul></li>
<li>execute:
function where is implemented the flow of the pipes.
<ul>
<li>Usage:
<code>execute(instance)</code></li>
<li>Value:
the preprocessed <code><a rd-options="" href="/link/Instance?package=bdpar&version=2.0.0" data-mini-rdoc="bdpar::Instance">Instance</a></code>.</li>
<li>Arguments:
<ul>
<li>instance:
(Instance) the <code><a rd-options="" href="/link/Instance?package=bdpar&version=2.0.0" data-mini-rdoc="bdpar::Instance">Instance</a></code> that is going to be processed.</li>
</ul></li>
</ul></li>
<li>get:
gets a list with containinig the set of pipes of the pipeline,
<ul>
<li>Usage:
<code>get()</code></li>
<li>Value:
the set of pipes containing the pipeline.</li>
</ul></li>
</ul>

Methods

This <code><a rd-options='' href='DynamicPipeline'>DynamicPipeline</a></code> class inherits from the
<code><a rd-options='' href='GenericPipeline'>GenericPipeline</a></code> class. Includes the execute method which
provides a dynamic pipelining implementation.

DynamicPipeline: Class implementing a dynamic pipelining proccess.

Description

Usage

Arguments

Constructor

Inherit

Methods

See Also