AnalysisPipeline
and StreamingAnalysisPipeline
objectsBase class for AnalysisPipeline
and StreamingAnalysisPipeline
objects
pipeline
A tibble which holds functions to be called
pipelineExecutor
A list containing details of the execution, such as topological ordering of functions to be executed, dependency map of functions, as well as logger configuration
output
A list which holds all the functions output
The class which holds the metadata including the registry of available functions, the data on which the pipeline is to be applied, as well as the pipeline itself, and serves as the base class for various types of Pipeline objects such as Batch and Streaming.
This base class which contains the slots related to the registry, pipeline and output can be extended to create custom class for specific scenarios if required.
In the documentation, objects of classes which are subclasses of this class are referred to as 'Pipeline' objects
Other Package core functions: MetaAnalysisPipeline-class
,
assessEngineSetUp
,
checkSchemaMatch
,
createPipelineInstance
,
exportAsMetaPipeline
,
generateOutput
,
genericPipelineException
,
getInput
, getLoggerDetails
,
getOutputById
,
getPipelinePrototype
,
getPipeline
, getRegistry
,
initDfBasedOnType
,
initialize,BaseAnalysisPipeline-method
,
loadMetaPipeline
,
loadPipeline
,
loadPredefinedFunctionRegistry
,
loadRegistry
, prepExecution
,
registerFunction
,
savePipeline
, saveRegistry
,
setInput
, setLoggerDetails
,
updateObject
,
visualizePipeline