Learn R Programming

⚠️There's a newer version (0.9.9) of this package.Take me there.

clustermq (version 0.8.95)

Evaluate Function Calls on HPC Schedulers (LSF, SGE, SLURM, PBS/Torque)

Description

Evaluate arbitrary function calls using workers on HPC schedulers in single line of code. All processing is done on the network without accessing the file system. Remote schedulers are supported via SSH.

Copy Link

Version

Install

install.packages('clustermq')

Monthly Downloads

1,292

Version

0.8.95

License

Apache License (== 2.0) | file LICENSE

Maintainer

Michael Schubert

Last Published

July 1st, 2020

Functions in clustermq (0.8.95)

Placeholder for local processing

Lookup table for return types to purrr functions

Construct the ZeroMQ host address

LSF scheduler functions

Fill a template string with supplied values

Master controlling the workers

SLURM scheduler functions

SSH scheduler functions

Process on multiple cores on one machine

Subset index chunk for processing

Function to check arguments with which Q() is called

summarize_result

Print a summary of errors and warnings that occurred during processing

Process on multiple processes on one machine

Lookup table for return types to vector NAs

Report queueing system on package attach if not set

Select the queueing system on package loading

Function to process a chunk of calls

Queue function calls on the cluster

Evaluate Function Calls on HPC Schedulers (LSF, SGE, SLURM)

Class for basic queuing system functions

Creates a pool of workers

Queue function calls defined by rows in a data.frame

register_dopar_cmq

Register clustermq as `foreach` parallel handler

clustermq foreach handler

R worker submitted as cluster job

SGE scheduler functions

SSH proxy for different schedulers

Wrap C++ Rcpp module in R6 to get reliable argument matching

Binds a ZeroMQ socket to an available port in given range