Learn R Programming

⚠️There's a newer version (0.9.9) of this package.Take me there.

clustermq (version 0.8.95.5)

Evaluate Function Calls on HPC Schedulers (LSF, SGE, SLURM, PBS/Torque)

Description

Evaluate arbitrary function calls using workers on HPC schedulers in single line of code. All processing is done on the network without accessing the file system. Remote schedulers are supported via SSH.

Copy Link

Version

Install

install.packages('clustermq')

Monthly Downloads

1,292

Version

0.8.95.5

License

Apache License (== 2.0) | file LICENSE

Maintainer

Michael Schubert

Last Published

February 19th, 2023

Functions in clustermq (0.8.95.5)

Creates a pool of workers

Wrap C++ Rcpp module in R6 to get reliable argument matching

R worker submitted as cluster job

Evaluate Function Calls on HPC Schedulers (LSF, SGE, SLURM)

clustermq foreach handler

Function to process a chunk of calls

summarize_result

Print a summary of errors and warnings that occurred during processing

Class for basic queuing system functions

SLURM scheduler functions

Function to check arguments with which Q() is called

Lookup table for return types to vector NAs

Binds a ZeroMQ socket to an available port in given range

Subset index chunk for processing

SSH scheduler functions

register_dopar_cmq

Register clustermq as `foreach` parallel handler

SSH proxy for different schedulers

Construct the ZeroMQ host address

Lookup table for return types to purrr functions

Fill a template string with supplied values

Master controlling the workers

Placeholder for local processing

LSF scheduler functions

Process on multiple cores on one machine

Process on multiple processes on one machine

Queue function calls on the cluster

Select the queueing system on package loading

Report queueing system on package attach if not set

Queue function calls defined by rows in a data.frame

SGE scheduler functions