Learn R Programming

⚠️There's a newer version (0.9.9) of this package.Take me there.

clustermq (version 0.9.2)

Evaluate Function Calls on HPC Schedulers (LSF, SGE, SLURM, PBS/Torque)

Description

Evaluate arbitrary function calls using workers on HPC schedulers in single line of code. All processing is done on the network without accessing the file system. Remote schedulers are supported via SSH.

Copy Link

Version

Install

install.packages('clustermq')

Monthly Downloads

1,292

Version

0.9.2

License

Apache License (== 2.0) | file LICENSE

Maintainer

Michael Schubert

Last Published

December 7th, 2023

Functions in clustermq (0.9.2)

Class for basic queuing system functions

Queue function calls defined by rows in a data.frame

Placeholder for local processing

SGE scheduler functions

SLURM scheduler functions

Class for basic queuing system functions

LSF scheduler functions

Queue function calls on the cluster

SSH scheduler functions

Function to check arguments with which Q() is called

Process on multiple cores on one machine

Subset index chunk for processing

Process on multiple processes on one machine

clustermq-package

Evaluate Function Calls on HPC Schedulers (LSF, SGE, SLURM)

Construct the ZeroMQ host address

Master controlling the workers

R worker submitted as cluster job

clustermq foreach handler

Creates a pool of workers

Message format for logging

SSH proxy for different schedulers

register_dopar_cmq

Register clustermq as `foreach` parallel handler

Select the queueing system on package loading

Report queueing system on package attach if not set

Lookup table for return types to vector NAs

Function to process a chunk of calls

summarize_result

Print a summary of errors and warnings that occurred during processing

Fill a template string with supplied values

Wraps an error in a condition object