brickster (version 0.2.6)

db_dbfs_add_block: DBFS Add Block

Description

Append a block of data to the stream specified by the input handle.

Usage

db_dbfs_add_block(
  handle,
  data,
  convert_to_raw = FALSE,
  host = db_host(),
  token = db_token(),
  perform_request = TRUE
)

Arguments

handle

Handle on an open stream.

data

Either a path for file on local system or a character/raw vector that will be base64-encoded. This has a limit of 1 MB.

convert_to_raw

Boolean (Default: FALSE), if TRUE will convert character vector to raw via base::as.raw().

host

Databricks workspace URL, defaults to calling db_host().

token

Databricks workspace token, defaults to calling db_token().

perform_request

If TRUE (default) the request is performed, if FALSE the httr2 request is returned without being performed.

Typical File Upload Flow

• Call create and get a handle via db_dbfs_create()

• Make one or more db_dbfs_add_block() calls with the handle you have

• Call db_dbfs_close() with the handle you have

Details

• If the handle does not exist, this call will throw an exception with RESOURCE_DOES_NOT_EXIST.

• If the block of data exceeds 1 MB, this call will throw an exception with MAX_BLOCK_SIZE_EXCEEDED.

See Also

Other DBFS API: db_dbfs_close(), db_dbfs_create(), db_dbfs_delete(), db_dbfs_get_status(), db_dbfs_list(), db_dbfs_mkdirs(), db_dbfs_move(), db_dbfs_put(), db_dbfs_read()