RSQLite (version 0.8-4)

safe.write: Write a data.frame avoiding exceeding memory limits

Description

This function batches calls to write.table to avoid exceeding memory limits for very large data.frames.

Usage

safe.write(value, file, batch, row.names = TRUE, ..., sep = ',', 
  eol = '
', quote.string=FALSE)

Arguments

value
a data.frame;
file
a file object (connection, file name, etc).
batch
maximum number of rows to write at a time.
...
any other arguments are passed to write.table.
sep
field separator passed to write.table.
eol
end of line character passed to write.table.
quote.string
logical value passed to write.table.

Value

  • NULL, invisibly.

Details

The function has a while loop invoking write.table for subsets of batch rows of value. Since this is a helper function for mysqlWriteTable has hardcoded other arguments to write.table.

See Also

write.table

Examples

Run this code
ctr.file <- file("dump.sqloader", "w")
   safe.write(big.data, file = ctr.file, batch = 25000)

Run the code above in your browser using DataCamp Workspace