RAthena (version 2.6.3)

dbConvertTable: dbConvertTable aws s3 backend file types.

Description

Utilises AWS Athena to convert AWS S3 backend file types. It also also to create more efficient file types i.e. "parquet" and "orc" from SQL queries.

Usage

dbConvertTable(conn, obj, name, ...)
# S4 method for AthenaConnection
dbConvertTable(
  conn,
  obj,
  name,
  partition = NULL,
  s3.location = NULL,
  file.type = c("NULL", "csv", "tsv", "parquet", "json", "orc"),
  compress = TRUE,
  data = TRUE,
  ...
)

Value

dbConvertTable() returns TRUE but invisible.

Arguments

conn

A DBI::DBIConnection object,

obj

Athena table or SQL DML query to be converted. For SQL, the query need to be wrapped with DBI::SQL() and follow AWS Athena DML format link

name

Name of destination table

...

Extra parameters, currently not used

partition

Partition Athena table

s3.location

location to store output file, must be in s3 uri format for example ("s3://mybucket/data/").

file.type

File type for name, currently support c("NULL","csv", "tsv", "parquet", "json", "orc"). "NULL" will let Athena set the file type for you.

compress

Compress name, currently can only compress c("parquet", "orc") (AWS Athena CTAS)

data

If name should be created with data or not.