stream_stats

0th

Percentile

Stream Statistics

Collects streaming statistics, usually, to be used with stream_render() to render streaming statistics.

Usage
stream_stats(stream, stats = list())
Arguments
stream

The stream to collect statistics from.

stats

An optional stats object generated using stream_stats().

Value

A stats object containing streaming statistics that can be passed back to the stats parameter to continue aggregating streaming stats.

Aliases
  • stream_stats
Examples
# NOT RUN {
sc <- spark_connect(master = "local")
sdf_len(sc, 10) %>%
  spark_write_parquet(path = "parquet-in")

stream <- stream_read_parquet(sc, "parquet-in") %>%
 stream_write_parquet("parquet-out")

stream_stats(stream)
# }
# NOT RUN {
# }
Documentation reproduced from package sparklyr, version 0.9.2, License: Apache License 2.0 | file LICENSE

Community examples

Looks like there are no examples yet.