Last chance! 50% off unlimited learning
Sale ends in
Reads a Socket stream as a Spark dataframe stream.
stream_read_socket(sc, name = NULL, columns = NULL, options = list(), ...)
A spark_connection
.
The name to assign to the newly generated stream.
A vector of column names or a named vector of column types.
If specified, the elements can be "binary"
for BinaryType
,
"boolean"
for BooleanType
, "byte"
for ByteType
,
"integer"
for IntegerType
, "integer64"
for LongType
,
"double"
for DoubleType
, "character"
for StringType
,
"timestamp"
for TimestampType
and "date"
for DateType
.
A list of strings with additional options.
Optional arguments; currently unused.
Other Spark stream serialization:
stream_read_csv()
,
stream_read_delta()
,
stream_read_json()
,
stream_read_kafka()
,
stream_read_orc()
,
stream_read_parquet()
,
stream_read_text()
,
stream_write_console()
,
stream_write_csv()
,
stream_write_delta()
,
stream_write_json()
,
stream_write_kafka()
,
stream_write_memory()
,
stream_write_orc()
,
stream_write_parquet()
,
stream_write_text()
# NOT RUN {
sc <- spark_connect(master = "local")
# Start socket server from terminal, example: nc -lk 9999
stream <- stream_read_socket(sc, options = list(host = "localhost", port = 9999))
stream
# }
# NOT RUN {
# }
Run the code above in your browser using DataLab