sdf_persist(x, storage.level = "MEMORY_AND_DISK")
tbl_spark
).Users of Spark should be careful to persist the results of any computations which are non-deterministic -- otherwise, one might see that the values within a column seem to 'change' as new operations are performed on that data set.