Write on your favourite object storage
df.write.format("qbeast")
.option("columnsToIndex",
"your,columns")
.save("your-storage-path")
(df.write.format("qbeast")
.option("columnsToIndex",
"your,columns")
.save("your-storage-path"))
Load the data onto a Spark Data Frame
val qbeastDf =
spark.read.format("qbeast")
.load("your-storage-path")
(qbeastDf = spark.read.load
("your-storage-path",
format="qbeast"))
And query with sampling
qbeastDf.sample(0.1).show
qbeastDf.sample(0.1).show
qbeastDf.createOrReplaceTempView(
"qbeast_table")
spark.sql("SELECT * FROM
qbeast_table
TABLESAMPLE(1 PERCENT)")