Writes the data from a data source to a directory of Parquet files.
ds_write_parquet(ds, path, save_mode = SaveMode$ERROR)
No return value, called for side effects only.
Pathling documentation - Writing Parquet
Other data sink functions:
ds_write_delta()
,
ds_write_ndjson()
,
ds_write_tables()
pc <- pathling_connect()
#> Warning: 2 arguments not used by format 'spark-3.5.3-bin-hadoop3'
data_source <- pc %>% pathling_read_ndjson(pathling_examples('ndjson'))
# Write the data to a directory of Parquet files.
data_source %>% ds_write_parquet(file.path(tempdir(), 'parquet'))
pathling_disconnect(pc)