roapi/columnq/src/table
Thomas Peiselt ea84099b07
Lazy load delta: Support for large tables (#71)
* Allow for delta tables to be directly backed by storage.

Enables experimental support for delta tables that are too large to be
stored in memory. We directly expose `DeltaTable` instead of copying the
data into a datafusion::Memtable.

Disadvantages:
- in the new mode, no support for S3
- as we're relying on datafusion to handle the parquet files directly,
  nested schemas and certain data types may not work properly.
2021-09-06 00:56:55 -07:00
..
arrow_ipc_file.rs add support for all Arrow IPC formats in roapi-http (#67) 2021-09-05 14:27:09 -07:00
arrow_ipc_stream.rs add support for all Arrow IPC formats in roapi-http (#67) 2021-09-05 14:27:09 -07:00
csv.rs use reexported arrow from datafusion in columnq 2021-08-14 16:33:27 -07:00
delta.rs Lazy load delta: Support for large tables (#71) 2021-09-06 00:56:55 -07:00
google_spreadsheets.rs use reexported arrow from datafusion in columnq 2021-08-14 16:33:27 -07:00
json.rs use reexported arrow from datafusion in columnq 2021-08-14 16:33:27 -07:00
mod.rs Lazy load delta: Support for large tables (#71) 2021-09-06 00:56:55 -07:00
ndjson.rs use reexported arrow from datafusion in columnq 2021-08-14 16:33:27 -07:00
parquet.rs Lazy load delta: Support for large tables (#71) 2021-09-06 00:56:55 -07:00