Qingping Hou
aa36d64dce
bump datafusion, arrow and deltalake version
2021-09-19 18:37:56 -07:00
Qingping Hou
57a1779a95
add exit/quit command to columnq-cli
2021-09-18 22:05:49 -07:00
Daniël Heres
f72299f142
Dependency upgrades ( #75 )
2021-09-13 19:12:45 +00:00
Qingping Hou
030fdfe091
Revert "ignore release jobs on doc and test data update"
...
This reverts commit 2b86d7e22c
2021-09-06 13:22:20 -07:00
QP Hou
b039024b8f
ignore release jobs on doc and test data update ( #73 )
2021-09-06 13:18:53 -07:00
Qingping Hou
612d5c1e74
add links in readme
2021-09-06 09:50:18 -07:00
Qingping Hou
7824f29980
add installation guide
2021-09-06 09:34:35 -07:00
Qingping Hou
69078c12b6
columnq-cli: add arrow and parquet output support
2021-09-06 00:58:03 -07:00
Qingping Hou
0a20484725
move columnq-cli history file to ~/.columnq_history
2021-09-06 00:58:03 -07:00
Qingping Hou
5696e3f855
add columnq-cli release job
2021-09-06 00:58:03 -07:00
Qingping Hou
904624648c
more columnq cli readme update
2021-09-06 00:58:03 -07:00
Thomas Peiselt
ea84099b07
Lazy load delta: Support for large tables ( #71 )
...
* Allow for delta tables to be directly backed by storage.
Enables experimental support for delta tables that are too large to be
stored in memory. We directly expose `DeltaTable` instead of copying the
data into a datafusion::Memtable.
Disadvantages:
- in the new mode, no support for S3
- as we're relying on datafusion to handle the parquet files directly,
nested schemas and certain data types may not work properly.
2021-09-06 00:56:55 -07:00
Erwin Kroon
ff2d06b0e4
add support for all Arrow IPC formats in roapi-http ( #67 )
...
* add support for all arrow IPC formats in roapi-http
* refactor: schema inferrence and partitions in 1 loop
2021-09-05 14:27:09 -07:00
Qingping Hou
db143275a9
remove diagram source
...
diagrams are now managed in docs repo
2021-09-04 17:41:28 -07:00
Qingping Hou
7da1de7b43
update diagram to include parquet encoding
2021-09-04 17:35:51 -07:00
Qingping Hou
82ab552ec4
update documentation
2021-09-04 17:32:39 -07:00
Qingping Hou
3ff234798e
better error message for fs io source
2021-09-04 17:32:39 -07:00
tempbottle
ac761afea0
explicit windows platform support
2021-09-04 08:50:58 -07:00
Qingping Hou
1dd783101e
disable i686 release for linux platform
2021-09-03 23:25:18 -07:00
Thomas Peiselt
5ace8b8695
Lazy load parquet ( #63 )
...
* PoC for parquet: reading a table by registering parquet directly.
* Adding config flag and restoring existing _in-memory_ code path.
* Addressing review comment: separate `to_mem_table()`.
* Addressing review comment: default-able `LoadOptionParquet`.
* Adding test: make sure we instantiated `datafusion::datasource::ParquetTable`
2021-09-03 19:36:18 +00:00
Erwin Kroon
c79a35a3fc
add parquet encoding ( #64 )
...
* add parquet encoding
* add alternative content-type for parquet encoding
2021-08-30 06:45:13 +00:00
Qingping Hou
0e8690d509
use reexported arrow from datafusion in columnq
2021-08-14 16:33:27 -07:00
Qingping Hou
d4a2ad9d84
bump datafusion to 5.0.0 release
2021-08-14 16:33:27 -07:00
Qingping Hou
a7255de838
use a different cache key for simd ci run
2021-08-08 21:45:38 -07:00
Qingping Hou
075fc70754
bump version to 0.3.4
2021-08-08 21:32:15 -07:00
Qingping Hou
ed74bb1ba9
cache rust builds in ci
2021-08-08 17:42:12 -07:00
Qingping Hou
0a2a965072
update arrow to 5.x and datafusion to latest
2021-08-08 17:42:12 -07:00
Qingping Hou
485dec7cc8
update deltalake for null partition fix
2021-08-08 17:42:12 -07:00
Qingping Hou
98110356d1
fix test
2021-07-22 23:38:28 -07:00
Qingping Hou
0001af26c2
fix docker image repo in release job
2021-07-22 23:38:28 -07:00
Qingping Hou
95f9ced23d
support deriving table name from table uri
2021-07-22 23:38:28 -07:00
Qingping Hou
e5989d1f9d
bump arrow for struct support in table output
2021-07-21 00:04:18 -07:00
Qingping Hou
75bb596987
define rust nightly version in a single place
2021-07-20 23:05:05 -07:00
Qingping Hou
5d97802813
fix linux and docker release
2021-07-20 22:52:31 -07:00
Qingping Hou
f1284592a6
pin nightly rustc version in release ci job
2021-07-20 22:10:57 -07:00
Qingping Hou
ca131b1aca
fix: support reading arbitrary binary from stdin as table input
2021-07-19 22:32:59 -07:00
Qingping Hou
ddf611cc0d
support csv serialization
2021-07-19 22:32:59 -07:00
Qingping Hou
7c51ff0fe4
moving encoding layer into columnq & support json cli output
2021-07-19 22:32:59 -07:00
Qingping Hou
8ed83db116
set dependency for docker image release job
2021-07-18 19:42:22 -07:00
Qingping Hou
aff94fa616
add automated docker image release
2021-07-18 19:41:18 -07:00
Qingping Hou
d7fab6369c
bump deltalake version to 0.4
2021-07-18 17:59:32 -07:00
Qingping Hou
e923f2edb8
bump rustc version in dockerfile
2021-07-18 01:19:49 -07:00
Qingping Hou
232f3280e4
bump version in cargo to 0.3.1
2021-07-18 00:45:14 -07:00
Qingping Hou
70bfcf1422
fix maturin install in release
2021-07-18 00:18:23 -07:00
Qingping Hou
d5359b4e56
lots of goodies
...
* add in memory io source support
* add sql command to columnq cli
* support passing table format as columnq cli option
2021-07-18 00:06:59 -07:00
Qingping Hou
c2af31882b
pin maturin version in ci
2021-07-18 00:06:59 -07:00
QP Hou
d6d7b538ad
enable lto for release build ( #49 )
2021-07-06 06:52:01 +00:00
Qingping Hou
afb130b0f8
move columnq cli into its own package
2021-07-05 23:10:47 -07:00
Qingping Hou
9238850e3d
enable readline with history
2021-07-05 23:10:47 -07:00
Qingping Hou
ef82e24a64
support SHOW COLUMNS statement in columnq CLI
2021-07-05 23:10:47 -07:00
