CodeCow/roapi
1
0
Fork 0
mirror of https://github.com/roapi/roapi.git synced 2026-06-05 21:04:02 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
127 Commits 3 Branches 47 Tags 2.2 MiB
roapi-http-v0.5.0
Commit Graph

127 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
QP Hou
ede97cb05f
change default batch size to 8192 (#112) 2021-11-21 19:12:25 -08:00
Qingping Hou
c439cf2bbd update readme for new feature 2021-11-21 17:52:54 -08:00
Qingping Hou
8a1fd6e011 bump version for release 2021-11-21 14:59:47 -08:00
QP Hou
928027fe31
bump datafusion to 6.x (#111) 
adds support for accessing nested struct field and array element
 2021-11-21 14:41:02 -08:00
Toby Hede
494f5d5b13
Wrap reader as bufreader for file json and ndjson (#109) 
* wrap read as bufreader for json
* wrap read as bufreader for ndjson
 2021-11-21 06:29:03 +00:00
Toby Hede
9e3769bb8c
make batch_size configurable (#107) 2021-11-19 00:54:37 +00:00
Charlie Harrington
65702fd350
fix typo 'GoogleSpeadsheet' -> 'GoogleSpreadsheet' (#108) 2021-11-16 19:11:18 +00:00
Xabi
def0b18b1e
Install ca-certificates in docker build (#106) 2021-11-16 08:34:31 +00:00
QP Hou
a08465d56f
bump tower-http to 0.1.2 (#105) 2021-11-13 17:17:53 -08:00
Erwin Kroon
56b8d0b8d3
Fallback to application/json encoding (#104) 
* feat: fallback to application/json encoding

* fix: update tower-http git hash

* Update roapi-http/src/api/mod.rs

* build: clean roapi-http output in default build

* fix: tower-http cors Any -> any()

Co-authored-by: QP Hou <dave2008713@gmail.com>
 2021-11-13 11:06:58 -08:00
Daniël Heres
b661dbe996
Uprade axum to 0.3 (#100) 2021-11-03 18:06:07 -07:00
QP Hou
de1359f150
support custom s3 endpoint (#99) 
* mention uri encoding in url parse error

* support custom s3 endpoint
 2021-10-30 23:28:11 -07:00
Qingping Hou
989d05092c bump crate versions 2021-10-24 16:48:18 -07:00
QP Hou
246bc6d0c5
migrate to axum (#97) 2021-10-24 16:27:25 -07:00
Erwin Kroon
3e4bd2ea40
refactor and convert routes tests into integration tests (#96) 
Introduced Application struct to help with axum migration.

Co-authored-by: Qingping Hou <dave2008713@gmail.com>
 2021-10-23 14:00:39 -07:00
QP Hou
6dd58dc9e0
fix intermittent illegal instruction build error (#95) 2021-10-18 18:56:21 -07:00
QP Hou
17c96d1102
refactor encode_record_batches to get ready for http framework migration (#94) 2021-10-18 10:19:34 -07:00
QP Hou
6ce319de5f
add native-tls feature to support linking with system provided openssl (#93) 
other ci related changes:
* temporarily disable openssl build in release jobs
* upload windows build to github release
 2021-10-14 09:05:54 -07:00
Qingping Hou
a018637a90 fix windows release build 2021-10-11 22:12:45 -07:00
QP Hou
5ffdf09a05
set target-cpu to skylake for x86 builds (#92) 2021-10-11 21:40:02 -07:00
QP Hou
b382249d39
fix mac universal2 build (#89) 2021-10-11 18:32:31 -07:00
QP Hou
7776462d3c
optimize release build (#88) 
* switching to snmalloc yields 20% performance boost
* codegen-unit=1 yields 20% performance boost
 2021-10-10 17:08:07 -07:00
QP Hou
fd824cabf2
validate docker build in CI (#87) 2021-10-10 13:46:17 -07:00
Erwin Kroon
92e1e2408e
Switch to rustls as the default (#83) 
Added the new features to the linux build-matrix and the windows and macos build only build the default rustls feature. Only the rustls matrix-items will have their wheels and artifacts publiced.
 2021-09-30 09:45:33 -07:00
Erwin Kroon
2183332de9
Enable SIMD feature for docker build (#81) 
* Enable SIMD feature for docker build

Fixes #15

* Force cargo-cache installation
 2021-09-26 10:14:53 -07:00
Qingping Hou
f291ef355f trim cargo cache in ci 2021-09-19 19:18:49 -07:00
Qingping Hou
509af14f61 fix tests 2021-09-19 18:59:11 -07:00
Qingping Hou
7857efabba test docker build in CI 2021-09-19 18:39:28 -07:00
Qingping Hou
aa36d64dce bump datafusion, arrow and deltalake version 2021-09-19 18:37:56 -07:00
Qingping Hou
57a1779a95 add exit/quit command to columnq-cli 2021-09-18 22:05:49 -07:00
Daniël Heres
f72299f142
Dependency upgrades (#75) 2021-09-13 19:12:45 +00:00
Qingping Hou
030fdfe091 Revert "ignore release jobs on doc and test data update" 
This reverts commit 2b86d7e22c.
 2021-09-06 13:22:20 -07:00
QP Hou
b039024b8f
ignore release jobs on doc and test data update (#73) 2021-09-06 13:18:53 -07:00
Qingping Hou
612d5c1e74 add links in readme 2021-09-06 09:50:18 -07:00
Qingping Hou
7824f29980 add installation guide 2021-09-06 09:34:35 -07:00
Qingping Hou
69078c12b6 columnq-cli: add arrow and parquet output support 2021-09-06 00:58:03 -07:00
Qingping Hou
0a20484725 move columnq-cli history file to ~/.columnq_history 2021-09-06 00:58:03 -07:00
Qingping Hou
5696e3f855 add columnq-cli release job 2021-09-06 00:58:03 -07:00
Qingping Hou
904624648c more columnq cli readme update 2021-09-06 00:58:03 -07:00
Thomas Peiselt
ea84099b07
Lazy load delta: Support for large tables (#71) 
* Allow for delta tables to be directly backed by storage.

Enables experimental support for delta tables that are too large to be
stored in memory. We directly expose `DeltaTable` instead of copying the
data into a datafusion::Memtable.

Disadvantages:
- in the new mode, no support for S3
- as we're relying on datafusion to handle the parquet files directly,
  nested schemas and certain data types may not work properly.
 2021-09-06 00:56:55 -07:00
Erwin Kroon
ff2d06b0e4
add support for all Arrow IPC formats in roapi-http (#67) 
* add support for all arrow IPC formats in roapi-http

* refactor: schema inferrence and partitions in 1 loop
 2021-09-05 14:27:09 -07:00
Qingping Hou
db143275a9 remove diagram source 
diagrams are now managed in docs repo
 2021-09-04 17:41:28 -07:00
Qingping Hou
7da1de7b43 update diagram to include parquet encoding 2021-09-04 17:35:51 -07:00
Qingping Hou
82ab552ec4 update documentation 2021-09-04 17:32:39 -07:00
Qingping Hou
3ff234798e better error message for fs io source 2021-09-04 17:32:39 -07:00
tempbottle
ac761afea0 explicit windows platform support 2021-09-04 08:50:58 -07:00
Qingping Hou
1dd783101e disable i686 release for linux platform 2021-09-03 23:25:18 -07:00
Thomas Peiselt
5ace8b8695
Lazy load parquet (#63) 
* PoC for parquet: reading a table by registering parquet directly.

* Adding config flag and restoring existing _in-memory_ code path.

* Addressing review comment: separate `to_mem_table()`.

* Addressing review comment: default-able `LoadOptionParquet`.

* Adding test: make sure we instantiated `datafusion::datasource::ParquetTable`
 2021-09-03 19:36:18 +00:00
Erwin Kroon
c79a35a3fc
add parquet encoding (#64) 
* add parquet encoding

* add alternative content-type for parquet encoding
 2021-08-30 06:45:13 +00:00
Qingping Hou
0e8690d509 use reexported arrow from datafusion in columnq 2021-08-14 16:33:27 -07:00