Commit Graph

200 Commits

Author SHA1 Message Date
Rich
bc5754a4ed
bump roapi to 0.9.0 and columnq-cli to 0.4.0 (#251)
* bump roapi to 0.9.0

* bump columnq-cli to 0.4.0
2023-01-24 20:43:26 -08:00
Rich
2ec39ddba8
support Native Azure Storage (#250)
* support native Azure Storage

* query azure_blogs in CI

* check Azure Storage support in readme

* remove debug print

* Handle url.host_str error
2023-01-23 18:25:56 -08:00
QP Hou
f2684ee103
docs: check GCS support in readme (#249) 2023-01-22 12:06:22 -05:00
Rich
fffc8558a8
Native GCS support (#248)
* Set object_store minimal version and turn on aws_profile feature

* Add native GCS support with GOOGLE_APPLICATION_CREDENTIALS

* hacky: create /tmp/gcs.json for test

* use GoogleCloudStorageBuilder::from_env

* create temp file inside test for GCS

Co-authored-by: QP Hou <dave2008713@gmail.com>
2023-01-22 07:42:47 +00:00
Rich
e4f00489d1
#240 Set object_store minimal version and turn on aws_profile feature (#247)
* Set object_store minimal version and turn on aws_profile feature

* remove unnecessary with_endpoint after upgrade to object_store 0.5.3
2023-01-21 23:20:11 -08:00
Rich
bd168d92d8
replace rusoto_s3: part 2 (last part) (#245)
* replace rusoto_s3 in columnq::table::delta

* remove rusoto crate
2023-01-18 22:15:12 -08:00
Rich
9db6b418cb
replace s3 table source to unified io:object_store (#244) 2023-01-17 23:29:11 -08:00
Rich
1e3644ec36
#240 support s3 direct with ColumnQObjectStoreProvider (#241)
* Add test case for s3 direct query

* draft: add ColumnQObjectStoreProvider and global Datafusion SessionContext

* fix a few tests of load params change

* fix database tests of load params change

* do not overwrite endpoint if AWS_ENDPOINT_URL is not provided

* ObjectStoreProvider trait change after upgrade from Datafusion 12 to 14

* add comment for difference of test_s3_memory and test_s3_direct

* add unit test for ColumnQObjectStoreProvider

* fix s3 unit test with aws region in CI
2023-01-16 22:03:11 -08:00
QP Hou
3d4da9a810
update datafusion to 14 and arrow to 26 (#242) 2023-01-15 22:47:13 -08:00
Rich
68ee99a924
#18 minio (S3) in CI (#237)
Full end to end S3 test
2023-01-10 22:24:20 -08:00
Rich
eed91fdbbe
#235: upgrade rusoto and force http1 for rustls (#236)
* upgrade rusoto and force http1 for rustls

* add dependency for  openssl_build
2023-01-01 15:33:25 -08:00
Akshith Madhur
c0bff95321
Added Pagination closes #229 (#230)
Co-authored-by: mr-kk-26 <gmail@gmail.com>
2022-11-27 00:33:19 -08:00
Akshith Madhur
026382ecf0
csv use_memory_table option added(resolves issue #224) (#225)
* csv use_memory_table option added

* fixes issue #224
2022-11-21 23:25:36 -08:00
QP Hou
1467739e25
replace dotenv with dotenvy (#216) 2022-11-21 22:15:58 -08:00
Y Togami
beac9cca6a
Fix: support .sqlite, sqlite3 (#223)
* fix: support sqlite extension

* chore: add .sqlite, .sqlite3 test data
2022-11-11 15:47:31 -08:00
Akshith Madhur
7fea7c791a
Fixes issue with limit (#221)
* fixes limit issue

* updated graphql & rest tests
2022-11-07 20:58:35 -08:00
Charlie Harrington
7a8c76363f
update roapi version to 0.8.1 (#222) 2022-11-06 21:11:39 -08:00
Y Togami
35549c0ddf
feat: support .xlsx (#218) 2022-10-28 18:46:09 -07:00
Ralf Northman
d5f71734d4
Implementation of response format config (#212) (#215) 2022-10-23 08:54:52 +00:00
Y Togami
ac43a36583
chore: typo (#214) 2022-10-22 12:43:59 -07:00
Charlie Harrington
0d0819546f
change 'reload-interval' short code to 'r' (#213) 2022-10-16 21:58:53 -07:00
Charlie Harrington
cc68167d9d
feat: automatic table refresh based on reload-interval config (#198)
Co-authored-by: Qingping Hou <dave2008713@gmail.com>
2022-10-15 22:00:55 -07:00
Y Togami
e9d0a03b89
dep: replace tempdir to tempfile (#202) 2022-10-15 17:53:42 -07:00
Y Togami
8180fb59d6
feat: Support jsonl for the file extension (#200)
* chore: add sample .ndjson .jsonl file

* test: add test for loading .ndjson and .jsonl

* feat: support jsonl for the file extension
2022-10-14 23:31:39 -07:00
Charlie Harrington
23f3a7d684
add security audit action (#201) 2022-10-14 22:56:24 -07:00
QP Hou
b7de919e34
fix columnq release (#196) 2022-09-27 00:25:04 -07:00
QP Hou
4f4bc93a74
enable database-sqlite flag for columnq-cli (#195) 2022-09-26 09:43:05 -07:00
QP Hou
175344ed1d
fix nightly toolchain version in dockerfile (#194) 2022-09-25 19:41:20 -07:00
Qingping Hou
4e812b9995 split database feature flag into database-mysql and database-sqlite 2022-09-25 18:58:05 -07:00
Qingping Hou
37e5d5b03a bump datafusion to 12 and sqlparser to 0.23 2022-09-25 18:58:05 -07:00
Prince Mishra
caf5b65f9b
Fix minor spelling errors (#191) 2022-09-24 21:41:08 -07:00
QP Hou
45132cb237
fix columnq-cli cargo install command 2022-09-24 11:55:08 -07:00
QP Hou
0d08aeb092
fix: support region and endpoint override for s3 (#187) 2022-08-24 22:42:28 -07:00
Qingping Hou
5972467cbb fix linter errors from new rustc release 2022-08-13 11:43:16 -07:00
Qingping Hou
d53c417d14 purge build cache 2022-08-13 11:18:24 -07:00
Qingping Hou
2b03943480 fix: support loading database source in yaml config 2022-08-08 01:03:08 -07:00
geoHeil
c88ce6059f
enable database feature in release build (#182) 2022-08-08 05:24:12 +00:00
Qingping Hou
021332de5d update readme 2022-05-30 21:05:10 -07:00
Qingping Hou
406dc3b380 add boolean support to postgres wire protocol 2022-05-30 19:49:21 -07:00
Qingping Hou
200abe6185 support bitint in json serialization 2022-05-30 17:32:51 -07:00
Qingping Hou
1dcb46b7df add postgres test 2022-05-30 16:45:20 -07:00
Qingping Hou
ebc43c6fd9 display binding addresses on start up 2022-05-30 16:45:05 -07:00
QP Hou
193ea79878
support postgres wire protocol in query layer (#169) 2022-05-29 19:20:58 -07:00
QP Hou
6dc3b77a62
bump datafusion and sqlparser dep (#168) 2022-05-28 19:41:42 -07:00
zemel leong
4bb6db38b5
Update the document for mysql and sqlite (#164) 2022-04-09 00:52:36 -07:00
zemel leong
3ace6078fa
Add MySQL, Sqlite support. (#162)
* added MySQL and Sqlite datasource support
* updated arrow, datafusion and deltalake to latest version
* cleared simd ci test cache to workaround nightly compiler bug
2022-04-07 00:55:10 -07:00
QP Hou
49aeaf1d71
add kvstore support (#161) 2022-04-02 19:46:58 -07:00
Daniël Heres
5d41a28417
Update axum, sqlparser (#160) 2022-04-02 10:43:50 -07:00
QP Hou
a2676c288f
update dependency versions for roapi-http 0.6.0 (#159) 2022-03-19 12:59:10 -07:00
QP Hou
2ee3927bd4
avoid hashmap clone in schema api calls (#158) 2022-03-19 12:22:12 -07:00