Commit Graph

10 Commits

Author SHA1 Message Date
QP Hou
7f0d4bf941
build with stable rust toolchain (#335) 2024-05-27 00:12:55 -07:00
QP Hou
3bfcb29bcd
bump datafusion to 37 and arrow to 51 (#334)
closes #324 #325
2024-05-26 23:32:56 -07:00
QP Hou
9eba0281c6
support http for delta tables (#333) 2024-05-26 00:33:01 -07:00
QP Hou
199f9d8e0f
bump datafusion to 35 and arrow to 50 (#320)
also bump rustc version
2024-03-24 15:58:36 -07:00
Rich
f9b17888cb
fix url decoding of space (#257)
* Add two test case of space

* decode percent in url

* remove query of space
2023-01-30 23:06:01 -08:00
Rich
2ec39ddba8
support Native Azure Storage (#250)
* support native Azure Storage

* query azure_blogs in CI

* check Azure Storage support in readme

* remove debug print

* Handle url.host_str error
2023-01-23 18:25:56 -08:00
Rich
fffc8558a8
Native GCS support (#248)
* Set object_store minimal version and turn on aws_profile feature

* Add native GCS support with GOOGLE_APPLICATION_CREDENTIALS

* hacky: create /tmp/gcs.json for test

* use GoogleCloudStorageBuilder::from_env

* create temp file inside test for GCS

Co-authored-by: QP Hou <dave2008713@gmail.com>
2023-01-22 07:42:47 +00:00
Rich
9db6b418cb
replace s3 table source to unified io:object_store (#244) 2023-01-17 23:29:11 -08:00
Rich
1e3644ec36
#240 support s3 direct with ColumnQObjectStoreProvider (#241)
* Add test case for s3 direct query

* draft: add ColumnQObjectStoreProvider and global Datafusion SessionContext

* fix a few tests of load params change

* fix database tests of load params change

* do not overwrite endpoint if AWS_ENDPOINT_URL is not provided

* ObjectStoreProvider trait change after upgrade from Datafusion 12 to 14

* add comment for difference of test_s3_memory and test_s3_direct

* add unit test for ColumnQObjectStoreProvider

* fix s3 unit test with aws region in CI
2023-01-16 22:03:11 -08:00
Rich
68ee99a924
#18 minio (S3) in CI (#237)
Full end to end S3 test
2023-01-10 22:24:20 -08:00