QP Hou
c07127a343
optimize partition scan
2023-12-11 14:09:05 -08:00
QP Hou
9377b7ccad
support infer schema by list of files ( #310 )
2023-11-19 20:14:26 -08:00
QP Hou
b2454f48e5
build docker image with cargo chef cache ( #309 )
2023-11-19 11:31:39 -08:00
QP Hou
a322d1b443
support defining nested enum data types in schema config ( #308 )
2023-11-18 19:01:53 -08:00
QP Hou
b70c3bcb0b
enable aws feature in object_store crate by default
2023-10-31 01:03:22 -07:00
QP Hou
d531f8ae46
support partitioned tables ( #307 )
2023-10-20 16:00:07 -07:00
QP Hou
ea01ffe0d3
upgrade clap to 4 ( #304 )
2023-10-14 21:09:21 -07:00
Qingping Hou
51584dd3a0
update readme
2023-10-11 00:19:45 -07:00
Qingping Hou
8df946f68a
update readme
2023-10-11 00:16:39 -07:00
QP Hou
0dcb6141cb
use lockfile in docker build ( #303 )
2023-10-10 23:58:30 -07:00
QP Hou
ef113c5521
add flightsql support ( #301 )
2023-10-10 22:31:14 -07:00
QP Hou
94a206045b
make addr config optional ( #302 )
2023-10-10 22:31:01 -07:00
QP Hou
b10afb0116
enable resolve 2 in cargo.toml ( #300 )
2023-10-03 01:53:06 -07:00
QP Hou
eef379f9bb
switch to snafu for error handling in columnq ( #299 )
2023-10-03 00:27:04 -07:00
QP Hou
2baf669841
update datafusion to 31 ( #297 )
2023-09-30 19:24:47 -07:00
Qingping Hou
32d85f4b0c
disable armv7 build
2023-09-16 12:36:18 -07:00
Qingping Hou
5d1559e08c
avoid skylake target cpu flags for arm builds
2023-09-16 12:36:18 -07:00
Joe
ffd1ca6dda
remove unwrap ( #294 )
2023-09-11 22:42:50 -07:00
Joe
5348f68d6e
refactor read table from db code ( #293 )
2023-09-10 23:42:28 -07:00
Joe
ff3617767d
feat: support postgresql ( #286 )
2023-08-29 09:06:11 -07:00
QP Hou
b8b772a018
[ci] fix gcs ci setup ( #291 )
2023-08-27 10:58:27 -07:00
Joe
500e535caa
feat: support datafusion config ( #288 )
2023-08-13 01:09:12 +00:00
Jean Khawand
921aef9f01
Enhance dev experience using devcontainer ( #285 )
...
feat(dev-container): introduce dev container for better developer experience
doc(dev-container): update readme for dev container setup
feat(dev-container): add dummy sql sample for testing
feat(dev-container): add devcontainer.json config
Co-authored-by: QP Hou <dave2008713@gmail.com>
---------
Co-authored-by: QP Hou <dave2008713@gmail.com>
2023-07-25 18:49:52 +00:00
Charles Swanberg
01c5422206
Cloud support deltalake ( #280 )
...
* fix: enable cloud support for deltalake
* fix clippy issues
* formatting fixes
2023-06-20 00:43:35 -07:00
QP Hou
df39a13d3f
upgrade datafusion and arrow ( #279 )
...
* update arrow, datafusion, delta, convergence, object_store, sqlparser
* fix breaking code
* update to datafusion 23
* update connectorx fork
---------
Co-authored-by: Chitral Verma <chitralverma@gmail.com>
2023-05-29 23:25:45 -07:00
Jiayu Liu
ae13d3bc9e
support toml as config lang ( #277 )
...
* support toml as config lang
* update readme
2023-05-22 22:45:39 -07:00
Robert Gieseke
411d727263
Update connector-x to latest commit of original repo
...
Closes #271
2023-04-14 08:27:30 -07:00
Akshith Madhur
4cd9360fb4
fixed csv-s3 issue ( #268 )
...
Co-authored-by: Elliot Alderson <elliot@Elliots-MacBook-Pro.local>
2023-03-14 23:35:02 -07:00
Rich
51e01ef968
Upgrade object_store to 0.5.4 ( #262 )
...
object_stoer 0.5.4 introduce more authentication support for GCP and Azure, including Workload Identity
2023-02-28 00:03:36 -08:00
Qingping Hou
5b28b7c252
support catalog queries
2023-02-06 19:02:20 -08:00
Qingping Hou
c91e9cbe57
apply and enforce rust-fmt
2023-02-06 19:02:20 -08:00
Rich
f9b17888cb
fix url decoding of space ( #257 )
...
* Add two test case of space
* decode percent in url
* remove query of space
2023-01-30 23:06:01 -08:00
Ryan Russell
97e6a4cd8d
chore(columnq): readability fixups in json ( #256 )
2023-01-29 09:43:39 -08:00
QP Hou
3e55a29b87
update deps in cargo lock ( #255 )
2023-01-29 09:32:15 -08:00
QP Hou
c8e7b596ec
ci: add sqlite tests ( #253 )
2023-01-28 23:55:54 -08:00
QP Hou
90e79dc7f0
fix(postgres): ignore non-select queries ( #252 )
2023-01-28 21:59:34 -05:00
QP Hou
2c128c8f7f
ci: fix lints from new rust release ( #254 )
2023-01-28 16:44:03 -08:00
Rich
bc5754a4ed
bump roapi to 0.9.0 and columnq-cli to 0.4.0 ( #251 )
...
* bump roapi to 0.9.0
* bump columnq-cli to 0.4.0
2023-01-24 20:43:26 -08:00
Rich
2ec39ddba8
support Native Azure Storage ( #250 )
...
* support native Azure Storage
* query azure_blogs in CI
* check Azure Storage support in readme
* remove debug print
* Handle url.host_str error
2023-01-23 18:25:56 -08:00
QP Hou
f2684ee103
docs: check GCS support in readme ( #249 )
2023-01-22 12:06:22 -05:00
Rich
fffc8558a8
Native GCS support ( #248 )
...
* Set object_store minimal version and turn on aws_profile feature
* Add native GCS support with GOOGLE_APPLICATION_CREDENTIALS
* hacky: create /tmp/gcs.json for test
* use GoogleCloudStorageBuilder::from_env
* create temp file inside test for GCS
Co-authored-by: QP Hou <dave2008713@gmail.com>
2023-01-22 07:42:47 +00:00
Rich
e4f00489d1
#240 Set object_store minimal version and turn on aws_profile feature ( #247 )
...
* Set object_store minimal version and turn on aws_profile feature
* remove unnecessary with_endpoint after upgrade to object_store 0.5.3
2023-01-21 23:20:11 -08:00
Rich
bd168d92d8
replace rusoto_s3: part 2 (last part) ( #245 )
...
* replace rusoto_s3 in columnq::table::delta
* remove rusoto crate
2023-01-18 22:15:12 -08:00
Rich
9db6b418cb
replace s3 table source to unified io:object_store ( #244 )
2023-01-17 23:29:11 -08:00
Rich
1e3644ec36
#240 support s3 direct with ColumnQObjectStoreProvider ( #241 )
...
* Add test case for s3 direct query
* draft: add ColumnQObjectStoreProvider and global Datafusion SessionContext
* fix a few tests of load params change
* fix database tests of load params change
* do not overwrite endpoint if AWS_ENDPOINT_URL is not provided
* ObjectStoreProvider trait change after upgrade from Datafusion 12 to 14
* add comment for difference of test_s3_memory and test_s3_direct
* add unit test for ColumnQObjectStoreProvider
* fix s3 unit test with aws region in CI
2023-01-16 22:03:11 -08:00
QP Hou
3d4da9a810
update datafusion to 14 and arrow to 26 ( #242 )
2023-01-15 22:47:13 -08:00
Rich
68ee99a924
#18 minio (S3) in CI ( #237 )
...
Full end to end S3 test
2023-01-10 22:24:20 -08:00
Rich
eed91fdbbe
#235 : upgrade rusoto and force http1 for rustls ( #236 )
...
* upgrade rusoto and force http1 for rustls
* add dependency for openssl_build
2023-01-01 15:33:25 -08:00
Akshith Madhur
c0bff95321
Added Pagination closes #229 ( #230 )
...
Co-authored-by: mr-kk-26 <gmail@gmail.com>
2022-11-27 00:33:19 -08:00
Akshith Madhur
026382ecf0
csv use_memory_table option added(resolves issue #224 ) ( #225 )
...
* csv use_memory_table option added
* fixes issue #224
2022-11-21 23:25:36 -08:00
