Commit Graph

314 Commits

Author SHA1 Message Date
Qingping Hou
be4fb9d359 ci(fix): use unique name for upload-artifact jobs
Some checks failed
build / build (push) Has been cancelled
build / database_test (push) Has been cancelled
build / object_store_memory_test (push) Has been cancelled
build / object_store_direct_test (push) Has been cancelled
build / openssl_build (push) Has been cancelled
build / mac_cross_build (push) Has been cancelled
build / Docker Image Build (push) Has been cancelled
columnq-cli release / Validate git tag (push) Has been cancelled
roapi release / Validate git tag (push) Has been cancelled
columnq-cli release / macos (push) Has been cancelled
columnq-cli release / windows (map[features:database-sqlite python-architecture:x64 target:x86_64-pc-windows-msvc]) (push) Has been cancelled
columnq-cli release / linux (map[features:rustls,database-sqlite image_tag:aarch64-musl manylinux:2014 name_suffix: rustflags: target:aarch64-unknown-linux-musl upload:true]) (push) Has been cancelled
columnq-cli release / linux (map[features:rustls,database-sqlite image_tag:x86_64-musl manylinux:2010 name_suffix: rustflags:-C target-cpu=skylake target:x86_64-unknown-linux-musl upload:true]) (push) Has been cancelled
columnq-cli release / PyPI Release (push) Has been cancelled
roapi release / macos (push) Has been cancelled
roapi release / windows (map[features:database-sqlite python-architecture:x64 target:x86_64-pc-windows-msvc]) (push) Has been cancelled
roapi release / linux (map[features:rustls,database-sqlite image_tag:aarch64-musl manylinux:2014 name_suffix: rustflags: target:aarch64-unknown-linux-musl upload:true]) (push) Has been cancelled
roapi release / linux (map[features:rustls,database-sqlite image_tag:x86_64-musl manylinux:2010 name_suffix: rustflags:-C target-cpu=skylake target:x86_64-unknown-linux-musl upload:true]) (push) Has been cancelled
roapi release / PyPI Release (push) Has been cancelled
roapi release / Docker Image Release (push) Has been cancelled
2024-10-20 19:02:00 -07:00
Qingping Hou
f4dacd9fa7 ci(fix): update upload-artifacts action to v4 2024-10-20 17:52:58 -07:00
hozan23
daabd84418
columnq: add apply_query() and exec_query_with_df() to query::rest module (#349)
Following this PR #348 

This PR exposes two functions from the columnq::query::rest module:

    apply_query()
    exec_query_with_df()

This PR also includes breaking changes to ensure consistency with the
function names in the `columnq::query::graphql` module. I renamed the
function `query_table` to `exec_table_query`.
2024-10-20 17:14:01 -07:00
hozan23
e282c6c1d1
columnq: add apply_query() and exec_query_with_df() to query::graphql module (#348)
This PR exposes two functions from the `columnq::query::graphql` module:

- `apply_query()`
- `exec_query_with_df()`

These functions are similar to `query_to_df()` and `exec_query()`, but
they accept a `DataFrame` instead of a `SessionContext`.

This is useful for defining rules directly within a `DataFrame` without
modifying the table schema in DataFusion's session context.
2024-10-20 17:09:06 -07:00
Brendan Ryback
b776dd34ce
Support for Dynamic Table Deletion #340 (#343)
Some checks failed
build / build (push) Has been cancelled
build / database_test (push) Has been cancelled
build / object_store_memory_test (push) Has been cancelled
build / object_store_direct_test (push) Has been cancelled
build / openssl_build (push) Has been cancelled
build / mac_cross_build (push) Has been cancelled
build / Docker Image Build (push) Has been cancelled
columnq-cli release / Validate git tag (push) Has been cancelled
roapi release / Validate git tag (push) Has been cancelled
columnq-cli release / macos (push) Has been cancelled
columnq-cli release / windows (map[features:database-sqlite python-architecture:x64 target:x86_64-pc-windows-msvc]) (push) Has been cancelled
columnq-cli release / linux (map[features:rustls,database-sqlite image_tag:aarch64-musl manylinux:2014 name_suffix: rustflags: target:aarch64-unknown-linux-musl upload:true]) (push) Has been cancelled
columnq-cli release / linux (map[features:rustls,database-sqlite image_tag:x86_64-musl manylinux:2010 name_suffix: rustflags:-C target-cpu=skylake target:x86_64-unknown-linux-musl upload:true]) (push) Has been cancelled
columnq-cli release / PyPI Release (push) Has been cancelled
roapi release / macos (push) Has been cancelled
roapi release / windows (map[features:database-sqlite python-architecture:x64 target:x86_64-pc-windows-msvc]) (push) Has been cancelled
roapi release / linux (map[features:rustls,database-sqlite image_tag:aarch64-musl manylinux:2014 name_suffix: rustflags: target:aarch64-unknown-linux-musl upload:true]) (push) Has been cancelled
roapi release / linux (map[features:rustls,database-sqlite image_tag:x86_64-musl manylinux:2010 name_suffix: rustflags:-C target-cpu=skylake target:x86_64-unknown-linux-musl upload:true]) (push) Has been cancelled
roapi release / PyPI Release (push) Has been cancelled
roapi release / Docker Image Release (push) Has been cancelled
closes #340
2024-08-25 21:02:56 +00:00
QP Hou
08ec089a84
bump object_store and, arrow (52) and datafusion (39) (#341)
Some checks failed
build / build (push) Has been cancelled
build / database_test (push) Has been cancelled
build / object_store_memory_test (push) Has been cancelled
build / object_store_direct_test (push) Has been cancelled
build / openssl_build (push) Has been cancelled
build / mac_cross_build (push) Has been cancelled
build / Docker Image Build (push) Has been cancelled
columnq-cli release / Validate git tag (push) Has been cancelled
roapi release / Validate git tag (push) Has been cancelled
columnq-cli release / macos (push) Has been cancelled
columnq-cli release / windows (map[features:database-sqlite python-architecture:x64 target:x86_64-pc-windows-msvc]) (push) Has been cancelled
columnq-cli release / linux (map[features:rustls,database-sqlite image_tag:aarch64-musl manylinux:2014 name_suffix: rustflags: target:aarch64-unknown-linux-musl upload:true]) (push) Has been cancelled
columnq-cli release / linux (map[features:rustls,database-sqlite image_tag:x86_64-musl manylinux:2010 name_suffix: rustflags:-C target-cpu=skylake target:x86_64-unknown-linux-musl upload:true]) (push) Has been cancelled
columnq-cli release / PyPI Release (push) Has been cancelled
roapi release / macos (push) Has been cancelled
roapi release / windows (map[features:database-sqlite python-architecture:x64 target:x86_64-pc-windows-msvc]) (push) Has been cancelled
roapi release / linux (map[features:rustls,database-sqlite image_tag:aarch64-musl manylinux:2014 name_suffix: rustflags: target:aarch64-unknown-linux-musl upload:true]) (push) Has been cancelled
roapi release / linux (map[features:rustls,database-sqlite image_tag:x86_64-musl manylinux:2010 name_suffix: rustflags:-C target-cpu=skylake target:x86_64-unknown-linux-musl upload:true]) (push) Has been cancelled
roapi release / PyPI Release (push) Has been cancelled
roapi release / Docker Image Release (push) Has been cancelled
close https://github.com/roapi/roapi/issues/337
2024-08-04 20:18:35 -07:00
QP Hou
7f0d4bf941
build with stable rust toolchain (#335) 2024-05-27 00:12:55 -07:00
QP Hou
3bfcb29bcd
bump datafusion to 37 and arrow to 51 (#334)
closes #324 #325
2024-05-26 23:32:56 -07:00
QP Hou
9eba0281c6
support http for delta tables (#333) 2024-05-26 00:33:01 -07:00
QP Hou
a46351c4d4
bump snmalloc to 0.3 (#332) 2024-05-19 22:10:57 -07:00
QP Hou
1938fe6c2b
fix remote storage support for deltalake (#331) 2024-05-19 20:56:46 -07:00
QP Hou
8168d93859
add api to get schema by table name (#330) 2024-05-18 20:29:55 -07:00
QP Hou
5a0b68de6d
fix: exclude folder in object_store s3 list content (#329) 2024-05-05 17:26:06 -07:00
Qingping Hou
76400b1d60 bump columnq-cli version 2024-04-28 23:27:27 -07:00
Qingping Hou
40682d733a bump datafusion for partition filter fix 2024-04-28 23:09:32 -07:00
Qingping Hou
98b46f2ad5 fix build cache export 2024-04-28 16:30:42 -07:00
Qingping Hou
5ff5ef76d0 bump columnq-cli version 2024-04-28 15:49:01 -07:00
Qingping Hou
9fbbd7fd35 fix roapi release job change rule 2024-04-28 12:39:39 -07:00
QP Hou
44b7b57b2d
fix macos python wheel release job (#328) 2024-04-28 12:17:43 -07:00
QP Hou
4c4999db68
update rust toolchain github action (#327) 2024-04-28 01:03:05 -07:00
Qingping Hou
a553521d61 fix python release for real 2024-04-28 00:16:44 -07:00
Qingping Hou
be9b93c9d8 fix pypi release 2024-04-28 00:10:24 -07:00
QP Hou
ffc794c43b
support partition filter pushdown (#326) 2024-04-28 00:03:34 -07:00
QP Hou
fd022b57bb fix docker release 2024-03-24 20:29:25 -07:00
QP Hou
9ec4eb4523 columnq-cli: fix table argument parsing 2024-03-24 16:01:33 -07:00
QP Hou
199f9d8e0f
bump datafusion to 35 and arrow to 50 (#320)
also bump rustc version
2024-03-24 15:58:36 -07:00
QP Hou
c2a3268d44
add token & basic auth support for flightsql endpoint (#318)
required to enable SSL in grafana's flightsql plugin
2024-03-10 22:48:01 -07:00
Maksym Dovhal
81a25205b7
Update xlsx table (#316)
This PR is a fix for issue https://github.com/roapi/roapi/issues/259

List of updates/fixes:
* module xlsx renamed to excel.
* Allow reading not only xlsx format but also xls, ods, xlsb
* Allow Excel DateTime format and transform it to arrow
Timestamp(Seconds, None)
* Allow using NULLs in any data types and use null value instead of
string "null"
* Fix issue with incorrect data type inference when multiple data types
are detected.
* Add possibility to specify data schema in config.
* Add new options: -
rows_range_start
 - rows_range_end
 - columns_range_start
 - columns_range_end
 - schema_inference_lines
* Make sheet_name optional and if it is not specified than use first
sheet by default

* Bump calamine crate to version 0.23.1 and add feature "dates"
(supporting for DateTime column format)

Documentation updates: https://github.com/roapi/docs/pull/20
2024-01-31 20:16:34 -08:00
QP Hou
9377b7ccad
support infer schema by list of files (#310) 2023-11-19 20:14:26 -08:00
QP Hou
b2454f48e5
build docker image with cargo chef cache (#309) 2023-11-19 11:31:39 -08:00
QP Hou
a322d1b443
support defining nested enum data types in schema config (#308) 2023-11-18 19:01:53 -08:00
QP Hou
b70c3bcb0b
enable aws feature in object_store crate by default 2023-10-31 01:03:22 -07:00
QP Hou
d531f8ae46
support partitioned tables (#307) 2023-10-20 16:00:07 -07:00
QP Hou
ea01ffe0d3
upgrade clap to 4 (#304) 2023-10-14 21:09:21 -07:00
Qingping Hou
51584dd3a0 update readme 2023-10-11 00:19:45 -07:00
Qingping Hou
8df946f68a update readme 2023-10-11 00:16:39 -07:00
QP Hou
0dcb6141cb
use lockfile in docker build (#303) 2023-10-10 23:58:30 -07:00
QP Hou
ef113c5521
add flightsql support (#301) 2023-10-10 22:31:14 -07:00
QP Hou
94a206045b
make addr config optional (#302) 2023-10-10 22:31:01 -07:00
QP Hou
b10afb0116
enable resolve 2 in cargo.toml (#300) 2023-10-03 01:53:06 -07:00
QP Hou
eef379f9bb
switch to snafu for error handling in columnq (#299) 2023-10-03 00:27:04 -07:00
QP Hou
2baf669841
update datafusion to 31 (#297) 2023-09-30 19:24:47 -07:00
Qingping Hou
32d85f4b0c disable armv7 build 2023-09-16 12:36:18 -07:00
Qingping Hou
5d1559e08c avoid skylake target cpu flags for arm builds 2023-09-16 12:36:18 -07:00
Joe
ffd1ca6dda
remove unwrap (#294) 2023-09-11 22:42:50 -07:00
Joe
5348f68d6e
refactor read table from db code (#293) 2023-09-10 23:42:28 -07:00
Joe
ff3617767d
feat: support postgresql (#286) 2023-08-29 09:06:11 -07:00
QP Hou
b8b772a018
[ci] fix gcs ci setup (#291) 2023-08-27 10:58:27 -07:00
Joe
500e535caa
feat: support datafusion config (#288) 2023-08-13 01:09:12 +00:00
Jean Khawand
921aef9f01
Enhance dev experience using devcontainer (#285)
feat(dev-container): introduce dev container for better developer experience
doc(dev-container): update readme for dev container setup
feat(dev-container): add dummy sql sample for testing
feat(dev-container): add devcontainer.json config

Co-authored-by: QP Hou <dave2008713@gmail.com>

---------

Co-authored-by: QP Hou <dave2008713@gmail.com>
2023-07-25 18:49:52 +00:00