Release notes
Changelog for every Xorq release - features, bug fixes, refactors, and deprecations.
0.3.7 (2026-01-08)
Features
- Add sdist.tar.gz as part of build artifacts (#1477) by @hussainsultan
Refactors
Deprecations
- Remove assert_not_in_nix_shell for uv_tool_run (#1494) by @hussainsultan
0.3.6 (2026-01-05)
Features
Bug Fixes
Refactors
- Use snapshot hash and node refs (#1462) by @dlovell
- Update hexdigest by @mesejo
- Dtype dedup (#1469) by @dlovell
- Init_templates.py (#1476) by @dlovell
- Arrow ipc pipe (#1479) by @dlovell
- Update dependency pytest to v9.0.2 (#1485) by @renovate
- Update actions/create-github-app-token action to v2.2.1 (#1482) by @renovate
- Update codecov/codecov-action action to v5.5.2 (#1483) by @renovate
- Update dependency pre-commit to v4.5.1 (#1484) by @renovate
- Update ruff to 0.14.10 (#1489) by @mesejo
- Use datafusion default strftime (#1472) by @mesejo
0.3.5 (2025-12-22)
Features
- Add Working with the documentation section (#1392) by @mesejo
- Added windows installation across tutorials (#1402) by @Olamideod
- Added an official style guide (#1403) by @Olamideod
- Add Vale linter configuration files (#1408) by @Olamideod
- Add temporal delta ops compiling (#1399) by @mesejo
- Added vale linter integration guide to the repo (#1410) by @Olamideod
- Add FillNull and NullIf translations (#1437) by @mesejo
- Add missing ops (#1441) by @mesejo
- Add TableUnnest op (#1436) by @mesejo
- Add ParquetSnapshotStorage (#1449) by @hussainsultan
Bug Fixes
- Asof_join with different column names (#1414) by @mesejo
- Update dependency fsspec to >=2024.6.1,<2025.10.1 (#1431) by @renovate
- Example with named memtable (#1458) by @mesejo
- Patch normalize token retain lazy (#1461) by @dlovell
- SdistBuilder: use untgzed dir as –with arg to uv (#1465) by @dlovell
- Update caching examples (#1463) by @mesejo
Refactors
- Reference the Style Guide in CONTRIBUTING.m (#1405) by @Olamideod
- Update README (#1286) by @hussainsultan
- Update dependency blackdoc to v0.4.6 (#1421) by @renovate
- Update dependency ruff to v0.14.7 (#1422) by @renovate
- Update pre-commit hook astral-sh/ruff-pre-commit to v0.14.7 (#1423) by @renovate
- Update pre-commit hook astral-sh/uv-pre-commit to v0.9.13 (#1424) by @renovate
- Update actions/create-github-app-token action to v2.2.0 (#1425) by @renovate
- Update dependency black to v25.11.0 (#1426) by @renovate
- Update dependency coverage to v7.12.0 (#1427) by @renovate
- Update dependency ipython to <9.8.0,>=8.19.0 (#1428) by @renovate
- Update dependency pre-commit to v4.5.0 (#1429) by @renovate
- Update actions/checkout action to v6 (#1432) by @renovate
- Apply sentence case per style guide (#1420) by @Olamideod
- Update postgres docker tag to v17.7 (#1430) by @renovate
- Update astral-sh/setup-uv action to v7 (#1433) by @renovate
- Update dependency ipykernel to v7 (#1434) by @renovate
- Update dependency pytest to v9 (#1435) by @renovate
- Make walk nodes deterministic (#1453) by @mesejo
- Parquet ttl cache (#1455) by @dlovell
- Simplify translate (#1457) by @mesejo
- Translation context methods (#1460) by @dlovell
- Rename let to xorq (#1450) by @mesejo
- Update hexdigest snapshot (#1466) by @mesejo
Deprecations
- Remove unused ls command (#1394) by @mesejo
0.3.4 (2025-11-19)
Features
Bug Fixes
- Fix FrozenDict replacement (#1385) by @mesejo
Refactors
Deprecations
- Remove requirements-dev.txt (#1387) by @mesejo
0.3.3 (2025-11-11)
Features
Refactors
- Enable lock file maintenance in renovatebot (#1370) by @mesejo
- Update pre-commit hook astral-sh/uv-pre-commit to v0.9.7 (#1367) by @renovate
- Update pre-commit hook astral-sh/ruff-pre-commit to v0.14.3 (#1366) by @renovate
- Update postgres docker tag to v17.6 (#1365) by @renovate
- Disable setup-python dependency updates (#1371) by @mesejo
- Update dependency trino to v0.336.0 (#1364) by @renovate
- Update dependencies pytest-codspeed, coverage, blackdoc (#1361) by @renovate
- Update dependency ruff to v0.14.3 (#1363) by @renovate
- Move expr_to_unbound (#1357) by @mesejo
0.3.2 (2025-11-03)
Features
- Add Multiply and Hash ops (#1183) by @mesejo
- Add
storagearg toPipeline.fit(#1257) by @dlovell - Add better error message for ValueError (#1263) by @mesejo
- Add reduction ops (#1265) by @mesejo
- Add xorq-psql (#1270) by @dlovell
- Add valid default xorq.expr.udf.agg.pandas_df name (#1278) by @mesejo
- Add sklearn_classifier_comparison (#1273) by @dlovell
- Add sqlite backend (#1244) by @mesejo
- Add pandas tests (#1295) by @mesejo
- Add tagging for ml ops (#1297) by @mesejo
- Add keypair auth (#1334) by @dlovell
- Add benchmark for import (#1342) by @mesejo
- Add sops (#1337) by @dlovell
- Add default database/schema from env vars (#1353) by @dlovell
- Add from_ibis function (#1354) by @mesejo
Bug Fixes
- Timeout peek port (#1255) by @dlovell
- Skip re.search on Path object in _maybe_glob_pattern (#1261) by @mesejo
- Uncached fittedstep model (#1260) by @dlovell
- Use pytest importorskip to sklearn test (#1262) by @mesejo
- _ParquetStorage._put: write to a tmp location (#1268) by @dlovell
- _transform_deferred_reads: squelch warning re Path (#1275) by @dlovell
- Faster do_explode_encode (#1269) by @dlovell
- Pipeline infer features (#1274) by @dlovell
- Not execute doc code (#1281) by @mesejo
- Enable count (#1290) by @dlovell
- Train test splits pandas (#1291) by @dlovell
- Custom_hash for nameless Series (#1289) by @mesejo
- Distinct: register from_yaml loader (#1303) by @dlovell
- Fixup template tests (#1311) by @dlovell
- Fixup pipeline tagging tests (#1312) by @dlovell
- Default env var reference (#1310) by @dlovell
- Mermaid diagrams in vignettes (#1327) by @mesejo
- Residual fixups for psycopg update (#1333) by @dlovell
- Parse multiline env vars (#1331) by @dlovell
- Fix
UnboundLocalErroron connect (#1341) by @dlovell - Snowflake GitHub Action (#1344) by @mesejo
- Create table from expr (#1347) by @dlovell
- Default create_object_udfs to False (#1352) by @dlovell
Refactors
- Test weather_lib example (#1254) by @mesejo
- Easily uncache (#1256) by @dlovell
- Improve no-extra runner (#1231) by @mesejo
- Add translation for First and Any ops (#1264) by @mesejo
- Better metadata (#1271) by @dlovell
- Split slow test workflow (#1272) by @mesejo
- Train test split default (#1196) by @dlovell
- Update readme with bottoms-up messaging (#1280) by @hussainsultan
- Update xorq_datafusion version (#1284) by @mesejo
- Move tests to the dedicated package (#1293) by @mesejo
- Move pandas backend out of vendored ibis (#1296) by @mesejo
- Allow for specifying compiler in to_sql (#1283) by @mesejo
- Improve testing (#1287) by @mesejo
- Update quickstart.qmd (#1299) by @mesejo
- Update quarto version (#1315) by @mesejo
- Chore: use Cloudfare CDN polyfill version (#1314) by @mesejo
- Change Bitnami Catalog (docker images) (#1316) by @mesejo
- Update pre-commit hook astral-sh/uv-pre-commit to v0.8.22 (#1320) by @renovate
- Update dependency blackdoc to v0.4.3 (#1317) by @renovate
- Update dependency coverage to v7.10.7 (#1318) by @renovate
- Update dependency pytest to v8.4.2 (#1319) by @renovate
- Update actions/create-github-app-token action to v2.1.4 (#1321) by @renovate
- Update codecov/codecov-action action to v5.5.1 (#1322) by @renovate
- Update dependency black to v25.9.0 (#1323) by @renovate
- Update dependency ipython to <9.7.0,>=8.19.0 (#1324) by @renovate
- Update dependency pre-commit to v4.3.0 (#1325) by @renovate
- Update dependency pytest-cov to v6.3.0 (#1326) by @renovate
- Make CachedNode inherit DatabaseTable (#1307) by @mesejo
- Ensure expr is indeed an ibis Expr (#1328) by @mesejo
- Update postgres Backend to latest ibis code (#1329) by @mesejo
- Make Read inherit from DatabaseTable (#1309) by @mesejo
- Add ValueError messages (#1330) by @ryanping
- Use evolve instead of defining clone (#1335) by @mesejo
- Update snowflake Backend code (#1343) by @mesejo
- Create common ancestor for custom ops (#1338) by @mesejo
- Apply security updates described by dependabot (#1356) by @mesejo
- RemoteTable registration (#1355) by @mesejo
Deprecations
0.3.1 (2025-08-30)
Features
- Add xorq app (#1163) by @hussainsultan
- Add CLI section in 10_minutes (#1158) by @mesejo
- Add Tag(Node) class, Expr.tag method (#1205) by @dlovell
- Add limit option to run (#1203) by @hussainsultan
- Support group by alias in aggregate (#1224) by @hussainsultan
- Add runner per backend (#1210) by @mesejo
- LETSQLAccessor: add property
tokenized(#1238) by @dlovell - Add listing and fetching of UnboundExprExchanger (#1207) by @mesejo
- Add catalog (#1249) by @dlovell
Bug Fixes
- Update dependency datafusion to v48 (#1174) by @renovate
- Update dependency fsspec to >=2024.6.1,<2025.7.1 (#1172) by @renovate
- Update dependency pyarrow to v21 (#1175) by @renovate
- Ensure preserve_index=False in RecordBatch.from_pandas (#1160) by @mesejo
- Xorq serve inference (#1176) by @dlovell
- Fix riscv issuee in nix run (#1185) by @hussainsultan
- Fix pyarrow 21.0.0 build on darwin (#1192) by @hussainsultan
- Read_record_batches schema mismatch (#1190) by @mesejo
- Pointing to main of xorq-weather-lib (#1188) by @mesejo
- Register with table_name default value (#1182) by @mesejo
- Update flake inputs (#1191) by @dlovell
- .sql on deferred_read_* nodes (#1184) by @mesejo
- Rename serve cmd (#1200) by @hussainsultan
- Better serve-unbound con detection (#1212) by @dlovell
- Wrong arg limit in serve_unbound_parser (#1226) by @mesejo
- Use item accessor (square brackets) for tag column (#1227) by @mesejo
- Fix readme broken links (#1234) by @hussainsultan
- SourceStorage._put: don’t pull local (#1235) by @dlovell
- Update reference (#1243) by @mesejo
- Allow None for the con in deferred_read_parquet by @mesejo
- Fix CLI command docs reference (#1250) by @mesejo
- Replace computed kwargs expr (#1247) by @dlovell
Refactors
- Make xorq cli app to use all deps (#1164) by @hussainsultan
- Update pre-commit hook astral-sh/ruff-pre-commit to v0.12.7 (#1168) by @renovate
- Update dependency ruff to v0.12.7 (#1167) by @renovate
- Update pre-commit hook astral-sh/uv-pre-commit to v0.8.4 (#1171) by @renovate
- Update bitnami/minio docker tag to v2025.7.23 (#1169) by @renovate
- Properly configure pin setup-python (#1177) by @mesejo
- Update dependency coverage to v7.10.2 (#1170) by @renovate
- Update dependency pytest-codspeed to v4 (#1173) by @renovate
- Make deferred read and sql outputs optional in BuildManager (#1199) by @hussainsultan
- Improve speed of ibis_yaml package (#1202) by @mesejo
- Move into_backend tests to test_into_backend.py (#1178) by @mesejo
- Bank marketing uses pipeline lib (#1204) by @dlovell
- Use local files for reducing execution time (#1206) by @mesejo
- Delay sklearn import (#1215) by @dlovell
- Delay pandas import (#1219) by @dlovell
- Use peek_port in test_serve_command (#1221) by @mesejo
- Reduce combinations and outdated workflows (#1230) by @mesejo
- Update penguins hexdigest (#1236) by @mesejo
- Move from xorq to xorq.api (#1222) by @mesejo
- Warn when a Read op targets a local file (#1195) by @mesejo
- Update project urls (#1248) by @mesejo
- Update CLI references with new commands (#1245) by @sanajitjana
- Disable weather_flight example temporarily (#1251) by @mesejo
- Update google-site-verification (#1253) by @mesejo
Deprecations
0.3.0 (2025-07-28)
Features
- Add expression format concept page (#1159) by @mesejo
0.2.5 (2025-07-26)
Features
Bug Fixes
- Use Path.name instead of Path.stem in run_command (#1118) by @mesejo
- Update for xorq-hash-cache rename (#1122) by @dlovell
- Fix quoting in google indexing (#1127) by @mesejo
- Use print_exc (#1125) by @dlovell
- Use port and host args in serve (#1130) by @mesejo
- Better type inference for LogisticRegression (#1136) by @dlovell
- Update for xorq-hash-cache (#1131) by @dlovell
- Port and host args handling (#1144) by @mesejo
- Use expr.ls.uncached when finding backend (#1141) by @mesejo
- Fix run commands (#1153) by @dlovell
- Deferred_read_* methods (#1155) by @mesejo
Refactors
- Test installation for multiple Python versions and OS (#1107) by @mesejo
- Uv-build (#1132) by @dlovell
- Run slow tests in a different runner (#1087) by @mesejo
- Refactor reference structure (#1129) by @mesejo
- Readme graphic (#1150) by @hussainsultan
- Move functions to translate.py (#1152) by @mesejo
- Make con optional in deferred_read (#1142) by @mesejo
- Xorq serve inference (#1143) by @dlovell
- Update quickstart tutorial to reflect CLI-centric approach (#1157) by @hussainsultan
- Update 10_minutes_xorq_tour (#1151) by @mesejo
Deprecations
- Serve_command: remove spurious kwargs (#1145) by @dlovell
0.2.4 (2025-07-09)
Features
Bug Fixes
- Override base, not just editables (#1095) by @dlovell
- Correct backend reference in README (#1097) by @IndexSeek
- Deferred_read_csv: schema: use columns not types (#1103) by @dlovell
- Fix border output color (#1104) by @mesejo
- Generic handling of cached node (#1105) by @dlovell
- Structfield (#1109) by @dlovell
- Fetch penguins (#1114) by @mesejo
Refactors
- Feature store (#1091) by @hussainsultan
- Rename weather micro-libs to xorq-prefix (#1096) by @dlovell
- Singledispatch sklearn (#1100) by @dlovell
- Use snapshot in test_build_file_stability (#1092) by @mesejo
- Improve grid listing style (#1101) by @mesejo
- Improve ml section documentation (#1099) by @mesejo
0.2.3 (2025-07-02)
Features
- Support list of paths in read_csv_rbr (#927) by @mesejo
- Add snapshot filtering (#937) by @mesejo
- Add python 3.13 to the test suite (#947) by @mesejo
- Add upsert (#938) by @mesejo
- Add xorq-cachix-{use,push} (#948) by @dlovell
- Add tls_utils (#966) by @dlovell
- Add set ops (#970) by @mesejo
- Add missing string ops translation (#969) by @mesejo
- Add .gitignore to .gitignore.template (#999) by @dlovell
- Add lineage_utils (#993) by @hussainsultan
- Add back opaque_ops (#1012) by @mesejo
- Add pipeline (#1015) by @dlovell
- Add ci-docs-preview workflow for netlify (#1030) by @mesejo
- Add YAML and build outputs in getting started (#1063) by @hussainsultan
- Add serve command (#1019) by @hussainsultan
- Add TSLKwargs to_disk and from_disk (#1077) by @mesejo
Bug Fixes
- Fix walking and checking (#914) by @dlovell
- Classproperty (#946) by @dlovell
- Update dependency fsspec to >=2024.6.1,<2025.5.1 (#954) by @renovate
- Update dependency fsspec to >=2024.6.1,<2025.5.2 (#965) by @renovate
- Update dependency datafusion to v47 (#971) by @renovate
- Ensure expr results in a non-empty result (#988) by @dlovell
- Xorqify all types (#990) by @dlovell
- Clear out registry (#1002) by @dlovell
- Enable building of DatabaseTable (#973) by @mesejo
- Use cloudpickle (#1014) by @dlovell
- Pass ibis schema instead of pyarrow (#1037) by @hussainsultan
- Store parquet files inside expr build dir (#1010) by @mesejo
- Use
large_binaryto intermediate state (#1043) by @dlovell - Build for non SQL backends (#1051) by @mesejo
- Fix links in README (#1052) by @mesejo
- Uniform caching dir (#1067) by @dlovell
- Test_default_caching_dir on windows (#1070) by @mesejo
- Update 10_minutes ParquetStorage usage (#1072) by @mesejo
- Fix theme minor issues (#1078) by @mesejo
- Build stability (#1064) by @dlovell
- Replace InMemoryTable and DatabaseTable behind opaque ops (#1080) by @mesejo
Refactors
- Update postgres docker tag to v17.5 (#924) by @renovate
- Update dependency ruff to v0.11.9 (#925) by @renovate
- Update pre-commit hook astral-sh/ruff-pre-commit to v0.11.9 (#926) by @renovate
- Update xorq-datafusion version (#929) by @mesejo
- Update dependency ruff to v0.11.10 (#940) by @renovate
- Update pre-commit hook astral-sh/ruff-pre-commit to v0.11.10 (#941) by @renovate
- Update codecov/codecov-action action to v5.4.3 (#944) by @renovate
- Update pre-commit hook astral-sh/uv-pre-commit to v0.7.4 (#945) by @renovate
- Update pre-commit hook astral-sh/uv-pre-commit to v0.7.5 (#949) by @renovate
- Update pre-commit hook astral-sh/uv-pre-commit to v0.7.6 (#952) by @renovate
- Disable cargo manager (#953) by @mesejo
- Disable dask dependency updates (#956) by @mesejo
- Update pre-commit hook astral-sh/ruff-pre-commit to v0.11.11 (#960) by @renovate
- Update pre-commit hook astral-sh/uv-pre-commit to v0.7.7 (#961) by @renovate
- Update dependency ruff to v0.11.11 (#959) by @renovate
- Update dependency coverage to v7.8.1 (#957) by @renovate
- Update pre-commit hook astral-sh/uv-pre-commit to v0.7.8 (#964) by @renovate
- Update bitnami/minio docker tag to v2025.5.24 (#967) by @renovate
- Update dependency coverage to v7.8.2 (#963) by @renovate
- Update duckdb darwin override (#968) by @hussainsultan
- Update dependency quartodoc to <0.10.1,>=0.7.2 (#972) by @renovate
- Update pre-commit hook astral-sh/ruff-pre-commit to v0.11.12 (#975) by @renovate
- Update dependency ruff to v0.11.12 (#974) by @renovate
- Update pre-commit hook astral-sh/uv-pre-commit to v0.7.9 (#977) by @renovate
- Update dependency ipython to <9.4.0,>=8.19.0 (#980) by @renovate
- Update dependency pytest to v8.4.0 (#982) by @renovate
- Update pre-commit hook astral-sh/uv-pre-commit to v0.7.10 (#984) by @renovate
- Update dependency python to v3.13.4 (#986) by @renovate
- Make normalize_filenames accepts glob pattern (#934) by @mesejo
- Versioned pins (#991) by @dlovell
- Update pre-commit hook astral-sh/uv-pre-commit to v0.7.11 (#989) by @renovate
- No .gitignore in version control (#994) by @dlovell
- Update pre-commit hook astral-sh/uv-pre-commit to v0.7.12 (#998) by @renovate
- Update trinodb/trino docker tag to v476 (#997) by @renovate
- Update pre-commit hook astral-sh/ruff-pre-commit to v0.11.13 (#996) by @renovate
- Update dependency ruff to v0.11.13 (#995) by @renovate
- Update dependency quartodoc to <0.11.1,>=0.7.2 (#1003) by @renovate
- Update dependency blackdoc to v0.3.10 (#1004) by @renovate
- Update dependency quartodoc to <0.11.2,>=0.7.2 (#1006) by @renovate
- Update dependency coverage to v7.9.0 (#1007) by @renovate
- Update dependency pytest-cov to v6.2.0 (#1008) by @renovate
- Make FlightUDXF use mtls by default (#1000) by @mesejo
- Make udwf buildable (#1005) by @mesejo
- Update dependency pytest-cov to v6.2.1 (#1009) by @renovate
- Update pre-commit hook astral-sh/uv-pre-commit to v0.7.13 (#1011) by @renovate
- Update dependency coverage to v7.9.1 (#1017) by @renovate
- Update dependency blackdoc to v0.4.0 (#1018) by @renovate
- Flight backend create (#1021) by @hussainsultan
- Update actions/create-github-app-token action to v1.12.0 (#1031) by @renovate
- Update astral-sh/setup-uv action to v6 (#1033) by @renovate
- Update pre-commit hook astral-sh/ruff-pre-commit to v0.12.0 (#1024) by @renovate
- Update dependency trino to v0.335.0 (#1023) by @renovate
- Update actions/create-github-app-token action to v2 (#1032) by @renovate
- Update extractions/setup-just action to v3 (#1034) by @renovate
- Update dependency ruff to v0.12.0 (#1022) by @renovate
- Update dependency pytest to v8.4.1 (#1029) by @renovate
- Set environment variables in ci-docs-preview workflow (#1042) by @mesejo
- Update pre-commit hook astral-sh/uv-pre-commit to v0.7.14 (#1044) by @renovate
- Clean commands (#1039) by @dlovell
- Revert mintlify and migrate to netlify (#1013) by @mesejo
- Readme rewrite (#1045) by @hussainsultan
- Update astral-sh/setup-uv action to v6 (#1046) by @renovate
- Update extractions/setup-just action to v3 (#1047) by @renovate
- Update pre-commit hook astral-sh/uv-pre-commit to v0.7.15 (#1050) by @renovate
- Update with penguins🐧 (#1055) by @hussainsultan
- Improve wording in README (#1057) by @hussainsultan
- Update pre-commit hook astral-sh/ruff-pre-commit to v0.12.1 (#1060) by @renovate
- Update pre-commit hook astral-sh/uv-pre-commit to v0.7.17 (#1062) by @renovate
- Update xorq-datafusion version to 0.2.3 (#1073) by @mesejo
- Update dependency blackdoc to v0.4.1 (#1058) by @renovate
- Update dependency blackdoc to v0.4.1 (#1076) by @renovate
- Update dependency ruff to v0.12.1 (#1059) by @renovate
- Update dependency ipython to <9.5.0,>=8.19.0 (#1079) by @renovate
- Update pre-commit hook astral-sh/uv-pre-commit to v0.7.18 (#1084) by @renovate
- Configure monthly PR creation (#1085) by @mesejo
- Make pyiceberg an optional (#1035) by @dlovell
Deprecations
0.2.2 (2025-05-08)
Features
Bug Fixes
- DevShells.impure: don’t require commands to build (#861) by @dlovell
- Register translation for PosixPath (#888) by @mesejo
- Update dependency pyarrow to v20 (#895) by @renovate
- Change _translate_type to translate yaml (#897) by @mesejo
- Ensure inclusion of env_templates (#906) by @dlovell
- Flight server issues (#922) by @mesejo
Refactors
- Update dependency ruff to v0.11.7 (#883) by @renovate
- Update pre-commit hook astral-sh/ruff-pre-commit to v0.11.7 (#884) by @renovate
- Update astral-sh/setup-uv action to v6 (#880) by @renovate
- Test library as an installed wheel (#885) by @mesejo
- Update dependency ipython to <9.3.0,>=8.19.0 (#889) by @renovate
- Update pre-commit hook astral-sh/uv-pre-commit to v0.6.17 (#891) by @renovate
- Ensure requests is installed for examples (#890) by @mesejo
- Run tests mark with s3 in workflow (#900) by @mesejo
- Ensure dependencies are resolved against PyPI index (#901) by @mesejo
- Update pre-commit hook astral-sh/uv-pre-commit to v0.7.0 (#902) by @renovate
- Update pre-commit hook astral-sh/uv-pre-commit to v0.7.2 (#903) by @renovate
- Update pre-commit hook astral-sh/ruff-pre-commit to v0.11.8 (#905) by @renovate
- Trace utils (#874) by @dlovell
- Darwin override for grpcio (#881) by @hussainsultan
- Update dependency ruff to v0.11.8 (#904) by @renovate
- Update dependency trino to v0.334.0 (#908) by @renovate
- Migrate to xorq-datafusion (#792) by @mesejo
- Update astral-sh/setup-uv action to v6 (#911) by @renovate
- Hook up kwargs in client.upload_data (#917) by @hussainsultan
- Update pre-commit hook astral-sh/uv-pre-commit to v0.7.3 (#921) by @renovate
Deprecations
0.2.1 (2025-04-25)
Features
- Add mcp server example (#731) by @hussainsultan
- Add files for pure-pypi uv env (#742) by @dlovell
- Add workflow for checking PR titles (#716) by @mesejo
- Add default value to expr_name (#748) by @dlovell
- Add top level –pdb and drop into post mortem on failure (#753) by @dlovell
- Additional checks (#810) by @dlovell
- Add test for query schema action (#822) by @hussainsultan
- Add normalization GCS path (#829) by @mesejo
- Add GCStorage (#838) by @dlovell
- Add virtualenv-default (#841) by @dlovell
- Add read_record_batches to Snowflake Backend (#834) by @mesejo
- Add env_utils, EnvConfigable (#843) by @dlovell
- Add env vars to reduce uv actions (#844) by @dlovell
- Add otel instrumentation (#845) by @dlovell
- Add get_object_metadata to SessionContext (#865) by @mesejo
- Add normalization for s3 and gcs objects (#871) by @mesejo
Bug Fixes
- Specify the correct type when raising on incorrect type (#747) by @dlovell
- Require explicit variable for tests (#749) by @dlovell
- Read_csv_rbr: ensure Schema (#751) by @dlovell
- Update dependency fsspec to >=2024.6.1,<2025.3.2 (#768) by @renovate
- Test cli on select examples (#763) by @dlovell
- Dont raise blocking raise (#765) by @dlovell
- Read with schema (#766) by @dlovell
- Fix Mod deserialization (#778) by @dlovell
- Update dependency fsspec to >=2024.6.1,<2025.3.3 (#780) by @renovate
- Read: capture read_kwargs (#777) by @dlovell
- Typo in modification time caching strategy (#803) by @hussainsultan
- Enable
CachedNode(#806) by @dlovell - Sundry fixes (#819) by @dlovell
- Update rust crate tokio to v1.44.2 [security] (#823) by @renovate
- Prevent optional dependency leakage (#840) by @dlovell
- Subprocess not monkeypatch (#849) by @dlovell
- Enable main
curry/functools.lru_cache(#856) by @dlovell - Clean up api (#862) by @dlovell
- Read_csv from s3 URL (#852) by @mesejo
- Update otel_utils to last EnvConfigable version (#870) by @mesejo
- Skip setting env variables in profiles.py example (#875) by @mesejo
- Use env var contextmanager whenever get_con is invoked (#879) by @dlovell
- Include env_templates files in wheel (#882) by @mesejo
Refactors
- Update README with xorq info (#741) by @mesejo
- Make github-actions dependencies pin (#744) by @mesejo
- Update dependency node to v22 (#743) by @renovate
- Pin dependencies (#745) by @renovate
- Enable writing to stdout (#757) by @dlovell
- Update to datafusion 46 (#724) by @mesejo
- Define fixture fixture_dir (#761) by @dlovell
- Enable renovatebot for pre-commit dependencies (#770) by @mesejo
- Make git diff message explicit and descriptive (#774) by @mesejo
- Update pre-commit hook astral-sh/uv-pre-commit to v0.6.11 (#773) by @renovate
- Upgrade requirements-dev.txt to uv 0.6.11 format (#775) by @mesejo
- Update pre-commit hook codespell-project/codespell to v2.4.1 (#771) by @renovate
- Update pre-commit hook astral-sh/ruff-pre-commit to v0.11.2 (#772) by @renovate
- Enable xorq buildable (#764) by @dlovell
- Update dependency coverage to v7.8.0 (#769) by @renovate
- Centralised postgres connection fixture (#776) by @mesejo
- Register Alias in ibis_yaml translate (#783) by @dlovell
- Register Round (#790) by @dlovell
- Update dependency pytest-cov to v6.1.0 (#791) by @renovate
- Update pre-commit hook astral-sh/uv-pre-commit to v0.6.12 (#796) by @renovate
- Enable memtable (#784) by @dlovell
- Update pre-commit hook astral-sh/ruff-pre-commit to v0.11.4 (#800) by @renovate
- Update bitnami/minio docker tag to v2025.4.3 (#801) by @renovate
- Update dependency ruff to v0.11.4 (#799) by @renovate
- Enable memtable test (#804) by @mesejo
- Enable
AggUDF(#807) by @dlovell - Update dependency pytest-cov to v6.1.1 (#808) by @renovate
- Factor out helpers (#811) by @dlovell
- Make PR description compact (#814) by @mesejo
- Update codecov badge in README (#825) by @mesejo
- Rationalize helpers (#818) by @dlovell
- Update pre-commit hook astral-sh/uv-pre-commit to v0.6.13 (#821) by @renovate
- Update dependency ipython to <9.2.0,>=8.19.0 (#815) by @renovate
- Enable exprscalarudf (#813) by @dlovell
- Update pre-commit hook astral-sh/uv-pre-commit to v0.6.14 (#831) by @renovate
- Update bitnami/minio docker tag to v2025.4.8 (#827) by @renovate
- Update dependency ruff to v0.11.5 (#832) by @renovate
- Update pre-commit hook astral-sh/ruff-pre-commit to v0.11.5 (#833) by @renovate
- Use gcs built in uri ctor (#839) by @dlovell
- Update google-github-actions/auth action to v2 (#835) by @renovate
- Update pre-commit hook astral-sh/ruff-pre-commit to v0.11.6 (#847) by @renovate
- Update dependency ruff to v0.11.6 (#846) by @renovate
- Update dependency ruff to v0.11.6 (#848) by @renovate
- Update codecov/codecov-action action to v5.4.2 (#842) by @renovate
- Gcstorage improvement (#863) by @dlovell
- Update pre-commit hook astral-sh/uv-pre-commit to v0.6.16 (#864) by @renovate
- Update bitnami/minio docker tag to v2025.4.22 (#869) by @renovate
- Avoid double rust compilation and use cargo cache (#873) by @mesejo
- Update trinodb/trino docker tag to v475 (#876) by @renovate
- Use python 3.10 (#877) by @mesejo
Deprecations
0.2.0 (2025-03-27)
Features
- Add ExprScalarUDF to walk_nodes (#693) by @dlovell
- Add hn part4 (#713) by @hussainsultan
- Add multi-duck vignette (#719) by @hussainsultan
- Add import_from_gist (#733) by @dlovell
- Add uv section (#730) by @mesejo
- Add type annotations to deferred_read_csv and deferred_read_parquet-star01 (#738) by @soheil
Bug Fixes
Refactors
Deprecations
0.1.17 (2025-03-24)
Features
- Add quickstart (#654) by @hussainsultan
- Add helpers to identify normalization issues (#669) by @dlovell
- Add exchangers to FlightServer constructor (#671) by @dlovell
- Add hn quickstart example (#675) by @hussainsultan
- Add part 1 of hn data tutorial (#661) by @hussainsultan
- Add hn data tutorial part 2 (#663) by @hussainsultan
- ToolsPackages: add gh (#673) by @dlovell
- Add ListActionsAction (#706) by @dlovell
Bug Fixes
- Update rust crate async-trait to v0.1.88 (#656) by @renovate
- Invoke inspect when explicitly requested in normalize_seq_with_caller (#668) by @dlovell
- Warning for not using raw string in regex (#676) by @ghoersti
- Update flake inputs to build with rust 1.85.0 (#690) by @dlovell
- Avoid duplicated execution of expr by removing read_all (#677) by @mesejo
- Update rust crate arrow to v54.3.0 (#700) by @renovate
- Make action_body a dict (#692) by @mesejo
Refactors
- Update dependency ruff to v0.10.0 (#653) by @renovate
- Update extractions/setup-just action to v3 (#658) by @renovate
- Update dependency ruff to v0.11.0 (#657) by @renovate
- Update CONTRIBUTING.md (#664) by @dlovell
- Mark snapshot tests (#665) by @dlovell
- Update dependency coverage to v7.7.0 (#666) by @renovate
- Update readme to use similar language as docs (#674) by @hussainsultan
- Update dependency pre-commit to v4.2.0 (#681) by @renovate
- Update trinodb/trino docker tag to v473 (#685) by @renovate
- Update to datafusion 45 (#672) by @mesejo
- Change url in test_read_csv_from_url (#688) by @mesejo
- Move tests to xorq/tests (#689) by @mesejo
- Improve core concepts (#686) by @hussainsultan
- Update dependency ruff to v0.11.1 (#691) by @renovate
- Update dependency ruff to v0.11.2 (#698) by @renovate
- Convert expr to table (#695) by @mesejo
- Update trinodb/trino docker tag to v474 (#702) by @renovate
- Update dependency coverage to v7.7.1 (#697) by @renovate
- Hotfix darwin build for 3.10,3.11 (#704) by @dlovell
0.1.16 (2025-03-13)
Features
- Add tutorials intro section (#634) by @mesejo
Bug Fixes
Refactors
0.1.15 (2025-03-11)
Features
- FlightServer: add con and client as properties (#568) by @dlovell
- Add xorq build cli command (#567) by @mesejo
- Add importing of notebooks (#577) by @mesejo
- Add deferred_fit_predict (#595) by @dlovell
- Add overview image (#605) by @hussainsultan
- Add to_json/to_csv (#604) by @mesejo
- Add run cli command (#581) by @mesejo
- Add examples tab (#608) by @mesejo
- Add run section of build and run tutorial (#637) by @mesejo
Bug Fixes
- Update dependency datafusion to v45 (#563) by @renovate
- Update rust crate async-trait to v0.1.87 (#594) by @renovate
- Dedupe yaml serialization (#589) by @hussainsultan
- Default to dynamic FlightUrl port (#603) by @dlovell
- Default_backend should xorq (#609) by @mesejo
- Flight caching (#610) by @dlovell
- Mark remote tables so clean up won’t interfere with others (#613) by @dlovell
- Update dependency fsspec to >=2024.6.1,<2025.3.1 (#618) by @renovate
- Update rust crate tokio to v1.44.0 (#621) by @renovate
- Update rust crate arrow-ord to v53.4.1 (#620) by @renovate
Refactors
- Update dependency ruff to v0.9.7 (#558) by @renovate
- Consolidate YAML/SQL serialization (#525) by @hussainsultan
- Move custom types to source file (#566) by @mesejo
- Extract postgres extra (#571) by @mesejo
- Update codecov/codecov-action action to v5.4.0 (#574) by @renovate
- Update cli docstring (#575) by @mesejo
- Migrate docs to mintlify (#541) by @mesejo
- Update readme (#580) by @hussainsultan
- Change api (#582) by @dlovell
- Update dependency ruff to v0.9.8 (#583) by @renovate
- Replace pydantic AnyURL with attrs (#573) by @mesejo
- Update dependency ruff to v0.9.9 (#585) by @renovate
- Update dependency ipython to v9 (#586) by @renovate
- Update bitnami/minio docker tag to v2025.2.28 (#587) by @renovate
- Default pdb to ipython TerminalPdb (#590) by @dlovell
- Update dependency pytest to v8.3.5 (#591) by @renovate
- Create cache module (#579) by @mesejo
- Update rust toolchain version (#597) by @mesejo
- Profile docs& guide (#602) by @ghoersti
- Update overview page with benefits and painpoints (#607) by @hussainsultan
- Update for ParquetCacheStorage -> ParquetStorage change (#606) by @dlovell
- Use connect_env (#611) by @mesejo
- Update overview page (#615) by @hussainsultan
- Repr of opaque nodes (#596) by @mesejo
- Refactor FlightServer code (#616) by @mesejo
- Update dependency ruff to v0.9.10 (#617) by @renovate
- Update trinodb/trino docker tag to v472 (#622) by @renovate
- Bump ring from 0.17.8 to 0.17.13 (#626) by @dependabot
- Expose datatypes as part of xorq (#578) by @mesejo
- Enable serde for connections (#630) by @dlovell
Deprecations
0.1.14 (2025-02-20)
Features
Bug Fixes
Refactors
- Refactor out hotfixing snowflake (#509) by @mesejo
- Update trinodb/trino docker tag to v470 (#512) by @renovate
- Update dependency ruff to v0.9.5 (#514) by @renovate
- Update bitnami/minio docker tag to v2025.2.7 (#526) by @renovate
- Update dependency coverage to v7.6.11 (#527) by @renovate
- Use get_print_logger instead of print (#533) by @dlovell
- Update dependency coverage to v7.6.12 (#530) by @renovate
- Update postgres docker tag to v17.3 (#535) by @renovate
- Register ibis datatypes, raise if not registered (#538) by @mesejo
- Transform datetime to bytes (#540) by @mesejo
- Vendor ibis (#529) by @mesejo
- Update actions/create-github-app-token action to v1.11.5 (#539) by @renovate
- Update dependency ruff to v0.9.6 (#528) by @renovate
- Wrap pins with examples (#511) by @mesejo
- Enable kwargless use of default name (#545) by @dlovell
- Clean vendoring (#546) by @mesejo
- Update bitnami/minio docker tag to v2025.2.18 (#554) by @renovate
- Update trinodb/trino docker tag to v471 (#555) by @renovate
- Rename to xorq (#550) by @mesejo
Deprecations
0.1.13 (2025-02-05)
Features
Bug Fixes
Refactors
- Enable caching bigquery exprs (#486) by @dlovell
- Snowflake-connector-python security update (#489) by @mesejo
- Update actions/create-github-app-token action to v1.11.2 (#492) by @renovate
- Update dependency ruff to v0.9.4 (#493) by @renovate
- Enable running entirely from pypi by @dlovell
- Invoke nix fmt by @dlovell
- Update dependency trino to v0.333.0 (#502) by @renovate
- Update actions/create-github-app-token action to v1.11.3 (#505) by @renovate
- Update bitnami/minio docker tag to v2025.2.3 (#507) by @renovate
Deprecations
0.1.12 (2025-01-29)
Features
- Add segmentation (#389) by @mesejo
- Add caching for to_sql (#404) by @mesejo
- Add hash(string) function (#451) by @mesejo
- Add get_plans (#447) by @dlovell
- Add quickgrove udf (#475) by @hussainsultan
- Add LargeUtf8 as a DataType (#462) by @mesejo
- Add requirement for letsql-pytest by @dlovell
- Add stand alone uv + rust shell (#482) by @dlovell
Bug Fixes
- Update rust crate object_store to v0.11.2 (#422) by @renovate
- Update rust crate async-trait to v0.1.84 (#425) by @renovate
- Update dependency dask to v2024.12.1 (#418) by @renovate
- Update dependency fsspec to >=2024.6.1,<2024.12.1 (#419) by @renovate
- Update rust crate async-trait to v0.1.85 (#432) by @renovate
- Update rust crate tokio to v1.43.0 (#438) by @renovate
- Invoke maturin on changes to rust (#445) by @dlovell
- Identify correct kwarg for duckdb (#452) by @dlovell
- Update dependency pyarrow to v19 (#454) by @renovate
- Update dependency structlog to v25 (#455) by @renovate
- Update dependency dask to v2025 (#458) by @renovate
- Failing docs deployment (#465) by @mesejo
- Fix dependency groups (#448) by @mesejo
- Get_storage_uncached args (#466) by @mesejo
- Update dependency attrs to v25 (#473) by @renovate
- Ensure dependencies are in sync (#480) by @mesejo
- Update for changes to uv/uv2nix by @dlovell
Refactors
- Update trinodb/trino docker tag to v468 (#421) by @renovate
- Update astral-sh/setup-uv action to v5 (#420) by @renovate
- Update actions/create-github-app-token action to v1.11.1 (#414) by @renovate
- Update bitnami/minio docker tag to v2024.12.18 (#415) by @renovate
- Update codecov/codecov-action action to v5.1.2 (#416) by @renovate
- Update dependency ruff to v0.8.6 (#417) by @renovate
- Update to datafusion v44 (#435) by @mesejo
- Update dependency coverage to v7.6.10 (#424) by @renovate
- Uv lock –upgrade-package jinja2 (#436) by @mesejo
- Update contributing workflow (#437) by @mesejo
- Update dependency ruff to v0.9.0 (#439) by @renovate
- Expose full SessionConfig (#440) by @mesejo
- Update dependency ruff to v0.9.1 (#441) by @renovate
- Update dependency trino to v0.332.0 (#449) by @renovate
- Update dependency ruff to v0.9.2 (#453) by @renovate
- Update dependency pre-commit to v4.1.0 (#463) by @renovate
- Update dependency codespell to v2.4.0 (#468) by @renovate
- Update codecov/codecov-action action to v5.2.0 (#469) by @renovate
- Update dependency ruff to v0.9.3 (#471) by @renovate
- Update codecov/codecov-action action to v5.3.1 (#472) by @renovate
- Enforce import order (#476) by @mesejo
- Update trinodb/trino docker tag to v469 (#478) by @renovate
- Update dependency codespell to v2.4.1 (#481) by @renovate
- Update dependency black to v25 (#483) by @renovate
- Update bitnami/minio docker tag to v2025 (#484) by @renovate
- Extend ruff select rules instead of overriding (#485) by @mesejo
Deprecations
0.1.11 (2024-12-17)
Features
Bug Fixes
- Update rust crate datafusion to v43 (#340) by @renovate
- Update dependency ibis-framework to v9.5.0 (#324) by @renovate
- Pin dependencies (#359) by @renovate
- Update rust crate object_store to v0.11.1 (#360) by @renovate
- Update aws-sdk-rust monorepo to v0.101.0 (#361) by @renovate
- Update rust crate arrow-ord to v53.3.0 (#368) by @renovate
- Update rust crate arrow to v53.3.0 (#367) by @renovate
- Fix performance regression by only parsing metadata once (#373) by @dlovell
- Update rust crate url to v2.5.4 (#376) by @renovate
- Update rust crate tokio to v1.42.0 (#386) by @renovate
- Update dependency dask to v2024.12.0 (#387) by @renovate
- Dynamically generate
none_tokenized(#396) by @dlovell - Update rust crate prost to v0.13.4 (#393) by @renovate
- To_pyarrow_batches (#398) by @mesejo
- Update dependency datafusion to v43 (#408) by @renovate
Refactors
- Update dependency ruff to v0.7.4 (#353) by @renovate
- Update codecov/codecov-action action to v5.0.2 (#355) by @renovate
- Update dependency coverage to v7.6.7 (#357) by @renovate
- Pin cargo dependencies version (#358) by @mesejo
- Update codecov/codecov-action action to v5.0.4 (#363) by @renovate
- Update codecov/codecov-action action to v5.0.7 (#365) by @renovate
- Update trinodb/trino docker tag to v465 (#369) by @renovate
- Update dependency ruff to v0.8.0 (#371) by @renovate
- Udf.agg.pandas_df: enableuse as a decorator (#375) by @dlovell
- Use bare datafusion (#346) by @mesejo
- Update dependency coverage to v7.6.8 (#378) by @renovate
- Update trinodb/trino docker tag to v466 (#382) by @renovate
- Update postgres docker tag to v17.2 (#377) by @renovate
- Update dependency ruff to v0.8.1 (#383) by @renovate
- Update dependency pytest to v8.3.4 (#384) by @renovate
- Move to uv (#380) by @mesejo
- Update trinodb/trino docker tag to v467 (#395) by @renovate
- Update dependency coverage to v7.6.9 (#392) by @renovate
- Update codecov/codecov-action action to v5.1.1 (#391) by @renovate
- Update astral-sh/setup-uv action to v4 (#394) by @renovate
- Update dependency ruff to v0.8.2 (#390) by @renovate
- Enable codspeed profiling (#399) by @mesejo
- Use python 3.12 in codspeed (#400) by @mesejo
- Update dependency trino to v0.331.0 (#401) by @renovate
- Enforce letsql as ls alias import (#403) by @mesejo
- Use cache for compiling rust (#406) by @mesejo
- Use maturin action with sccache (#410) by @mesejo
- Update dependency ruff to v0.8.3 (#407) by @renovate
- Update actions/cache action to v4 (#409) by @renovate
- Update bitnami/minio docker tag to v2024.12.13 (#411) by @renovate
Deprecations
- Remove xfail markers, clean warnings (#385) by @mesejo
0.1.10 (2024-11-15)
Features
Bug Fixes
Refactors
- Reparametrize caching into storage and invalidation strategy (#278) by @dlovell
- Update trinodb/trino docker tag to v464 (#326) by @renovate
- Use vars instead of secrets (#330) by @mesejo
- Update bitnami/minio docker tag to v2024.10.29 (#327) by @renovate
- Update dependency ruff to v0.7.2 (#331) by @renovate
- Use env variables in workflows (#332) by @mesejo
- Update dependency quartodoc to ^0.7.2 || ^0.9.0 (#333) by @renovate
- Update dependency ruff to v0.7.3 (#338) by @renovate
- Update bitnami/minio docker tag to v2024.11.7 (#337) by @renovate
- Udate python version in pyproject (#351) by @mesejo
- Update dependency coverage to v7.6.5 (#349) by @renovate
- Update codecov/codecov-action action to v5 (#350) by @renovate
- Update postgres docker tag to v17.1 (#352) by @renovate
0.1.9 (2024-10-30)
Bug Fixes
Refactors
- Make git indifferent to changes in use nix/flake (#305) by @dlovell
- Update dependency ruff to v0.7.1 (#311) by @renovate
- Ci check for proper package installation (#318) by @mesejo
- Check proper installation of examples extras (#320) by @mesejo
- Use letsql execute/to_pyarrow/to_pyarrow_batches (#316) by @mesejo
- Update dependency pytest-cov to v6 (#322) by @renovate
- Update trinodb/trino docker tag to v463 (#321) by @renovate
0.1.8 (2024-10-24)
Bug Fixes
- Fix pre-release workflow (#257) by @mesejo
- Update dependency fsspec to v2024.9.0 (#255) by @renovate
- Update dependency datafusion to v40 (#226) by @renovate
- Update rust crate arrow-ord to v53 (#251) by @renovate
- Enable build on macos (#260) by @dlovell
- Enable build on macos (#262) by @dlovell
- Update rust crate datafusion-common to v42 (#269) by @renovate
- Fix
nix runissues re SSL and macos temp user dirs by @dlovell - Fix
nix runissues re IPYTHONDIR (#264) by @dlovell - Docs deployment (#294) by @mesejo
Refactors
- Update dependency ruff to v0.6.4 (#258) by @renovate
- Update changelog command (#259) by @mesejo
- Update dependency ruff to v0.6.5 (#265) by @renovate
- Update actions/create-github-app-token action to v1.11.0 (#263) by @renovate
- Update dependency ruff to v0.6.8 (#273) by @renovate
- Disable test_examples temporarily (#284) by @mesejo
- Update dependency coverage to v7.6.3 (#283) by @renovate
- Update dependency ruff to v0.6.9 (#285) by @renovate
- Update dependency black to v24.10.0 (#287) by @renovate
- Update codecov/codecov-action action to v4.6.0 (#286) by @renovate
- Update to datafusion v42 (#293) by @mesejo
- Update dependency pre-commit to v4 (#291) by @renovate
- Update tests and workflows (#299) by @mesejo
- Only run ruff on repo files (#301) by @dlovell
- Set postgres env vars (#303) by @mesejo
- Update dependency ruff to v0.7.0 (#302) by @renovate
Deprecations
0.1.7 (2024-09-05)
Bug Fixes
Refactors
- Update dependency ruff to v0.6.3 (#242) by @renovate
- Refactor and clean segment anything function (#243) by @mesejo
- Reading from csv in HTTP, add basic s3 support (#230) by @mesejo
- Change output of segment_anything to mask and iou_score (#244) by @mesejo
- Bump quinn-proto from 0.11.6 to 0.11.8 (#249) by @dependabot
- Update actions/create-github-app-token action to v1.10.4 (#253) by @renovate
- Bump cryptography from 43.0.0 to 43.0.1 (#254) by @dependabot
0.1.6 (2024-08-29)
Features
Bug Fixes
Refactors
- Update dependency ruff to v0.6.2 (#229) by @renovate
0.1.5 (2024-08-21)
Features
- Add pyarrow udaf based on PyAggregator (#108) by @mesejo
- Add unit tests based on workflow diagram (#110) by @mesejo
- Add postgres read_parquet (#118) by @mesejo
- Add wrapper for snowflake backend (#119) by @mesejo
- Add read_sqlite and read_postgres (#120) by @mesejo
- Add ibis udf and model registration method (#182) by @hussainsultan
- Add udf signature and return a partial with model_name (#195) by @hussainsultan
- Add image and array manipulation functions (#181) by @mesejo
- Add example predict_xgb.py (#213) by @dlovell
- Add connectors for using environment variables or fixed examples server (#217) by @dlovell
- Add workflow for testing library only dependencies (#223) by @mesejo
- Add duckdb and xgboost as dependencies for examples (#216) by @mesejo
Bug Fixes
- Register cache tables when executing to_pyarrow (#114) by @mesejo
- Update dependency fsspec to v2024.6.1 (#144) by @renovate
- Update rust crate pyo3 to 0.21 (#146) by @renovate
- Update tokio-prost monorepo to 0.13.1 (#147) by @renovate
- Update rust crate datafusion range to v40 (#165) by @renovate
- Update rust crate datafusion-* to v40 (#167) by @renovate
- Widen dependency dask range to v2024 (#164) by @renovate
- Enable build on macos by @dlovell
- Conditionally include libiconv in maturinOverride by @dlovell
- Update dependency attrs to v24 (#185) by @renovate
- Return proper type in get_log_path by @dlovell
- Use pandas backend in SourceStorage by @mesejo
- Update rust crate datafusion to v41 (#203) by @renovate
Refactors
- Wrap ibis backends (#115) by @mesejo
- Unpin pyarrow version (#121) by @mesejo
- Update README (#125) by @mesejo
- Use options.backend as ParquetCacheStorage’s default backend (#123) by @mesejo
- Change to publish on release (#122) by @mesejo
- Configure Renovate (#124) by @renovate
- Update dependency black to v24 [security] (#126) by @renovate
- Update dependency pure-eval to v0.2.3 (#130) by @renovate
- Update dependency blackdoc to v0.3.9 (#128) by @renovate
- Update dependency pytest to v7.4.4 (#131) by @renovate
- Update actions/create-github-app-token action to v1.10.3 (#127) by @renovate
- Update dependency connectorx to v0.3.3 (#129) by @renovate
- Update dependency snowflake/snowflake-connector-python to v3.11.0 (#141) by @renovate
- Update dependency importlib-metadata to v8.1.0 (#139) by @renovate
- Update dependency ruff to v0.5.4 (#133) by @renovate
- Update dependency black to v24.4.2 (#136) by @renovate
- Update dependency sqlalchemy to v2.0.31 (#134) by @renovate
- Update codecov/codecov-action action to v4.5.0 (#135) by @renovate
- Update dependency codespell to v2.3.0 (#137) by @renovate
- Update dependency coverage to v7.6.0 (#138) by @renovate
- Update dependency sqlglot to v23.17.0 (#142) by @renovate
- Update dependency pre-commit to v3.7.1 (#140) by @renovate
- Update dependency structlog to v24.4.0 (#143) by @renovate
- Update actions/checkout action to v4 (#148) by @renovate
- Update actions/setup-python action to v5 (#149) by @renovate
- Update dependency datafusion/datafusion to v39 (#150) by @renovate
- Update dependency numpy to v2 (#152) by @renovate
- Update dependency duckb/duckdb to v1 (#151) by @renovate
- Update dependency pyarrow to v17 (#153) by @renovate
- Disable pip_requirements manager (#163) by @mesejo
- Update dependency pytest-cov to v5 (#159) by @renovate
- Update extractions/setup-just action to v2 (#161) by @renovate
- Update github artifact actions to v4 (#162) by @renovate
- Range for datafusion-common (#166) by @renovate
- Update dependency pytest to v8 (#158) by @renovate
- Update dependencies ranges (#172) by @mesejo
- Enable plugin development for backends (#132) by @mesejo
- Include pre-commit dependencies in renovatebot scan (#176) by @mesejo
- Update dependency ruff to v0.5.5 (#174) by @renovate
- Bump object_store from 0.10.1 to 0.10.2 (#175) by @dependabot
- Update dependency pre-commit to v3.8.0 (#178) by @renovate
- Lock file maintenance, update Cargo TOML (#179) by @renovate
- Refactor flake (#180) by @dlovell
- Use poetry2nix overlays by @dlovell
- Enable editable install by @dlovell
- Update dependency ruff to v0.5.6 (#183) by @renovate
- Update dependency coverage to v7.6.1 (#187) by @renovate
- Lock file maintenance (#188) by @renovate
- Collapse ifs by @dlovell
- Enable
nix runto drop into an ipython shell by @dlovell - Make key_prefix settable in config/CacheStorage (#196) by @dlovell
- Update dependency ruff to v0.5.7 (#197) by @renovate
- Bump aiohttp from 3.9.5 to 3.10.2 (#212) by @dependabot
- Lock file maintenance (#207) by @renovate
- Return wrapper with model_name partialized by @hussainsultan
- Update links to data files (#214) by @mesejo
- Update dependency ruff to v0.6.0 (#215) by @renovate
- Update gbdt-rs repo url (#220) by @mesejo
- Make gbdt-rs dependency unambiguous (#222) by @mesejo
- Use postgres.connect_examples() and TemporaryDirectory (#219) by @mesejo
- Update dependency ruff to v0.6.1 (#218) by @renovate
Deprecations
0.1.4 (2024-07-02)
Refactors
0.1.3 (2024-06-24)
Features
- Add docker start to ci-test by @mesejo
- Poetry: add poetry checks to .pre-commit-config.yaml by @dlovell
- Add source cache by default by @mesejo
- Test_cache: add test_parquet_cache_storage by @dlovell
- Add rust files by @dlovell
- Add new cases to DataFusionBackend.register by @dlovell
- Add client tests for new register types by @dlovell
- Add faster function for CachedNode removal by @mesejo
- Add optimizations for predict_xgb in datafusion (#16) by @mesejo
- Lint: add args to poetry pre-commit invocation (#20) by @dlovell
- Add TableProvider for ibis Table (#21) by @mesejo
- Add filter pushdown for ibis.Table TableProvider (#24) by @mesejo
- Add .sql implementation (#28) by @mesejo
- Add automatic testing for examples dir (#45) by @mesejo
- Add docs (#51) by @mesejo
- Add better snowflake caching (#49) by @dlovell
- Add docs-preview workflow (#54) by @mesejo
- Add missing extras to poetry install in docs workflow (#58) by @mesejo
- Add start of services to workflow (#59) by @mesejo
- Add docs deploy workflow (#55) by @mesejo
- Add array functions (#60) by @mesejo
- Add registering of arbitrary expressions (#64) by @mesejo
- Add generic functions (#66) by @mesejo
- Add hashing of duckdb parquet files (#67) by @mesejo
- Add numeric functions (#80) by @mesejo
- Add
lsaccessor for Expr (#81) by @dlovell - Add greatest and least functions (#98) by @mesejo
- Add temporal functions (#99) by @mesejo
- Add StructColumn and StructField ops (#102) by @mesejo
- Add SnapshotStorage (#103) by @dlovell
Bug Fixes
- Filter bug solved by @mesejo
- Set stable ibis dependency by @mesejo
- Failing ci by @mesejo
- Pyproject: specify rev when using git ref, don’t use git@github.com by @dlovell
- Pyproject: make pyarrow,datafusion core dependencies by @dlovell
- Run
poetry lock --no-updateby @dlovell - Use _load_into_cache in _put by @mesejo
- _cached: special case for name == “datafusion” by @dlovell
- ParquetCacheStorage: properly create cache dir by @dlovell
- Local cache with parquet storage by @mesejo
- Fix mac build with missing source files by @hussainsultan
- Allow for multiple execution of letsql tables (#41) by @mesejo
- Fix import order using ruff (#37) by @mesejo
- Mismatched table names causing table not found error (#43) by @mesejo
- Ensure nonnull-ability of columns works (#53) by @dlovell
- Explicitly install poetry-plugin-export per warning message (#61) by @dlovell
- Update make_native_op to replace tables (#75) by @mesejo
- Normalize_memory_databasetable: incrementally tokenize RecordBatchs (#73) by @dlovell
- Cannot create table (#74) by @mesejo
- Handle case of table names during con.register (#77) by @mesejo
- Use sqlglot to generate escaped name string (#85) by @dlovell
- Register table on caching nodes (#87) by @mesejo
- Ensure snowflake tables have their Namespace bound on creation (#91) by @dlovell
- Change name of parameter in replace_table function (#94) by @mesejo
- Return native_dts, not sources (#95) by @dlovell
- Displace offsets in TimestampBucket (#104) by @mesejo
Refactors
- Improve performance and ux of predict_xgb by @mesejo
- Improve performance and ux of predict_xgb (#8) by @mesejo
- Fetch only the required features for the model by @mesejo
- Fetch only the required features for the model (#9) by @mesejo
- Organize the letsql package by @mesejo
- Lint by @dlovell
- Define CacheStorage with deterministic hashing for keys by @mesejo
- Define KEY_PREFIX to identify letsql cache by @dlovell
- Conftest: define expected_tables, enforce test fixture table list by @dlovell
- Lint by @dlovell
- Update poetry.lock by @dlovell
- Enable registration of pyarrow.RecordBatchReader and ir.Expr (#13) by @mesejo
- Update CONTRIBUTING.md with instructions to run Postgres by @mesejo
- Register more dask normalize_token types (#17) by @dlovell
- Enable flake to work on both linux and macos (#18) by @dlovell
- Clean up development and ci/cd workflows (#19) by @mesejo
- Temporal readme by @mesejo
- Publish test coverage (#31) by @mesejo
- Update project files README, CHANGELOG and pyproject.toml (#30) by @mesejo
- Expose TableProvider trait in Python (#29) by @mesejo
- Clear warnings, bump up datafusion version to 37.1.0 (#33) by @mesejo
- Update ibis version (#34) by @mesejo
- Xgboost is being deprecated (#40) by @hussainsultan
- Drop connection handling (#36) by @mesejo
- Refactor _register_and_transform_cache_tables (#44) by @mesejo
- Improve postgres table caching / cache invalidation (#47) by @dlovell
- Make engines optional extras (#50) by @dlovell
- SourceStorage: special case for cross-source caching (#63) by @dlovell
- Problem with multi-engine execution (#70) by @mesejo
- Clean test_execute and move tests from test_isolated_execution (#79) by @mesejo
- Move cache related tests to test_cache.py (#88) by @mesejo
- Give ParquetCacheStorage a default path (#92) by @dlovell
- Update to datafusion version 39.0.0 (#97) by @mesejo
- Make cache default path configurable (#101) by @mesejo
- V0.1.3 (#106) by @mesejo
Deprecations
0.1.2.post (2024-02-01)
Features
- Add missing dependencies by @mesejo
0.1.2 (2024-02-01)
Features
- Add CONTRIBUTING.md
- Address problems with schema
- Nix: add flake.nix and related files by @dlovell
- Add db package for showing predict udf working by @mesejo
- Add db package for showing predict udf working (#1) by @mesejo
Deprecations
- Remove xgboost as dependency by @mesejo
0.1.1 (2023-11-09)
Features
- Add register and client functions
- Add testing of api
- Add isnan/isinf and fix offset
- Add udf support
- Add new string ops, remove typo
Refactors
- Test array, temporal, string and udf
- Start adding wrapper
- Prepare for release