Release notes

Changelog for every Xorq release - features, bug fixes, refactors, and deprecations.

0.3.7 (2026-01-08)

Features

  • Add sdist.tar.gz as part of build artifacts (#1477) by @hussainsultan

Refactors

  • Restructure documentation and populate the Getting Started and Tutorials tabs (#1451) by @Olamideod
  • Refactor expr dump/load, naming (#1492) by @dlovell
  • Cleanup translate (#1459) by @mesejo

Deprecations

  • Remove assert_not_in_nix_shell for uv_tool_run (#1494) by @hussainsultan

0.3.6 (2026-01-05)

Features

  • Add new embedded backend ops (#1464) by @mesejo
  • Add cases (#1480) by @mesejo
  • Add BinaryView type (#1481) by @hussainsultan

Bug Fixes

  • Update snapshot (#1475) by @dlovell
  • Enforce order_by arg to first and last in mutate (#1470) by @mesejo

Refactors

  • Use snapshot hash and node refs (#1462) by @dlovell
  • Update hexdigest by @mesejo
  • Dtype dedup (#1469) by @dlovell
  • Init_templates.py (#1476) by @dlovell
  • Arrow ipc pipe (#1479) by @dlovell
  • Update dependency pytest to v9.0.2 (#1485) by @renovate
  • Update actions/create-github-app-token action to v2.2.1 (#1482) by @renovate
  • Update codecov/codecov-action action to v5.5.2 (#1483) by @renovate
  • Update dependency pre-commit to v4.5.1 (#1484) by @renovate
  • Update ruff to 0.14.10 (#1489) by @mesejo
  • Use datafusion default strftime (#1472) by @mesejo

0.3.5 (2025-12-22)

Features

  • Add Working with the documentation section (#1392) by @mesejo
  • Added windows installation across tutorials (#1402) by @Olamideod
  • Added an official style guide (#1403) by @Olamideod
  • Add Vale linter configuration files (#1408) by @Olamideod
  • Add temporal delta ops compiling (#1399) by @mesejo
  • Added vale linter integration guide to the repo (#1410) by @Olamideod
  • Add FillNull and NullIf translations (#1437) by @mesejo
  • Add missing ops (#1441) by @mesejo
  • Add TableUnnest op (#1436) by @mesejo
  • Add ParquetSnapshotStorage (#1449) by @hussainsultan

Bug Fixes

  • Asof_join with different column names (#1414) by @mesejo
  • Update dependency fsspec to >=2024.6.1,<2025.10.1 (#1431) by @renovate
  • Example with named memtable (#1458) by @mesejo
  • Patch normalize token retain lazy (#1461) by @dlovell
  • SdistBuilder: use untgzed dir as –with arg to uv (#1465) by @dlovell
  • Update caching examples (#1463) by @mesejo

Refactors

  • Reference the Style Guide in CONTRIBUTING.m (#1405) by @Olamideod
  • Update README (#1286) by @hussainsultan
  • Update dependency blackdoc to v0.4.6 (#1421) by @renovate
  • Update dependency ruff to v0.14.7 (#1422) by @renovate
  • Update pre-commit hook astral-sh/ruff-pre-commit to v0.14.7 (#1423) by @renovate
  • Update pre-commit hook astral-sh/uv-pre-commit to v0.9.13 (#1424) by @renovate
  • Update actions/create-github-app-token action to v2.2.0 (#1425) by @renovate
  • Update dependency black to v25.11.0 (#1426) by @renovate
  • Update dependency coverage to v7.12.0 (#1427) by @renovate
  • Update dependency ipython to <9.8.0,>=8.19.0 (#1428) by @renovate
  • Update dependency pre-commit to v4.5.0 (#1429) by @renovate
  • Update actions/checkout action to v6 (#1432) by @renovate
  • Apply sentence case per style guide (#1420) by @Olamideod
  • Update postgres docker tag to v17.7 (#1430) by @renovate
  • Update astral-sh/setup-uv action to v7 (#1433) by @renovate
  • Update dependency ipykernel to v7 (#1434) by @renovate
  • Update dependency pytest to v9 (#1435) by @renovate
  • Make walk nodes deterministic (#1453) by @mesejo
  • Parquet ttl cache (#1455) by @dlovell
  • Simplify translate (#1457) by @mesejo
  • Translation context methods (#1460) by @dlovell
  • Rename let to xorq (#1450) by @mesejo
  • Update hexdigest snapshot (#1466) by @mesejo

Deprecations

  • Remove unused ls command (#1394) by @mesejo

0.3.4 (2025-11-19)

Features

  • Add strftime function (#1373) by @mesejo
  • Add find_in_set (#1375) by @mesejo
  • Add help for uv-build and uv-run commands (#1395) by @mesejo

Bug Fixes

  • Fix FrozenDict replacement (#1385) by @mesejo

Refactors

  • Correct installation of quickstart (#1379) by @mesejo
  • Automate preview (#1380) by @mesejo
  • Rollback automatic preview of docs (#1383) by @mesejo
  • Use xorq[examples] across tutorials (#1388) by @mesejo
  • Use pyscopg[binary] (#1396) by @mesejo

Deprecations

  • Remove requirements-dev.txt (#1387) by @mesejo

0.3.3 (2025-11-11)

Features

  • Add builtin containers in from_ibis (#1369) by @mesejo
  • Add hexdigest function (#1374) by @mesejo
  • Support version >= 1.4.1 (#1377) by @mesejo

Refactors

  • Enable lock file maintenance in renovatebot (#1370) by @mesejo
  • Update pre-commit hook astral-sh/uv-pre-commit to v0.9.7 (#1367) by @renovate
  • Update pre-commit hook astral-sh/ruff-pre-commit to v0.14.3 (#1366) by @renovate
  • Update postgres docker tag to v17.6 (#1365) by @renovate
  • Disable setup-python dependency updates (#1371) by @mesejo
  • Update dependency trino to v0.336.0 (#1364) by @renovate
  • Update dependencies pytest-codspeed, coverage, blackdoc (#1361) by @renovate
  • Update dependency ruff to v0.14.3 (#1363) by @renovate
  • Move expr_to_unbound (#1357) by @mesejo

0.3.2 (2025-11-03)

Features

  • Add Multiply and Hash ops (#1183) by @mesejo
  • Add storage arg to Pipeline.fit (#1257) by @dlovell
  • Add better error message for ValueError (#1263) by @mesejo
  • Add reduction ops (#1265) by @mesejo
  • Add xorq-psql (#1270) by @dlovell
  • Add valid default xorq.expr.udf.agg.pandas_df name (#1278) by @mesejo
  • Add sklearn_classifier_comparison (#1273) by @dlovell
  • Add sqlite backend (#1244) by @mesejo
  • Add pandas tests (#1295) by @mesejo
  • Add tagging for ml ops (#1297) by @mesejo
  • Add keypair auth (#1334) by @dlovell
  • Add benchmark for import (#1342) by @mesejo
  • Add sops (#1337) by @dlovell
  • Add default database/schema from env vars (#1353) by @dlovell
  • Add from_ibis function (#1354) by @mesejo

Bug Fixes

  • Timeout peek port (#1255) by @dlovell
  • Skip re.search on Path object in _maybe_glob_pattern (#1261) by @mesejo
  • Uncached fittedstep model (#1260) by @dlovell
  • Use pytest importorskip to sklearn test (#1262) by @mesejo
  • _ParquetStorage._put: write to a tmp location (#1268) by @dlovell
  • _transform_deferred_reads: squelch warning re Path (#1275) by @dlovell
  • Faster do_explode_encode (#1269) by @dlovell
  • Pipeline infer features (#1274) by @dlovell
  • Not execute doc code (#1281) by @mesejo
  • Enable count (#1290) by @dlovell
  • Train test splits pandas (#1291) by @dlovell
  • Custom_hash for nameless Series (#1289) by @mesejo
  • Distinct: register from_yaml loader (#1303) by @dlovell
  • Fixup template tests (#1311) by @dlovell
  • Fixup pipeline tagging tests (#1312) by @dlovell
  • Default env var reference (#1310) by @dlovell
  • Mermaid diagrams in vignettes (#1327) by @mesejo
  • Residual fixups for psycopg update (#1333) by @dlovell
  • Parse multiline env vars (#1331) by @dlovell
  • Fix UnboundLocalError on connect (#1341) by @dlovell
  • Snowflake GitHub Action (#1344) by @mesejo
  • Create table from expr (#1347) by @dlovell
  • Default create_object_udfs to False (#1352) by @dlovell

Refactors

  • Test weather_lib example (#1254) by @mesejo
  • Easily uncache (#1256) by @dlovell
  • Improve no-extra runner (#1231) by @mesejo
  • Add translation for First and Any ops (#1264) by @mesejo
  • Better metadata (#1271) by @dlovell
  • Split slow test workflow (#1272) by @mesejo
  • Train test split default (#1196) by @dlovell
  • Update readme with bottoms-up messaging (#1280) by @hussainsultan
  • Update xorq_datafusion version (#1284) by @mesejo
  • Move tests to the dedicated package (#1293) by @mesejo
  • Move pandas backend out of vendored ibis (#1296) by @mesejo
  • Allow for specifying compiler in to_sql (#1283) by @mesejo
  • Improve testing (#1287) by @mesejo
  • Update quickstart.qmd (#1299) by @mesejo
  • Update quarto version (#1315) by @mesejo
  • Chore: use Cloudfare CDN polyfill version (#1314) by @mesejo
  • Change Bitnami Catalog (docker images) (#1316) by @mesejo
  • Update pre-commit hook astral-sh/uv-pre-commit to v0.8.22 (#1320) by @renovate
  • Update dependency blackdoc to v0.4.3 (#1317) by @renovate
  • Update dependency coverage to v7.10.7 (#1318) by @renovate
  • Update dependency pytest to v8.4.2 (#1319) by @renovate
  • Update actions/create-github-app-token action to v2.1.4 (#1321) by @renovate
  • Update codecov/codecov-action action to v5.5.1 (#1322) by @renovate
  • Update dependency black to v25.9.0 (#1323) by @renovate
  • Update dependency ipython to <9.7.0,>=8.19.0 (#1324) by @renovate
  • Update dependency pre-commit to v4.3.0 (#1325) by @renovate
  • Update dependency pytest-cov to v6.3.0 (#1326) by @renovate
  • Make CachedNode inherit DatabaseTable (#1307) by @mesejo
  • Ensure expr is indeed an ibis Expr (#1328) by @mesejo
  • Update postgres Backend to latest ibis code (#1329) by @mesejo
  • Make Read inherit from DatabaseTable (#1309) by @mesejo
  • Add ValueError messages (#1330) by @ryanping
  • Use evolve instead of defining clone (#1335) by @mesejo
  • Update snowflake Backend code (#1343) by @mesejo
  • Create common ancestor for custom ops (#1338) by @mesejo
  • Apply security updates described by dependabot (#1356) by @mesejo
  • RemoteTable registration (#1355) by @mesejo

Deprecations

  • Remove vendored ibis conftest.py (#1300) by @mesejo
  • Remove commented code (#1313) by @mesejo
  • Remove redundant normalization (#1336) by @mesejo
  • Remove replace_cache_table (#1348) by @mesejo
  • Remove legacy_replace_cache_table (#1349) by @mesejo

0.3.1 (2025-08-30)

Features

  • Add xorq app (#1163) by @hussainsultan
  • Add CLI section in 10_minutes (#1158) by @mesejo
  • Add Tag(Node) class, Expr.tag method (#1205) by @dlovell
  • Add limit option to run (#1203) by @hussainsultan
  • Support group by alias in aggregate (#1224) by @hussainsultan
  • Add runner per backend (#1210) by @mesejo
  • LETSQLAccessor: add property tokenized (#1238) by @dlovell
  • Add listing and fetching of UnboundExprExchanger (#1207) by @mesejo
  • Add catalog (#1249) by @dlovell

Bug Fixes

  • Update dependency datafusion to v48 (#1174) by @renovate
  • Update dependency fsspec to >=2024.6.1,<2025.7.1 (#1172) by @renovate
  • Update dependency pyarrow to v21 (#1175) by @renovate
  • Ensure preserve_index=False in RecordBatch.from_pandas (#1160) by @mesejo
  • Xorq serve inference (#1176) by @dlovell
  • Fix riscv issuee in nix run (#1185) by @hussainsultan
  • Fix pyarrow 21.0.0 build on darwin (#1192) by @hussainsultan
  • Read_record_batches schema mismatch (#1190) by @mesejo
  • Pointing to main of xorq-weather-lib (#1188) by @mesejo
  • Register with table_name default value (#1182) by @mesejo
  • Update flake inputs (#1191) by @dlovell
  • .sql on deferred_read_* nodes (#1184) by @mesejo
  • Rename serve cmd (#1200) by @hussainsultan
  • Better serve-unbound con detection (#1212) by @dlovell
  • Wrong arg limit in serve_unbound_parser (#1226) by @mesejo
  • Use item accessor (square brackets) for tag column (#1227) by @mesejo
  • Fix readme broken links (#1234) by @hussainsultan
  • SourceStorage._put: don’t pull local (#1235) by @dlovell
  • Update reference (#1243) by @mesejo
  • Allow None for the con in deferred_read_parquet by @mesejo
  • Fix CLI command docs reference (#1250) by @mesejo
  • Replace computed kwargs expr (#1247) by @dlovell

Refactors

  • Make xorq cli app to use all deps (#1164) by @hussainsultan
  • Update pre-commit hook astral-sh/ruff-pre-commit to v0.12.7 (#1168) by @renovate
  • Update dependency ruff to v0.12.7 (#1167) by @renovate
  • Update pre-commit hook astral-sh/uv-pre-commit to v0.8.4 (#1171) by @renovate
  • Update bitnami/minio docker tag to v2025.7.23 (#1169) by @renovate
  • Properly configure pin setup-python (#1177) by @mesejo
  • Update dependency coverage to v7.10.2 (#1170) by @renovate
  • Update dependency pytest-codspeed to v4 (#1173) by @renovate
  • Make deferred read and sql outputs optional in BuildManager (#1199) by @hussainsultan
  • Improve speed of ibis_yaml package (#1202) by @mesejo
  • Move into_backend tests to test_into_backend.py (#1178) by @mesejo
  • Bank marketing uses pipeline lib (#1204) by @dlovell
  • Use local files for reducing execution time (#1206) by @mesejo
  • Delay sklearn import (#1215) by @dlovell
  • Delay pandas import (#1219) by @dlovell
  • Use peek_port in test_serve_command (#1221) by @mesejo
  • Reduce combinations and outdated workflows (#1230) by @mesejo
  • Update penguins hexdigest (#1236) by @mesejo
  • Move from xorq to xorq.api (#1222) by @mesejo
  • Warn when a Read op targets a local file (#1195) by @mesejo
  • Update project urls (#1248) by @mesejo
  • Update CLI references with new commands (#1245) by @sanajitjana
  • Disable weather_flight example temporarily (#1251) by @mesejo
  • Update google-site-verification (#1253) by @mesejo

Deprecations

  • Remove spurious riscv64 entry (#1165) by @dlovell
  • Remove bind value in FlightURL (#1181) by @mesejo
  • Remove row_number hack for gen_splits (#1193) by @hussainsultan
  • Remove print in elide_cache_node (#1228) by @mesejo

0.3.0 (2025-07-28)

Features

  • Add expression format concept page (#1159) by @mesejo

0.2.5 (2025-07-26)

Features

  • Add xorq init (#1117) by @dlovell
  • Add cryptography as a core dependency (#1123) by @dlovell
  • Add google verification to docs (#1126) by @mesejo
  • Add penguins template to xorq init (#1134) by @mesejo
  • Add DropNull op translation (#1135) by @mesejo
  • Add caching concept (#1154) by @mesejo

Bug Fixes

  • Use Path.name instead of Path.stem in run_command (#1118) by @mesejo
  • Update for xorq-hash-cache rename (#1122) by @dlovell
  • Fix quoting in google indexing (#1127) by @mesejo
  • Use print_exc (#1125) by @dlovell
  • Use port and host args in serve (#1130) by @mesejo
  • Better type inference for LogisticRegression (#1136) by @dlovell
  • Update for xorq-hash-cache (#1131) by @dlovell
  • Port and host args handling (#1144) by @mesejo
  • Use expr.ls.uncached when finding backend (#1141) by @mesejo
  • Fix run commands (#1153) by @dlovell
  • Deferred_read_* methods (#1155) by @mesejo

Refactors

  • Test installation for multiple Python versions and OS (#1107) by @mesejo
  • Uv-build (#1132) by @dlovell
  • Run slow tests in a different runner (#1087) by @mesejo
  • Refactor reference structure (#1129) by @mesejo
  • Readme graphic (#1150) by @hussainsultan
  • Move functions to translate.py (#1152) by @mesejo
  • Make con optional in deferred_read (#1142) by @mesejo
  • Xorq serve inference (#1143) by @dlovell
  • Update quickstart tutorial to reflect CLI-centric approach (#1157) by @hussainsultan
  • Update 10_minutes_xorq_tour (#1151) by @mesejo

Deprecations

  • Serve_command: remove spurious kwargs (#1145) by @dlovell

0.2.4 (2025-07-09)

Features

  • Add base methods from Expr (#1093) by @mesejo
  • Add cache_dir to serve command (#1106) by @mesejo

Bug Fixes

  • Override base, not just editables (#1095) by @dlovell
  • Correct backend reference in README (#1097) by @IndexSeek
  • Deferred_read_csv: schema: use columns not types (#1103) by @dlovell
  • Fix border output color (#1104) by @mesejo
  • Generic handling of cached node (#1105) by @dlovell
  • Structfield (#1109) by @dlovell
  • Fetch penguins (#1114) by @mesejo

Refactors

  • Feature store (#1091) by @hussainsultan
  • Rename weather micro-libs to xorq-prefix (#1096) by @dlovell
  • Singledispatch sklearn (#1100) by @dlovell
  • Use snapshot in test_build_file_stability (#1092) by @mesejo
  • Improve grid listing style (#1101) by @mesejo
  • Improve ml section documentation (#1099) by @mesejo

0.2.3 (2025-07-02)

Features

  • Support list of paths in read_csv_rbr (#927) by @mesejo
  • Add snapshot filtering (#937) by @mesejo
  • Add python 3.13 to the test suite (#947) by @mesejo
  • Add upsert (#938) by @mesejo
  • Add xorq-cachix-{use,push} (#948) by @dlovell
  • Add tls_utils (#966) by @dlovell
  • Add set ops (#970) by @mesejo
  • Add missing string ops translation (#969) by @mesejo
  • Add .gitignore to .gitignore.template (#999) by @dlovell
  • Add lineage_utils (#993) by @hussainsultan
  • Add back opaque_ops (#1012) by @mesejo
  • Add pipeline (#1015) by @dlovell
  • Add ci-docs-preview workflow for netlify (#1030) by @mesejo
  • Add YAML and build outputs in getting started (#1063) by @hussainsultan
  • Add serve command (#1019) by @hussainsultan
  • Add TSLKwargs to_disk and from_disk (#1077) by @mesejo

Bug Fixes

  • Fix walking and checking (#914) by @dlovell
  • Classproperty (#946) by @dlovell
  • Update dependency fsspec to >=2024.6.1,<2025.5.1 (#954) by @renovate
  • Update dependency fsspec to >=2024.6.1,<2025.5.2 (#965) by @renovate
  • Update dependency datafusion to v47 (#971) by @renovate
  • Ensure expr results in a non-empty result (#988) by @dlovell
  • Xorqify all types (#990) by @dlovell
  • Clear out registry (#1002) by @dlovell
  • Enable building of DatabaseTable (#973) by @mesejo
  • Use cloudpickle (#1014) by @dlovell
  • Pass ibis schema instead of pyarrow (#1037) by @hussainsultan
  • Store parquet files inside expr build dir (#1010) by @mesejo
  • Use large_binary to intermediate state (#1043) by @dlovell
  • Build for non SQL backends (#1051) by @mesejo
  • Fix links in README (#1052) by @mesejo
  • Uniform caching dir (#1067) by @dlovell
  • Test_default_caching_dir on windows (#1070) by @mesejo
  • Update 10_minutes ParquetStorage usage (#1072) by @mesejo
  • Fix theme minor issues (#1078) by @mesejo
  • Build stability (#1064) by @dlovell
  • Replace InMemoryTable and DatabaseTable behind opaque ops (#1080) by @mesejo

Refactors

  • Update postgres docker tag to v17.5 (#924) by @renovate
  • Update dependency ruff to v0.11.9 (#925) by @renovate
  • Update pre-commit hook astral-sh/ruff-pre-commit to v0.11.9 (#926) by @renovate
  • Update xorq-datafusion version (#929) by @mesejo
  • Update dependency ruff to v0.11.10 (#940) by @renovate
  • Update pre-commit hook astral-sh/ruff-pre-commit to v0.11.10 (#941) by @renovate
  • Update codecov/codecov-action action to v5.4.3 (#944) by @renovate
  • Update pre-commit hook astral-sh/uv-pre-commit to v0.7.4 (#945) by @renovate
  • Update pre-commit hook astral-sh/uv-pre-commit to v0.7.5 (#949) by @renovate
  • Update pre-commit hook astral-sh/uv-pre-commit to v0.7.6 (#952) by @renovate
  • Disable cargo manager (#953) by @mesejo
  • Disable dask dependency updates (#956) by @mesejo
  • Update pre-commit hook astral-sh/ruff-pre-commit to v0.11.11 (#960) by @renovate
  • Update pre-commit hook astral-sh/uv-pre-commit to v0.7.7 (#961) by @renovate
  • Update dependency ruff to v0.11.11 (#959) by @renovate
  • Update dependency coverage to v7.8.1 (#957) by @renovate
  • Update pre-commit hook astral-sh/uv-pre-commit to v0.7.8 (#964) by @renovate
  • Update bitnami/minio docker tag to v2025.5.24 (#967) by @renovate
  • Update dependency coverage to v7.8.2 (#963) by @renovate
  • Update duckdb darwin override (#968) by @hussainsultan
  • Update dependency quartodoc to <0.10.1,>=0.7.2 (#972) by @renovate
  • Update pre-commit hook astral-sh/ruff-pre-commit to v0.11.12 (#975) by @renovate
  • Update dependency ruff to v0.11.12 (#974) by @renovate
  • Update pre-commit hook astral-sh/uv-pre-commit to v0.7.9 (#977) by @renovate
  • Update dependency ipython to <9.4.0,>=8.19.0 (#980) by @renovate
  • Update dependency pytest to v8.4.0 (#982) by @renovate
  • Update pre-commit hook astral-sh/uv-pre-commit to v0.7.10 (#984) by @renovate
  • Update dependency python to v3.13.4 (#986) by @renovate
  • Make normalize_filenames accepts glob pattern (#934) by @mesejo
  • Versioned pins (#991) by @dlovell
  • Update pre-commit hook astral-sh/uv-pre-commit to v0.7.11 (#989) by @renovate
  • No .gitignore in version control (#994) by @dlovell
  • Update pre-commit hook astral-sh/uv-pre-commit to v0.7.12 (#998) by @renovate
  • Update trinodb/trino docker tag to v476 (#997) by @renovate
  • Update pre-commit hook astral-sh/ruff-pre-commit to v0.11.13 (#996) by @renovate
  • Update dependency ruff to v0.11.13 (#995) by @renovate
  • Update dependency quartodoc to <0.11.1,>=0.7.2 (#1003) by @renovate
  • Update dependency blackdoc to v0.3.10 (#1004) by @renovate
  • Update dependency quartodoc to <0.11.2,>=0.7.2 (#1006) by @renovate
  • Update dependency coverage to v7.9.0 (#1007) by @renovate
  • Update dependency pytest-cov to v6.2.0 (#1008) by @renovate
  • Make FlightUDXF use mtls by default (#1000) by @mesejo
  • Make udwf buildable (#1005) by @mesejo
  • Update dependency pytest-cov to v6.2.1 (#1009) by @renovate
  • Update pre-commit hook astral-sh/uv-pre-commit to v0.7.13 (#1011) by @renovate
  • Update dependency coverage to v7.9.1 (#1017) by @renovate
  • Update dependency blackdoc to v0.4.0 (#1018) by @renovate
  • Flight backend create (#1021) by @hussainsultan
  • Update actions/create-github-app-token action to v1.12.0 (#1031) by @renovate
  • Update astral-sh/setup-uv action to v6 (#1033) by @renovate
  • Update pre-commit hook astral-sh/ruff-pre-commit to v0.12.0 (#1024) by @renovate
  • Update dependency trino to v0.335.0 (#1023) by @renovate
  • Update actions/create-github-app-token action to v2 (#1032) by @renovate
  • Update extractions/setup-just action to v3 (#1034) by @renovate
  • Update dependency ruff to v0.12.0 (#1022) by @renovate
  • Update dependency pytest to v8.4.1 (#1029) by @renovate
  • Set environment variables in ci-docs-preview workflow (#1042) by @mesejo
  • Update pre-commit hook astral-sh/uv-pre-commit to v0.7.14 (#1044) by @renovate
  • Clean commands (#1039) by @dlovell
  • Revert mintlify and migrate to netlify (#1013) by @mesejo
  • Readme rewrite (#1045) by @hussainsultan
  • Update astral-sh/setup-uv action to v6 (#1046) by @renovate
  • Update extractions/setup-just action to v3 (#1047) by @renovate
  • Update pre-commit hook astral-sh/uv-pre-commit to v0.7.15 (#1050) by @renovate
  • Update with penguins🐧 (#1055) by @hussainsultan
  • Improve wording in README (#1057) by @hussainsultan
  • Update pre-commit hook astral-sh/ruff-pre-commit to v0.12.1 (#1060) by @renovate
  • Update pre-commit hook astral-sh/uv-pre-commit to v0.7.17 (#1062) by @renovate
  • Update xorq-datafusion version to 0.2.3 (#1073) by @mesejo
  • Update dependency blackdoc to v0.4.1 (#1058) by @renovate
  • Update dependency blackdoc to v0.4.1 (#1076) by @renovate
  • Update dependency ruff to v0.12.1 (#1059) by @renovate
  • Update dependency ipython to <9.5.0,>=8.19.0 (#1079) by @renovate
  • Update pre-commit hook astral-sh/uv-pre-commit to v0.7.18 (#1084) by @renovate
  • Configure monthly PR creation (#1085) by @mesejo
  • Make pyiceberg an optional (#1035) by @dlovell

Deprecations

  • Remove read_sqlite (#987) by @mesejo
  • Remove dead code (#1001) by @mesejo
  • Remove rust toolchain from nix configs (#1020) by @hussainsultan
  • Remove to_pyarrow transformation (#1040) by @mesejo
  • Remove empty example section (#1086) by @mesejo

0.2.2 (2025-05-08)

Features

  • Support StringToDate in build (#892) by @mesejo
  • Add ArrayAny and ArrayAll to xorq backend (#893) by @mesejo
  • Add IsInf and IsNan ops (#898) by @mesejo
  • Add pyiceberg backend (#910) by @mesejo

Bug Fixes

  • DevShells.impure: don’t require commands to build (#861) by @dlovell
  • Register translation for PosixPath (#888) by @mesejo
  • Update dependency pyarrow to v20 (#895) by @renovate
  • Change _translate_type to translate yaml (#897) by @mesejo
  • Ensure inclusion of env_templates (#906) by @dlovell
  • Flight server issues (#922) by @mesejo

Refactors

  • Update dependency ruff to v0.11.7 (#883) by @renovate
  • Update pre-commit hook astral-sh/ruff-pre-commit to v0.11.7 (#884) by @renovate
  • Update astral-sh/setup-uv action to v6 (#880) by @renovate
  • Test library as an installed wheel (#885) by @mesejo
  • Update dependency ipython to <9.3.0,>=8.19.0 (#889) by @renovate
  • Update pre-commit hook astral-sh/uv-pre-commit to v0.6.17 (#891) by @renovate
  • Ensure requests is installed for examples (#890) by @mesejo
  • Run tests mark with s3 in workflow (#900) by @mesejo
  • Ensure dependencies are resolved against PyPI index (#901) by @mesejo
  • Update pre-commit hook astral-sh/uv-pre-commit to v0.7.0 (#902) by @renovate
  • Update pre-commit hook astral-sh/uv-pre-commit to v0.7.2 (#903) by @renovate
  • Update pre-commit hook astral-sh/ruff-pre-commit to v0.11.8 (#905) by @renovate
  • Trace utils (#874) by @dlovell
  • Darwin override for grpcio (#881) by @hussainsultan
  • Update dependency ruff to v0.11.8 (#904) by @renovate
  • Update dependency trino to v0.334.0 (#908) by @renovate
  • Migrate to xorq-datafusion (#792) by @mesejo
  • Update astral-sh/setup-uv action to v6 (#911) by @renovate
  • Hook up kwargs in client.upload_data (#917) by @hussainsultan
  • Update pre-commit hook astral-sh/uv-pre-commit to v0.7.3 (#921) by @renovate

Deprecations

  • Remove double prefix (#896) by @mesejo
  • Remove old rust build related code (#912) by @dlovell

0.2.1 (2025-04-25)

Features

  • Add mcp server example (#731) by @hussainsultan
  • Add files for pure-pypi uv env (#742) by @dlovell
  • Add workflow for checking PR titles (#716) by @mesejo
  • Add default value to expr_name (#748) by @dlovell
  • Add top level –pdb and drop into post mortem on failure (#753) by @dlovell
  • Additional checks (#810) by @dlovell
  • Add test for query schema action (#822) by @hussainsultan
  • Add normalization GCS path (#829) by @mesejo
  • Add GCStorage (#838) by @dlovell
  • Add virtualenv-default (#841) by @dlovell
  • Add read_record_batches to Snowflake Backend (#834) by @mesejo
  • Add env_utils, EnvConfigable (#843) by @dlovell
  • Add env vars to reduce uv actions (#844) by @dlovell
  • Add otel instrumentation (#845) by @dlovell
  • Add get_object_metadata to SessionContext (#865) by @mesejo
  • Add normalization for s3 and gcs objects (#871) by @mesejo

Bug Fixes

  • Specify the correct type when raising on incorrect type (#747) by @dlovell
  • Require explicit variable for tests (#749) by @dlovell
  • Read_csv_rbr: ensure Schema (#751) by @dlovell
  • Update dependency fsspec to >=2024.6.1,<2025.3.2 (#768) by @renovate
  • Test cli on select examples (#763) by @dlovell
  • Dont raise blocking raise (#765) by @dlovell
  • Read with schema (#766) by @dlovell
  • Fix Mod deserialization (#778) by @dlovell
  • Update dependency fsspec to >=2024.6.1,<2025.3.3 (#780) by @renovate
  • Read: capture read_kwargs (#777) by @dlovell
  • Typo in modification time caching strategy (#803) by @hussainsultan
  • Enable CachedNode (#806) by @dlovell
  • Sundry fixes (#819) by @dlovell
  • Update rust crate tokio to v1.44.2 [security] (#823) by @renovate
  • Prevent optional dependency leakage (#840) by @dlovell
  • Subprocess not monkeypatch (#849) by @dlovell
  • Enable main curry/functools.lru_cache (#856) by @dlovell
  • Clean up api (#862) by @dlovell
  • Read_csv from s3 URL (#852) by @mesejo
  • Update otel_utils to last EnvConfigable version (#870) by @mesejo
  • Skip setting env variables in profiles.py example (#875) by @mesejo
  • Use env var contextmanager whenever get_con is invoked (#879) by @dlovell
  • Include env_templates files in wheel (#882) by @mesejo

Refactors

  • Update README with xorq info (#741) by @mesejo
  • Make github-actions dependencies pin (#744) by @mesejo
  • Update dependency node to v22 (#743) by @renovate
  • Pin dependencies (#745) by @renovate
  • Enable writing to stdout (#757) by @dlovell
  • Update to datafusion 46 (#724) by @mesejo
  • Define fixture fixture_dir (#761) by @dlovell
  • Enable renovatebot for pre-commit dependencies (#770) by @mesejo
  • Make git diff message explicit and descriptive (#774) by @mesejo
  • Update pre-commit hook astral-sh/uv-pre-commit to v0.6.11 (#773) by @renovate
  • Upgrade requirements-dev.txt to uv 0.6.11 format (#775) by @mesejo
  • Update pre-commit hook codespell-project/codespell to v2.4.1 (#771) by @renovate
  • Update pre-commit hook astral-sh/ruff-pre-commit to v0.11.2 (#772) by @renovate
  • Enable xorq buildable (#764) by @dlovell
  • Update dependency coverage to v7.8.0 (#769) by @renovate
  • Centralised postgres connection fixture (#776) by @mesejo
  • Register Alias in ibis_yaml translate (#783) by @dlovell
  • Register Round (#790) by @dlovell
  • Update dependency pytest-cov to v6.1.0 (#791) by @renovate
  • Update pre-commit hook astral-sh/uv-pre-commit to v0.6.12 (#796) by @renovate
  • Enable memtable (#784) by @dlovell
  • Update pre-commit hook astral-sh/ruff-pre-commit to v0.11.4 (#800) by @renovate
  • Update bitnami/minio docker tag to v2025.4.3 (#801) by @renovate
  • Update dependency ruff to v0.11.4 (#799) by @renovate
  • Enable memtable test (#804) by @mesejo
  • Enable AggUDF (#807) by @dlovell
  • Update dependency pytest-cov to v6.1.1 (#808) by @renovate
  • Factor out helpers (#811) by @dlovell
  • Make PR description compact (#814) by @mesejo
  • Update codecov badge in README (#825) by @mesejo
  • Rationalize helpers (#818) by @dlovell
  • Update pre-commit hook astral-sh/uv-pre-commit to v0.6.13 (#821) by @renovate
  • Update dependency ipython to <9.2.0,>=8.19.0 (#815) by @renovate
  • Enable exprscalarudf (#813) by @dlovell
  • Update pre-commit hook astral-sh/uv-pre-commit to v0.6.14 (#831) by @renovate
  • Update bitnami/minio docker tag to v2025.4.8 (#827) by @renovate
  • Update dependency ruff to v0.11.5 (#832) by @renovate
  • Update pre-commit hook astral-sh/ruff-pre-commit to v0.11.5 (#833) by @renovate
  • Use gcs built in uri ctor (#839) by @dlovell
  • Update google-github-actions/auth action to v2 (#835) by @renovate
  • Update pre-commit hook astral-sh/ruff-pre-commit to v0.11.6 (#847) by @renovate
  • Update dependency ruff to v0.11.6 (#846) by @renovate
  • Update dependency ruff to v0.11.6 (#848) by @renovate
  • Update codecov/codecov-action action to v5.4.2 (#842) by @renovate
  • Gcstorage improvement (#863) by @dlovell
  • Update pre-commit hook astral-sh/uv-pre-commit to v0.6.16 (#864) by @renovate
  • Update bitnami/minio docker tag to v2025.4.22 (#869) by @renovate
  • Avoid double rust compilation and use cargo cache (#873) by @mesejo
  • Update trinodb/trino docker tag to v475 (#876) by @renovate
  • Use python 3.10 (#877) by @mesejo

Deprecations

  • Remove redundant compiler (#756) by @mesejo
  • Remove tenacity from examples (#759) by @mesejo
  • Remove commintlint (#779) by @mesejo

0.2.0 (2025-03-27)

Features

  • Add ExprScalarUDF to walk_nodes (#693) by @dlovell
  • Add hn part4 (#713) by @hussainsultan
  • Add multi-duck vignette (#719) by @hussainsultan
  • Add import_from_gist (#733) by @dlovell
  • Add uv section (#730) by @mesejo
  • Add type annotations to deferred_read_csv and deferred_read_parquet-star01 (#738) by @soheil

Bug Fixes

  • Postgres deferred_read_parquet fails for http source (#708) by @mesejo
  • Spurious backend in _find_backend (#717) by @mesejo
  • Update expected command hashes (#734) by @dlovell
  • Register dict (#735) by @dlovell

Refactors

  • ParquetStorage to build and run (#684) by @mesejo
  • Centralize definition of parquet_dir fixture (#722) by @dlovell
  • Generalize openai invocation (#732) by @dlovell
  • Connect_examples pass kwargs (#736) by @dlovell

Deprecations

  • Remove PyO3 migration warnings (#707) by @mesejo
  • Remove unused exchanger (#715) by @mesejo

0.1.17 (2025-03-24)

Features

  • Add quickstart (#654) by @hussainsultan
  • Add helpers to identify normalization issues (#669) by @dlovell
  • Add exchangers to FlightServer constructor (#671) by @dlovell
  • Add hn quickstart example (#675) by @hussainsultan
  • Add part 1 of hn data tutorial (#661) by @hussainsultan
  • Add hn data tutorial part 2 (#663) by @hussainsultan
  • ToolsPackages: add gh (#673) by @dlovell
  • Add ListActionsAction (#706) by @dlovell

Bug Fixes

  • Update rust crate async-trait to v0.1.88 (#656) by @renovate
  • Invoke inspect when explicitly requested in normalize_seq_with_caller (#668) by @dlovell
  • Warning for not using raw string in regex (#676) by @ghoersti
  • Update flake inputs to build with rust 1.85.0 (#690) by @dlovell
  • Avoid duplicated execution of expr by removing read_all (#677) by @mesejo
  • Update rust crate arrow to v54.3.0 (#700) by @renovate
  • Make action_body a dict (#692) by @mesejo

Refactors

  • Update dependency ruff to v0.10.0 (#653) by @renovate
  • Update extractions/setup-just action to v3 (#658) by @renovate
  • Update dependency ruff to v0.11.0 (#657) by @renovate
  • Update CONTRIBUTING.md (#664) by @dlovell
  • Mark snapshot tests (#665) by @dlovell
  • Update dependency coverage to v7.7.0 (#666) by @renovate
  • Update readme to use similar language as docs (#674) by @hussainsultan
  • Update dependency pre-commit to v4.2.0 (#681) by @renovate
  • Update trinodb/trino docker tag to v473 (#685) by @renovate
  • Update to datafusion 45 (#672) by @mesejo
  • Change url in test_read_csv_from_url (#688) by @mesejo
  • Move tests to xorq/tests (#689) by @mesejo
  • Improve core concepts (#686) by @hussainsultan
  • Update dependency ruff to v0.11.1 (#691) by @renovate
  • Update dependency ruff to v0.11.2 (#698) by @renovate
  • Convert expr to table (#695) by @mesejo
  • Update trinodb/trino docker tag to v474 (#702) by @renovate
  • Update dependency coverage to v7.7.1 (#697) by @renovate
  • Hotfix darwin build for 3.10,3.11 (#704) by @dlovell

0.1.16 (2025-03-13)

Features

  • Add tutorials intro section (#634) by @mesejo

Bug Fixes

  • Infer suffix in read_(parquet/csv) (#639) by @mesejo
  • Special case for postgres in case of complex types (#644) by @dlovell
  • Update rust crate tokio to v1.44.1 (#650) by @renovate

Refactors

  • Update bitnami/minio docker tag to v2025.3.12 (#649) by @renovate
  • Update tutorial with new sklearn functions (#645) by @mesejo
  • Expose deferred_reads as top level (#646) by @mesejo
  • Make udf top level (#647) by @mesejo

0.1.15 (2025-03-11)

Features

  • FlightServer: add con and client as properties (#568) by @dlovell
  • Add xorq build cli command (#567) by @mesejo
  • Add importing of notebooks (#577) by @mesejo
  • Add deferred_fit_predict (#595) by @dlovell
  • Add overview image (#605) by @hussainsultan
  • Add to_json/to_csv (#604) by @mesejo
  • Add run cli command (#581) by @mesejo
  • Add examples tab (#608) by @mesejo
  • Add run section of build and run tutorial (#637) by @mesejo

Bug Fixes

  • Update dependency datafusion to v45 (#563) by @renovate
  • Update rust crate async-trait to v0.1.87 (#594) by @renovate
  • Dedupe yaml serialization (#589) by @hussainsultan
  • Default to dynamic FlightUrl port (#603) by @dlovell
  • Default_backend should xorq (#609) by @mesejo
  • Flight caching (#610) by @dlovell
  • Mark remote tables so clean up won’t interfere with others (#613) by @dlovell
  • Update dependency fsspec to >=2024.6.1,<2025.3.1 (#618) by @renovate
  • Update rust crate tokio to v1.44.0 (#621) by @renovate
  • Update rust crate arrow-ord to v53.4.1 (#620) by @renovate

Refactors

  • Update dependency ruff to v0.9.7 (#558) by @renovate
  • Consolidate YAML/SQL serialization (#525) by @hussainsultan
  • Move custom types to source file (#566) by @mesejo
  • Extract postgres extra (#571) by @mesejo
  • Update codecov/codecov-action action to v5.4.0 (#574) by @renovate
  • Update cli docstring (#575) by @mesejo
  • Migrate docs to mintlify (#541) by @mesejo
  • Update readme (#580) by @hussainsultan
  • Change api (#582) by @dlovell
  • Update dependency ruff to v0.9.8 (#583) by @renovate
  • Replace pydantic AnyURL with attrs (#573) by @mesejo
  • Update dependency ruff to v0.9.9 (#585) by @renovate
  • Update dependency ipython to v9 (#586) by @renovate
  • Update bitnami/minio docker tag to v2025.2.28 (#587) by @renovate
  • Default pdb to ipython TerminalPdb (#590) by @dlovell
  • Update dependency pytest to v8.3.5 (#591) by @renovate
  • Create cache module (#579) by @mesejo
  • Update rust toolchain version (#597) by @mesejo
  • Profile docs& guide (#602) by @ghoersti
  • Update overview page with benefits and painpoints (#607) by @hussainsultan
  • Update for ParquetCacheStorage -> ParquetStorage change (#606) by @dlovell
  • Use connect_env (#611) by @mesejo
  • Update overview page (#615) by @hussainsultan
  • Repr of opaque nodes (#596) by @mesejo
  • Refactor FlightServer code (#616) by @mesejo
  • Update dependency ruff to v0.9.10 (#617) by @renovate
  • Update trinodb/trino docker tag to v472 (#622) by @renovate
  • Bump ring from 0.17.8 to 0.17.13 (#626) by @dependabot
  • Expose datatypes as part of xorq (#578) by @mesejo
  • Enable serde for connections (#630) by @dlovell

Deprecations

  • Remove predict_xgb related code (#562) by @mesejo
  • Remove sqlalchemy dependency (#572) by @mesejo
  • Remove netlify workflows (#576) by @mesejo

0.1.14 (2025-02-20)

Features

  • Add FlightServer (#474) by @mesejo
  • Add ordering arg to register_record_batch_reader (#479) by @mesejo
  • Add ExprScalarUDF (#532) by @dlovell

Bug Fixes

  • Convert name to valid Python identifier (#508) by @mesejo
  • Update rust crate prost to v0.13.5 (#531) by @renovate
  • Ensure stable hash for normalize_read (#549) by @dlovell

Refactors

  • Refactor out hotfixing snowflake (#509) by @mesejo
  • Update trinodb/trino docker tag to v470 (#512) by @renovate
  • Update dependency ruff to v0.9.5 (#514) by @renovate
  • Update bitnami/minio docker tag to v2025.2.7 (#526) by @renovate
  • Update dependency coverage to v7.6.11 (#527) by @renovate
  • Use get_print_logger instead of print (#533) by @dlovell
  • Update dependency coverage to v7.6.12 (#530) by @renovate
  • Update postgres docker tag to v17.3 (#535) by @renovate
  • Register ibis datatypes, raise if not registered (#538) by @mesejo
  • Transform datetime to bytes (#540) by @mesejo
  • Vendor ibis (#529) by @mesejo
  • Update actions/create-github-app-token action to v1.11.5 (#539) by @renovate
  • Update dependency ruff to v0.9.6 (#528) by @renovate
  • Wrap pins with examples (#511) by @mesejo
  • Enable kwargless use of default name (#545) by @dlovell
  • Clean vendoring (#546) by @mesejo
  • Update bitnami/minio docker tag to v2025.2.18 (#554) by @renovate
  • Update trinodb/trino docker tag to v471 (#555) by @renovate
  • Rename to xorq (#550) by @mesejo

Deprecations

  • Remove unwanted dependencies (#551) by @mesejo
  • Remove replace_fix wrapper (#553) by @mesejo

0.1.13 (2025-02-05)

Features

  • Add quickgrove example (#499) by @hussainsultan
  • Add quickgrove to examples optional (#501) by @mesejo

Bug Fixes

  • Update rust crate async-trait to v0.1.86 (#494) by @renovate
  • Update dependency fsspec to v2025 (#495) by @renovate
  • Enable no rust build drv by @dlovell
  • Ls.register: invoke correct method (#500) by @dlovell

Refactors

  • Enable caching bigquery exprs (#486) by @dlovell
  • Snowflake-connector-python security update (#489) by @mesejo
  • Update actions/create-github-app-token action to v1.11.2 (#492) by @renovate
  • Update dependency ruff to v0.9.4 (#493) by @renovate
  • Enable running entirely from pypi by @dlovell
  • Invoke nix fmt by @dlovell
  • Update dependency trino to v0.333.0 (#502) by @renovate
  • Update actions/create-github-app-token action to v1.11.3 (#505) by @renovate
  • Update bitnami/minio docker tag to v2025.2.3 (#507) by @renovate

Deprecations

  • Remove poetry.lock (#488) by @mesejo
  • Remove optimizer module (#506) by @mesejo
  • Remove hotfix for Postgres (#503) by @mesejo
  • Remove hotfix pandas (#504) by @mesejo

0.1.12 (2025-01-29)

Features

  • Add segmentation (#389) by @mesejo
  • Add caching for to_sql (#404) by @mesejo
  • Add hash(string) function (#451) by @mesejo
  • Add get_plans (#447) by @dlovell
  • Add quickgrove udf (#475) by @hussainsultan
  • Add LargeUtf8 as a DataType (#462) by @mesejo
  • Add requirement for letsql-pytest by @dlovell
  • Add stand alone uv + rust shell (#482) by @dlovell

Bug Fixes

  • Update rust crate object_store to v0.11.2 (#422) by @renovate
  • Update rust crate async-trait to v0.1.84 (#425) by @renovate
  • Update dependency dask to v2024.12.1 (#418) by @renovate
  • Update dependency fsspec to >=2024.6.1,<2024.12.1 (#419) by @renovate
  • Update rust crate async-trait to v0.1.85 (#432) by @renovate
  • Update rust crate tokio to v1.43.0 (#438) by @renovate
  • Invoke maturin on changes to rust (#445) by @dlovell
  • Identify correct kwarg for duckdb (#452) by @dlovell
  • Update dependency pyarrow to v19 (#454) by @renovate
  • Update dependency structlog to v25 (#455) by @renovate
  • Update dependency dask to v2025 (#458) by @renovate
  • Failing docs deployment (#465) by @mesejo
  • Fix dependency groups (#448) by @mesejo
  • Get_storage_uncached args (#466) by @mesejo
  • Update dependency attrs to v25 (#473) by @renovate
  • Ensure dependencies are in sync (#480) by @mesejo
  • Update for changes to uv/uv2nix by @dlovell

Refactors

  • Update trinodb/trino docker tag to v468 (#421) by @renovate
  • Update astral-sh/setup-uv action to v5 (#420) by @renovate
  • Update actions/create-github-app-token action to v1.11.1 (#414) by @renovate
  • Update bitnami/minio docker tag to v2024.12.18 (#415) by @renovate
  • Update codecov/codecov-action action to v5.1.2 (#416) by @renovate
  • Update dependency ruff to v0.8.6 (#417) by @renovate
  • Update to datafusion v44 (#435) by @mesejo
  • Update dependency coverage to v7.6.10 (#424) by @renovate
  • Uv lock –upgrade-package jinja2 (#436) by @mesejo
  • Update contributing workflow (#437) by @mesejo
  • Update dependency ruff to v0.9.0 (#439) by @renovate
  • Expose full SessionConfig (#440) by @mesejo
  • Update dependency ruff to v0.9.1 (#441) by @renovate
  • Update dependency trino to v0.332.0 (#449) by @renovate
  • Update dependency ruff to v0.9.2 (#453) by @renovate
  • Update dependency pre-commit to v4.1.0 (#463) by @renovate
  • Update dependency codespell to v2.4.0 (#468) by @renovate
  • Update codecov/codecov-action action to v5.2.0 (#469) by @renovate
  • Update dependency ruff to v0.9.3 (#471) by @renovate
  • Update codecov/codecov-action action to v5.3.1 (#472) by @renovate
  • Enforce import order (#476) by @mesejo
  • Update trinodb/trino docker tag to v469 (#478) by @renovate
  • Update dependency codespell to v2.4.1 (#481) by @renovate
  • Update dependency black to v25 (#483) by @renovate
  • Update bitnami/minio docker tag to v2025 (#484) by @renovate
  • Extend ruff select rules instead of overriding (#485) by @mesejo

Deprecations

  • Remove pre-register (#450) by @mesejo
  • Remove warnings (#457) by @mesejo
  • Remove uv.lock from git diff (#467) by @mesejo
  • Remove MarkedRemoteTable (#459) by @mesejo

0.1.11 (2024-12-17)

Features

  • Add reading parquet from http (#370) by @mesejo
  • Add codspeed (#374) by @mesejo

Bug Fixes

  • Update rust crate datafusion to v43 (#340) by @renovate
  • Update dependency ibis-framework to v9.5.0 (#324) by @renovate
  • Pin dependencies (#359) by @renovate
  • Update rust crate object_store to v0.11.1 (#360) by @renovate
  • Update aws-sdk-rust monorepo to v0.101.0 (#361) by @renovate
  • Update rust crate arrow-ord to v53.3.0 (#368) by @renovate
  • Update rust crate arrow to v53.3.0 (#367) by @renovate
  • Fix performance regression by only parsing metadata once (#373) by @dlovell
  • Update rust crate url to v2.5.4 (#376) by @renovate
  • Update rust crate tokio to v1.42.0 (#386) by @renovate
  • Update dependency dask to v2024.12.0 (#387) by @renovate
  • Dynamically generate none_tokenized (#396) by @dlovell
  • Update rust crate prost to v0.13.4 (#393) by @renovate
  • To_pyarrow_batches (#398) by @mesejo
  • Update dependency datafusion to v43 (#408) by @renovate

Refactors

  • Update dependency ruff to v0.7.4 (#353) by @renovate
  • Update codecov/codecov-action action to v5.0.2 (#355) by @renovate
  • Update dependency coverage to v7.6.7 (#357) by @renovate
  • Pin cargo dependencies version (#358) by @mesejo
  • Update codecov/codecov-action action to v5.0.4 (#363) by @renovate
  • Update codecov/codecov-action action to v5.0.7 (#365) by @renovate
  • Update trinodb/trino docker tag to v465 (#369) by @renovate
  • Update dependency ruff to v0.8.0 (#371) by @renovate
  • Udf.agg.pandas_df: enableuse as a decorator (#375) by @dlovell
  • Use bare datafusion (#346) by @mesejo
  • Update dependency coverage to v7.6.8 (#378) by @renovate
  • Update trinodb/trino docker tag to v466 (#382) by @renovate
  • Update postgres docker tag to v17.2 (#377) by @renovate
  • Update dependency ruff to v0.8.1 (#383) by @renovate
  • Update dependency pytest to v8.3.4 (#384) by @renovate
  • Move to uv (#380) by @mesejo
  • Update trinodb/trino docker tag to v467 (#395) by @renovate
  • Update dependency coverage to v7.6.9 (#392) by @renovate
  • Update codecov/codecov-action action to v5.1.1 (#391) by @renovate
  • Update astral-sh/setup-uv action to v4 (#394) by @renovate
  • Update dependency ruff to v0.8.2 (#390) by @renovate
  • Enable codspeed profiling (#399) by @mesejo
  • Use python 3.12 in codspeed (#400) by @mesejo
  • Update dependency trino to v0.331.0 (#401) by @renovate
  • Enforce letsql as ls alias import (#403) by @mesejo
  • Use cache for compiling rust (#406) by @mesejo
  • Use maturin action with sccache (#410) by @mesejo
  • Update dependency ruff to v0.8.3 (#407) by @renovate
  • Update actions/cache action to v4 (#409) by @renovate
  • Update bitnami/minio docker tag to v2024.12.13 (#411) by @renovate

Deprecations

  • Remove xfail markers, clean warnings (#385) by @mesejo

0.1.10 (2024-11-15)

Features

  • Add test for to_pyarrow and to_pyarrow_batches (#325) by @mesejo
  • Add udwf (#354) by @dlovell

Bug Fixes

  • Update dependency pyarrow to v18 (#319) by @renovate
  • Update dependency ibis-framework to v9.4.0 (#145) by @renovate
  • Update dependency connectorx to v0.4.0 (#334) by @renovate
  • RemoteTable bug (#335) by @mesejo

Refactors

  • Reparametrize caching into storage and invalidation strategy (#278) by @dlovell
  • Update trinodb/trino docker tag to v464 (#326) by @renovate
  • Use vars instead of secrets (#330) by @mesejo
  • Update bitnami/minio docker tag to v2024.10.29 (#327) by @renovate
  • Update dependency ruff to v0.7.2 (#331) by @renovate
  • Use env variables in workflows (#332) by @mesejo
  • Update dependency quartodoc to ^0.7.2 || ^0.9.0 (#333) by @renovate
  • Update dependency ruff to v0.7.3 (#338) by @renovate
  • Update bitnami/minio docker tag to v2024.11.7 (#337) by @renovate
  • Udate python version in pyproject (#351) by @mesejo
  • Update dependency coverage to v7.6.5 (#349) by @renovate
  • Update codecov/codecov-action action to v5 (#350) by @renovate
  • Update postgres docker tag to v17.1 (#352) by @renovate

0.1.9 (2024-10-30)

Bug Fixes

  • Update dependency snowflake-connector-python to v3.12.3 [security] (#312) by @renovate
  • Synchronize dependencies (#317) by @dlovell

Refactors

  • Make git indifferent to changes in use nix/flake (#305) by @dlovell
  • Update dependency ruff to v0.7.1 (#311) by @renovate
  • Ci check for proper package installation (#318) by @mesejo
  • Check proper installation of examples extras (#320) by @mesejo
  • Use letsql execute/to_pyarrow/to_pyarrow_batches (#316) by @mesejo
  • Update dependency pytest-cov to v6 (#322) by @renovate
  • Update trinodb/trino docker tag to v463 (#321) by @renovate

0.1.8 (2024-10-24)

Bug Fixes

  • Fix pre-release workflow (#257) by @mesejo
  • Update dependency fsspec to v2024.9.0 (#255) by @renovate
  • Update dependency datafusion to v40 (#226) by @renovate
  • Update rust crate arrow-ord to v53 (#251) by @renovate
  • Enable build on macos (#260) by @dlovell
  • Enable build on macos (#262) by @dlovell
  • Update rust crate datafusion-common to v42 (#269) by @renovate
  • Fix nix run issues re SSL and macos temp user dirs by @dlovell
  • Fix nix run issues re IPYTHONDIR (#264) by @dlovell
  • Docs deployment (#294) by @mesejo

Refactors

  • Update dependency ruff to v0.6.4 (#258) by @renovate
  • Update changelog command (#259) by @mesejo
  • Update dependency ruff to v0.6.5 (#265) by @renovate
  • Update actions/create-github-app-token action to v1.11.0 (#263) by @renovate
  • Update dependency ruff to v0.6.8 (#273) by @renovate
  • Disable test_examples temporarily (#284) by @mesejo
  • Update dependency coverage to v7.6.3 (#283) by @renovate
  • Update dependency ruff to v0.6.9 (#285) by @renovate
  • Update dependency black to v24.10.0 (#287) by @renovate
  • Update codecov/codecov-action action to v4.6.0 (#286) by @renovate
  • Update to datafusion v42 (#293) by @mesejo
  • Update dependency pre-commit to v4 (#291) by @renovate
  • Update tests and workflows (#299) by @mesejo
  • Only run ruff on repo files (#301) by @dlovell
  • Set postgres env vars (#303) by @mesejo
  • Update dependency ruff to v0.7.0 (#302) by @renovate

Deprecations

  • Remove the requirement of table registration for expr execution (#209) by @dlovell
  • Remove segment_anything (#295) by @mesejo
  • Remove tensor functions (#297) by @mesejo

0.1.7 (2024-09-05)

Bug Fixes

  • Fix typo in README (#241) by @mesejo
  • Update rust crate arrow to v53 (#250) by @renovate

Refactors

  • Update dependency ruff to v0.6.3 (#242) by @renovate
  • Refactor and clean segment anything function (#243) by @mesejo
  • Reading from csv in HTTP, add basic s3 support (#230) by @mesejo
  • Change output of segment_anything to mask and iou_score (#244) by @mesejo
  • Bump quinn-proto from 0.11.6 to 0.11.8 (#249) by @dependabot
  • Update actions/create-github-app-token action to v1.10.4 (#253) by @renovate
  • Bump cryptography from 43.0.0 to 43.0.1 (#254) by @dependabot

0.1.6 (2024-08-29)

Features

  • Add workflow for testing snowflake (#233) by @mesejo
  • Add ci workflow for testing s3 (#235) by @mesejo

Bug Fixes

  • Issues with release to pypi (#228) by @mesejo
  • Registration of in-memory tables (#232) by @mesejo
  • Improve snowflake workflow (#234) by @mesejo
  • Checkout PR ref (#236) by @mesejo
  • Fix dask version (#237) by @mesejo

Refactors

  • Update dependency ruff to v0.6.2 (#229) by @renovate

0.1.5 (2024-08-21)

Features

  • Add pyarrow udaf based on PyAggregator (#108) by @mesejo
  • Add unit tests based on workflow diagram (#110) by @mesejo
  • Add postgres read_parquet (#118) by @mesejo
  • Add wrapper for snowflake backend (#119) by @mesejo
  • Add read_sqlite and read_postgres (#120) by @mesejo
  • Add ibis udf and model registration method (#182) by @hussainsultan
  • Add udf signature and return a partial with model_name (#195) by @hussainsultan
  • Add image and array manipulation functions (#181) by @mesejo
  • Add example predict_xgb.py (#213) by @dlovell
  • Add connectors for using environment variables or fixed examples server (#217) by @dlovell
  • Add workflow for testing library only dependencies (#223) by @mesejo
  • Add duckdb and xgboost as dependencies for examples (#216) by @mesejo

Bug Fixes

  • Register cache tables when executing to_pyarrow (#114) by @mesejo
  • Update dependency fsspec to v2024.6.1 (#144) by @renovate
  • Update rust crate pyo3 to 0.21 (#146) by @renovate
  • Update tokio-prost monorepo to 0.13.1 (#147) by @renovate
  • Update rust crate datafusion range to v40 (#165) by @renovate
  • Update rust crate datafusion-* to v40 (#167) by @renovate
  • Widen dependency dask range to v2024 (#164) by @renovate
  • Enable build on macos by @dlovell
  • Conditionally include libiconv in maturinOverride by @dlovell
  • Update dependency attrs to v24 (#185) by @renovate
  • Return proper type in get_log_path by @dlovell
  • Use pandas backend in SourceStorage by @mesejo
  • Update rust crate datafusion to v41 (#203) by @renovate

Refactors

  • Wrap ibis backends (#115) by @mesejo
  • Unpin pyarrow version (#121) by @mesejo
  • Update README (#125) by @mesejo
  • Use options.backend as ParquetCacheStorage’s default backend (#123) by @mesejo
  • Change to publish on release (#122) by @mesejo
  • Configure Renovate (#124) by @renovate
  • Update dependency black to v24 [security] (#126) by @renovate
  • Update dependency pure-eval to v0.2.3 (#130) by @renovate
  • Update dependency blackdoc to v0.3.9 (#128) by @renovate
  • Update dependency pytest to v7.4.4 (#131) by @renovate
  • Update actions/create-github-app-token action to v1.10.3 (#127) by @renovate
  • Update dependency connectorx to v0.3.3 (#129) by @renovate
  • Update dependency snowflake/snowflake-connector-python to v3.11.0 (#141) by @renovate
  • Update dependency importlib-metadata to v8.1.0 (#139) by @renovate
  • Update dependency ruff to v0.5.4 (#133) by @renovate
  • Update dependency black to v24.4.2 (#136) by @renovate
  • Update dependency sqlalchemy to v2.0.31 (#134) by @renovate
  • Update codecov/codecov-action action to v4.5.0 (#135) by @renovate
  • Update dependency codespell to v2.3.0 (#137) by @renovate
  • Update dependency coverage to v7.6.0 (#138) by @renovate
  • Update dependency sqlglot to v23.17.0 (#142) by @renovate
  • Update dependency pre-commit to v3.7.1 (#140) by @renovate
  • Update dependency structlog to v24.4.0 (#143) by @renovate
  • Update actions/checkout action to v4 (#148) by @renovate
  • Update actions/setup-python action to v5 (#149) by @renovate
  • Update dependency datafusion/datafusion to v39 (#150) by @renovate
  • Update dependency numpy to v2 (#152) by @renovate
  • Update dependency duckb/duckdb to v1 (#151) by @renovate
  • Update dependency pyarrow to v17 (#153) by @renovate
  • Disable pip_requirements manager (#163) by @mesejo
  • Update dependency pytest-cov to v5 (#159) by @renovate
  • Update extractions/setup-just action to v2 (#161) by @renovate
  • Update github artifact actions to v4 (#162) by @renovate
  • Range for datafusion-common (#166) by @renovate
  • Update dependency pytest to v8 (#158) by @renovate
  • Update dependencies ranges (#172) by @mesejo
  • Enable plugin development for backends (#132) by @mesejo
  • Include pre-commit dependencies in renovatebot scan (#176) by @mesejo
  • Update dependency ruff to v0.5.5 (#174) by @renovate
  • Bump object_store from 0.10.1 to 0.10.2 (#175) by @dependabot
  • Update dependency pre-commit to v3.8.0 (#178) by @renovate
  • Lock file maintenance, update Cargo TOML (#179) by @renovate
  • Refactor flake (#180) by @dlovell
  • Use poetry2nix overlays by @dlovell
  • Enable editable install by @dlovell
  • Update dependency ruff to v0.5.6 (#183) by @renovate
  • Update dependency coverage to v7.6.1 (#187) by @renovate
  • Lock file maintenance (#188) by @renovate
  • Collapse ifs by @dlovell
  • Enable nix run to drop into an ipython shell by @dlovell
  • Make key_prefix settable in config/CacheStorage (#196) by @dlovell
  • Update dependency ruff to v0.5.7 (#197) by @renovate
  • Bump aiohttp from 3.9.5 to 3.10.2 (#212) by @dependabot
  • Lock file maintenance (#207) by @renovate
  • Return wrapper with model_name partialized by @hussainsultan
  • Update links to data files (#214) by @mesejo
  • Update dependency ruff to v0.6.0 (#215) by @renovate
  • Update gbdt-rs repo url (#220) by @mesejo
  • Make gbdt-rs dependency unambiguous (#222) by @mesejo
  • Use postgres.connect_examples() and TemporaryDirectory (#219) by @mesejo
  • Update dependency ruff to v0.6.1 (#218) by @renovate

Deprecations

  • Remove warnings and deprecated palmerpenguins package (#113) by @mesejo
  • Remove so that the udf keeps its metadata (#198) by @hussainsultan

0.1.4 (2024-07-02)

Refactors

  • Api letsql api methods (#105) by @mesejo
  • Prepare for release 0.1.4 (#107) by @mesejo
  • 0.1.4 (#109) by @mesejo

0.1.3 (2024-06-24)

Features

  • Add docker start to ci-test by @mesejo
  • Poetry: add poetry checks to .pre-commit-config.yaml by @dlovell
  • Add source cache by default by @mesejo
  • Test_cache: add test_parquet_cache_storage by @dlovell
  • Add rust files by @dlovell
  • Add new cases to DataFusionBackend.register by @dlovell
  • Add client tests for new register types by @dlovell
  • Add faster function for CachedNode removal by @mesejo
  • Add optimizations for predict_xgb in datafusion (#16) by @mesejo
  • Lint: add args to poetry pre-commit invocation (#20) by @dlovell
  • Add TableProvider for ibis Table (#21) by @mesejo
  • Add filter pushdown for ibis.Table TableProvider (#24) by @mesejo
  • Add .sql implementation (#28) by @mesejo
  • Add automatic testing for examples dir (#45) by @mesejo
  • Add docs (#51) by @mesejo
  • Add better snowflake caching (#49) by @dlovell
  • Add docs-preview workflow (#54) by @mesejo
  • Add missing extras to poetry install in docs workflow (#58) by @mesejo
  • Add start of services to workflow (#59) by @mesejo
  • Add docs deploy workflow (#55) by @mesejo
  • Add array functions (#60) by @mesejo
  • Add registering of arbitrary expressions (#64) by @mesejo
  • Add generic functions (#66) by @mesejo
  • Add hashing of duckdb parquet files (#67) by @mesejo
  • Add numeric functions (#80) by @mesejo
  • Add ls accessor for Expr (#81) by @dlovell
  • Add greatest and least functions (#98) by @mesejo
  • Add temporal functions (#99) by @mesejo
  • Add StructColumn and StructField ops (#102) by @mesejo
  • Add SnapshotStorage (#103) by @dlovell

Bug Fixes

  • Filter bug solved by @mesejo
  • Set stable ibis dependency by @mesejo
  • Failing ci by @mesejo
  • Pyproject: specify rev when using git ref, don’t use git@github.com by @dlovell
  • Pyproject: make pyarrow,datafusion core dependencies by @dlovell
  • Run poetry lock --no-update by @dlovell
  • Use _load_into_cache in _put by @mesejo
  • _cached: special case for name == “datafusion” by @dlovell
  • ParquetCacheStorage: properly create cache dir by @dlovell
  • Local cache with parquet storage by @mesejo
  • Fix mac build with missing source files by @hussainsultan
  • Allow for multiple execution of letsql tables (#41) by @mesejo
  • Fix import order using ruff (#37) by @mesejo
  • Mismatched table names causing table not found error (#43) by @mesejo
  • Ensure nonnull-ability of columns works (#53) by @dlovell
  • Explicitly install poetry-plugin-export per warning message (#61) by @dlovell
  • Update make_native_op to replace tables (#75) by @mesejo
  • Normalize_memory_databasetable: incrementally tokenize RecordBatchs (#73) by @dlovell
  • Cannot create table (#74) by @mesejo
  • Handle case of table names during con.register (#77) by @mesejo
  • Use sqlglot to generate escaped name string (#85) by @dlovell
  • Register table on caching nodes (#87) by @mesejo
  • Ensure snowflake tables have their Namespace bound on creation (#91) by @dlovell
  • Change name of parameter in replace_table function (#94) by @mesejo
  • Return native_dts, not sources (#95) by @dlovell
  • Displace offsets in TimestampBucket (#104) by @mesejo

Refactors

  • Improve performance and ux of predict_xgb by @mesejo
  • Improve performance and ux of predict_xgb (#8) by @mesejo
  • Fetch only the required features for the model by @mesejo
  • Fetch only the required features for the model (#9) by @mesejo
  • Organize the letsql package by @mesejo
  • Lint by @dlovell
  • Define CacheStorage with deterministic hashing for keys by @mesejo
  • Define KEY_PREFIX to identify letsql cache by @dlovell
  • Conftest: define expected_tables, enforce test fixture table list by @dlovell
  • Lint by @dlovell
  • Update poetry.lock by @dlovell
  • Enable registration of pyarrow.RecordBatchReader and ir.Expr (#13) by @mesejo
  • Update CONTRIBUTING.md with instructions to run Postgres by @mesejo
  • Register more dask normalize_token types (#17) by @dlovell
  • Enable flake to work on both linux and macos (#18) by @dlovell
  • Clean up development and ci/cd workflows (#19) by @mesejo
  • Temporal readme by @mesejo
  • Publish test coverage (#31) by @mesejo
  • Update project files README, CHANGELOG and pyproject.toml (#30) by @mesejo
  • Expose TableProvider trait in Python (#29) by @mesejo
  • Clear warnings, bump up datafusion version to 37.1.0 (#33) by @mesejo
  • Update ibis version (#34) by @mesejo
  • Xgboost is being deprecated (#40) by @hussainsultan
  • Drop connection handling (#36) by @mesejo
  • Refactor _register_and_transform_cache_tables (#44) by @mesejo
  • Improve postgres table caching / cache invalidation (#47) by @dlovell
  • Make engines optional extras (#50) by @dlovell
  • SourceStorage: special case for cross-source caching (#63) by @dlovell
  • Problem with multi-engine execution (#70) by @mesejo
  • Clean test_execute and move tests from test_isolated_execution (#79) by @mesejo
  • Move cache related tests to test_cache.py (#88) by @mesejo
  • Give ParquetCacheStorage a default path (#92) by @dlovell
  • Update to datafusion version 39.0.0 (#97) by @mesejo
  • Make cache default path configurable (#101) by @mesejo
  • V0.1.3 (#106) by @mesejo

Deprecations

  • Pyproject: remove redundant and conflicting dependency specifications by @dlovell
  • Remove macos test suite by @mesejo
  • Remove optimizer.py (#14) by @mesejo
  • Remove redundant item setting _sources on registering the cache nodes (#90) by @mesejo

0.1.2.post (2024-02-01)

Features

  • Add missing dependencies by @mesejo

0.1.2 (2024-02-01)

Features

  • Add CONTRIBUTING.md
  • Address problems with schema
  • Nix: add flake.nix and related files by @dlovell
  • Add db package for showing predict udf working by @mesejo
  • Add db package for showing predict udf working (#1) by @mesejo

Deprecations

  • Remove xgboost as dependency by @mesejo

0.1.1 (2023-11-09)

Features

  • Add register and client functions
  • Add testing of api
  • Add isnan/isinf and fix offset
  • Add udf support
  • Add new string ops, remove typo

Refactors

  • Test array, temporal, string and udf
  • Start adding wrapper
  • Prepare for release