Skip to content

Update to DataFusion 55 / arrow-flight 59 - #63

Merged
hozan23 merged 1 commit into
mainfrom
feat/datafusion-55
Sep 12, 2026
Merged

hozan23 merged 1 commit into
mainfrom
feat/datafusion-55

Conversation

@backkem

@backkem backkem commented Sep 12, 2026

Copy link
Copy Markdown
Collaborator

Stacked on #62 (issue 60) — base is fix/federation-dev-dependency, not main.

[workspace.dependencies] bumps: datafusion and datafusion-substrait 54.0 → 55.1, arrow-flight 58.3 → 59.3, datafusion-federation 0.5.5 → 0.5.6. tonic and prost stay on 0.14.

One source change: datafusion_substrait::serializer::deserialize_bytes is now sync and takes &[u8] instead of Vec<u8>. Single call site, parse_substrait_bytes in service.rs.

This also fixes a latent build break on main. Cargo.lock is gitignored, so every CI run resolves fresh; the datafusion-federation = "0.5.5" caret requirement now resolves to 0.5.6, which requires datafusion = "55" while the workspace pinned 54. Cargo builds both trees, and datafusion-flight-sql-table-provider fails with four E0053 mismatches on SQLExecutor (two datafusion_sql versions). Bumping to 55.1 collapses the graph to one version.

Verified locally: cargo build --workspace, cargo build --examples, cargo clippy --workspace --all-targets and cargo fmt --check clean; cargo test --workspace 14 passed, 0 failed.

Closes #61

Bump datafusion and datafusion-substrait to 55.1, arrow-flight to 59.3
and datafusion-federation to 0.5.6. Adapt to deserialize_bytes becoming
sync and taking &[u8]. Fixes #61
Base automatically changed from fix/federation-dev-dependency to main September 12, 2026 19:55
@hozan23
hozan23 merged commit 1f5a384 into main Sep 12, 2026
14 checks passed
@alamb

alamb commented Sep 13, 2026

Copy link
Copy Markdown
Contributor

Thank you @backkem and @hozan23 🙏

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Update to DataFusion 55 / arrow 59

3 participants