Skip to content

fix(core): read hudi-defaults.conf from the local filesystem - #997

Draft
yihua wants to merge 1 commit into
apache:mainfrom
yihua:fix/hudi-defaults-local-read
Draft

yihua wants to merge 1 commit into
apache:mainfrom
yihua:fix/hudi-defaults-local-read

Conversation

@yihua

@yihua yihua commented Nov 9, 2026 •

Copy link
Copy Markdown
Contributor

Description

closes #995

hudi-defaults.conf was read through the table's object store at its local path, so for a table on S3, GCS or Azure every table open sent a GET for etc/hudi/conf/hudi-defaults.conf into the table's bucket instead of reading the local file. It is now read from the local filesystem, which also makes a relative HUDI_CONF_DIR work. A file placed at that key in a table's bucket is no longer applied. hudi-core now enables tokio's fs feature.

Impact: one request fewer per table open, so two fewer for a cold open and plan of a table with a metadata table (both tables are opened). In a request trace of a cold open and plan on a metadata-enabled test fixture, these were 2 of the 33 requests, each waiting on the one before.

How are the changes test-covered

  • N/A
  • Automated tests (unit and/or integration tests)
  • Manual tests
    • Details are described below

A new test resolves options with a relative HUDI_CONF_DIR and fails on the old read path. The existing get_global_table_props test covers the absolute, missing and unset cases.

The global config file was read through the table's object store at its
local path, so a table on cloud storage sent a GET for
etc/hudi/conf/hudi-defaults.conf into its bucket on every open instead of
reading the local file. Read it from the local filesystem, which also lets
a relative HUDI_CONF_DIR work.
@codecov

codecov Bot commented Nov 9, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 90.94%. Comparing base (6ba42e7) to head (7f9bfc5).

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #997      +/-   ##
==========================================
- Coverage   90.96%   90.94%   -0.03%     
==========================================
  Files         154      154              
  Lines       22070    22068       -2     
==========================================
- Hits        20076    20069       -7     
- Misses       1994     1999       +5     

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Read hudi-defaults.conf from the local filesystem, not the table's object store

1 participant