Issue 4797:Prevent thread leak when BookKeeper client constructor fails - #4798
Open
kroosxu wants to merge 6 commits into
Open
Issue 4797:Prevent thread leak when BookKeeper client constructor fails#4798kroosxu wants to merge 6 commits into
kroosxu wants to merge 6 commits into
Conversation
kroosxu
force-pushed
the
bkClient-resource-leak
branch
from
July 8, 2026 03:42
0c2a1c1 to
519e7b1
Compare
wenbingshen
approved these changes
Jul 22, 2026
Author
|
Hi @lhotari @merlimat @hangc0276 @StevenLuMT , can you please take a look? |
There was a problem hiding this comment.
Pull request overview
This PR addresses a resource/thread leak in BookKeeper client construction by ensuring that resources allocated before a constructor failure are released, and adds a regression test to verify that repeated failed builds do not accumulate client worker threads.
Changes:
- Invoke
close()when constructor initialization fails during metadata driver initialization or ledger manager factory initialization. - Make
close()tolerant of partially-initialized instances by null-guarding key fields before dereference. - Add
BookKeeperConstructorFailureTestto detect thread accumulation across repeated failingbuild()attempts.
Reviewed changes
Copilot reviewed 2 out of 2 changed files in this pull request and generated 2 comments.
| File | Description |
|---|---|
| bookkeeper-server/src/main/java/org/apache/bookkeeper/client/BookKeeper.java | Adds constructor cleanup on specific failure paths and hardens close() against partially-initialized state. |
| bookkeeper-server/src/test/java/org/apache/bookkeeper/client/BookKeeperConstructorFailureTest.java | Adds regression coverage to ensure repeated failed builds don’t accumulate client executor threads. |
Comments suppressed due to low confidence (1)
bookkeeper-server/src/main/java/org/apache/bookkeeper/client/BookKeeper.java:468
- close() can throw InterruptedException (and BKException per signature), which would override the original MetadataException and change the exception observed by callers. Consider making the cleanup best-effort here (suppress close() failures and preserve interrupt status) so the original initialization error is what’s thrown.
} catch (MetadataException me) {
log.error().exception(me).log("Encountered metadata exceptions on initializing metadata client driver");
close();
throw new IOException("Failed to initialize metadata client driver", me);
}
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
Comment on lines
458
to
463
| @@ -459,9 +459,11 @@ public BookKeeper(ClientConfiguration conf, ZooKeeper zk, EventLoopGroup eventLo | |||
| log.error() | |||
| .exception(ce) | |||
| .log("Failed to initialize metadata client driver using invalid metadata service uri"); | |||
| close(); | |||
| throw new IOException("Failed to initialize metadata client driver", ce); | |||
Comment on lines
536
to
543
| } catch (MetadataException e) { | ||
| close(); | ||
| throw new IOException("Failed to initialize ledger manager factory", e); | ||
| } |
zymap
reviewed
Jul 30, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Descriptions of the changes in this PR:
Fix #4797
Motivation
When
BookKeeper.forConfig(conf).build()fails part-way through construction(for example because
metadataServiceUripoints to an unreachable or invalidZooKeeper ensemble, or
MetadataDrivers#getClientDriver(URI)cannot resolvea driver for the configured scheme), the constructor leaks every resource it
has already allocated up to the point of failure.
Changes
In the
BookKeeperconstructor, when initialization fails after theworker pools have been created but before the object is
fully constructed, invoke
close()on the partially-initialized instanceso that all already-allocated resources are
shut down before the exception is propagated to the caller.
Add
BookKeeperConstructorFailureTestunderbookkeeper-server/src/test/java/org/apache/bookkeeper/client/coveringthe regression:
testRepeatedFailedBuildsDoNotAccumulateThreads— 5 consecutivefailing
build()calls must not accumulate threads.