[cretz]

🚀 What

• Default low-level HTTP clients (inference, management, sandbox; sync and async) no longer have a read timeout, matching the JS and Go and Blaxel clients
• Fixes httpx's 5s default breaking long-held calls (slow inference, waiting process runs, log streams, filesystem watch, process wait)

💻 How

• Pass httpx.Timeout(5.0, read=None) when creating the default client; connect, write, and pool keep httpx's 5s
• Clients passed via http_client_override are unchanged

🔬 Testing

• None added; config-only change

[Copilot]

🟢 Approval recommended

No active review issues remain for the changes disabling read timeouts on the SDK’s default HTTP clients.

No open issues 🎉

What changed in this PR

Disables read timeouts on the SDK’s default low-level HTTP clients so long-running requests and streams are not interrupted by httpx’s five-second read timeout.

Changes:

• Applies httpx.Timeout(5.0, read=None) to synchronous and asynchronous inference, management, and sandbox clients.
• Preserves five-second connect, write, and pool timeouts.
• Leaves clients supplied through http_client_override unchanged.

File	Description
baseten/​client/​_sandbox.py	Disables default read timeouts for sandbox calls and streams.
baseten/​client/​_management.py	Disables default read timeouts for management requests.
baseten/​client/​_inference.py	Disables default read timeouts for long-running inference requests.

_{Review effort: Balanced}

[cretz]

Doing admin bypass, the sandbox tests are too flaky