Skip to content

fix(providers): disable AsyncOpenAI keep-alive reuse to avoid SSL UNEXPECTED_EOF on idle-reaping gateways #205

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
raymondginger2018-sudo wants to merge 1 commit into from
Closed

fix(providers): disable AsyncOpenAI keep-alive reuse to avoid SSL UNEXPECTED_EOF on idle-reaping gateways #205

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 8 additions & 0 deletions core/providers/openai_compat.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -30,6 +30,8 @@
)
from openai import AsyncOpenAI

import httpx

from core.providers.base import (
LLMProvider,
LLMResponse,
Expand Down Expand Up @@ -259,6 +261,12 @@ def __init__(
default_headers=default_headers,
max_retries=0,
timeout=_get_default_request_timeout_s(),
# 禁用 keep-alive 连接复用：第三方网关(如 scnet)会回收空闲连接，
# 复用被回收的死连接会触发 SSL: UNEXPECTED_EOF_WHILE_READING。
# 每次请求新建连接，代价 ~50-100ms 握手，对 LLM 秒级请求可忽略。
http_client=httpx.AsyncClient(
limits=httpx.Limits(max_keepalive_connections=0),
),
)

# Responses API circuit breaker: skip after repeated failures,
Expand Down
Loading