feat(sync): Cloudflare AI Gateway model catalog sync#3317
Conversation
Reuse Workers AI sync secrets against /compat/models (gateway default). Hybrid sync: API membership + list prices; capabilities via base_model. Refresh catalog: add missing OpenAI/Workers AI models, drop nemotron.
factorBaseModel was called with context:0 when the gateway has no limit override, which tripped baseModelOmit and stripped inherited limit.input. Inherit the base metadata context instead.
|
Now I have all the information I need. Let me compile my findings. Action items
|
Summary
cloudflare-ai-gatewaysync module (bun models:sync cloudflare-ai-gateway/cloudflaregroup).CLOUDFLARE_WORKERS_AI_SYNC_ACCOUNT_ID/CLOUDFLARE_WORKERS_AI_SYNC_API_TOKEN) againstGET /compat/modelson gatewaydefault.reasoning_optionscome frombase_model/ existing TOMLs / source OpenAI·Anthropic·Workers AI files (endpoint is too thin for full authoring).nemotron-3-120b-a12bno longer served), cost/format updates on a few existing entries. 82 → 106 models.Evidence
defaultreturned 2361 models.openai/*,anthropic/*(single-segment),workers-ai/@cf/*(skips whisper/aura-1)./compat/models), https://developers.cloudflare.com/ai-gateway/usage/rest-api/Test plan
bun models:sync cloudflare-ai-gateway(live)bun validatebun models:sync --list-providersincludescloudflare-ai-gateway