Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -158,6 +158,7 @@ zerogpu chat "Port this helper to async/await." -m deepseek-v4-flash-0731
| `LFM2.5-1.2B-Thinking` | Compact reasoning model. |
| `gpt-oss-120b` | 120B MoE, 131K context, reasoning + function calling. |
| `llama-guard-4-12b` | 12B dense, 164K context, brand safety + text moderation. |
| `deepseek-v4.1-flash` | Sparse MoE (8B active on input, 16B on output), 1M context, long-context agentic work + function calling. |
| `qwen3-30b-a3b-fp8` | 30B MoE, 100+ languages, reasoning + function calling. |
| `glm-5.2` | 753B MoE, 262K context, reasoning + function calling. The platform's most capable model, and its priciest. |
| `deepseek-v4-flash-0731` | 284B MoE (13B active), 1M context, coding and agentic workflows. |
Expand Down
3 changes: 2 additions & 1 deletion docs/DOCUMENTATION.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@
`zerogpu-cli` is the official command-line interface for [ZeroGPU](https://zerogpu.ai), a distributed / edge inference platform for small language models (SLMs) and nano language models. The CLI is a thin, OpenAI-compatible client around the ZeroGPU **Responses API** (`https://api.zerogpu.ai/v1/responses`) — and, for models served only there, the **Chat Completions API** (`https://api.zerogpu.ai/v1/chat/completions`) — that lets you call a curated set of edge-optimized models directly from your terminal for common NLP workloads:

- Conversational chat (`LFM2.5-1.2B-Instruct`, `LFM2.5-1.2B-Thinking`)
- Reasoning and tool-use chat (`gpt-oss-120b`, `llama-guard-4-12b`, `qwen3-30b-a3b-fp8`, `glm-5.2`, `deepseek-v4-flash-0731`)
- Reasoning and tool-use chat (`gpt-oss-120b`, `llama-guard-4-12b`, `deepseek-v4.1-flash`, `qwen3-30b-a3b-fp8`, `glm-5.2`, `deepseek-v4-flash-0731`)
- IAB content/audience classification (`zlm-v1-iab-classify-edge`, `zlm-v2-iab-classify-edge-enriched`)
- Domain-level IAB classification (`zlm-v1-iab-domain-classifier`)
- Zero-shot classification (`deberta-v3-small`)
Expand Down Expand Up @@ -213,6 +213,7 @@ zerogpu chat <text> [-i <instructions>] [-m <model>] [-r]
| `LFM2.5-1.2B-Thinking` | Responses | Compact reasoning model. |
| `gpt-oss-120b` | Responses | 120B MoE, 131K context, reasoning + function calling. |
| `llama-guard-4-12b` | Responses | 12B dense, 163,840-token context, brand safety + text moderation. |
| `deepseek-v4.1-flash` | Responses | Sparse MoE (8B active on input, 16B on output), 1,048,576-token context, long-context agentic work + function calling. |
| `qwen3-30b-a3b-fp8` | Chat Completions | 30B MoE, 100+ languages, reasoning + function calling. |
| `glm-5.2` | Chat Completions | 753B MoE, 262,144-token context, reasoning + function calling. The most capable model on the platform, and the most expensive by an order of magnitude. |
| `deepseek-v4-flash-0731` | Chat Completions | 284B MoE (13B active), 1,048,576-token context, coding and agentic workflows. |
Expand Down
4 changes: 2 additions & 2 deletions package-lock.json

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

2 changes: 1 addition & 1 deletion package.json
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
{
"name": "zerogpu-cli",
"version": "3.9.0",
"version": "3.10.0",
"description": "Command-line interface for ZeroGPU.",
"type": "module",
"bin": {
Expand Down
1 change: 1 addition & 0 deletions src/commands/chat.ts
Original file line number Diff line number Diff line change
Expand Up @@ -25,6 +25,7 @@ const CHAT_MODELS: Record<string, "responses" | "chat-completions"> = {
"LFM2.5-1.2B-Thinking": "responses",
"gpt-oss-120b": "responses",
"llama-guard-4-12b": "responses",
"deepseek-v4.1-flash": "responses",
"qwen3-30b-a3b-fp8": "chat-completions",
"glm-5.2": "chat-completions",
"deepseek-v4-flash-0731": "chat-completions",
Expand Down
1 change: 1 addition & 0 deletions src/lib/savings.ts
Original file line number Diff line number Diff line change
Expand Up @@ -23,6 +23,7 @@ export const ZGPU_PRICING: Record<string, { in: number; out: number }> = {
"gpt-oss-120b": { in: 0.15, out: 0.6 },
"qwen3-30b-a3b-fp8": { in: 0.05, out: 0.3 },
"glm-5.2": { in: 1.1, out: 3.5 },
"deepseek-v4.1-flash": { in: 0.3, out: 1.2 },
"deepseek-v4-flash-0731": { in: 0.16, out: 0.38 },
"llama-guard-4-12b": { in: 0.18, out: 0.18 },
"llama-3.1-8b-instruct-fast": { in: 0.02, out: 0.05 },
Expand Down
1 change: 1 addition & 0 deletions tests/savings.test.ts
Original file line number Diff line number Diff line change
Expand Up @@ -114,6 +114,7 @@ describe("ZGPU_PRICING tracks the published model catalog", () => {
"gpt-oss-120b": { in: 0.15, out: 0.6 },
"qwen3-30b-a3b-fp8": { in: 0.05, out: 0.3 },
"glm-5.2": { in: 1.1, out: 3.5 },
"deepseek-v4.1-flash": { in: 0.3, out: 1.2 },
"deepseek-v4-flash-0731": { in: 0.16, out: 0.38 },
"llama-guard-4-12b": { in: 0.18, out: 0.18 },
"llama-3.1-8b-instruct-fast": { in: 0.02, out: 0.05 },
Expand Down