Skip to content

RFC-0022: Inference backend architecture - #43

Draft
jsilvanus wants to merge 1 commit into
mainfrom
rfc/inference-backend-architecture
Draft

jsilvanus wants to merge 1 commit into
mainfrom
rfc/inference-backend-architecture

Conversation

@jsilvanus

Copy link
Copy Markdown
Owner

Adds RFC-0022 defining the capability-oriented inference backend architecture beneath RFC-0020. It covers the common backend boundary, capability-specific interfaces, generic tensor inference, GGUF/llama.cpp, ONNX Runtime, lifecycle/resource boundaries, and the open architectural decisions that should be settled before implementation.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant