Skip to content

feat: add llmman sample as a local model provider - #627

Merged
HavenDV merged 1 commit into
tryAGI:mainfrom
ericcurtin:llmman
Sep 8, 2026
Merged

HavenDV merged 1 commit into
tryAGI:mainfrom
ericcurtin:llmman

Conversation

@ericcurtin

@ericcurtin ericcurtin commented Sep 4, 2026 •

Copy link
Copy Markdown
Contributor

Adds llmman, a local model runner that serves Ollama-, OpenAI- and Anthropic-compatible APIs on port 17434.

  • This repo integrates Ollama in the examples via its OpenAI-compatible /v1 endpoint rather than a provider package, so llmman is added the same way.
  • examples/LangChain.Samples.Llmman: minimal chat sample modelled on LangChain.Samples.OpenAI, pointing OpenAIClient at http://127.0.0.1:17434/v1 (model gemma4). Honours LLMMAN_HOST ([host][:port]) like OLLAMA_HOST; uses a placeholder API key since llmman needs none.
  • LangChain.slnx: registers the sample under /Samples/ (alphabetical).
  • examples/LangChain.Samples.LocalRAG/Program.cs: one-line comment that llmman serves the same API on port 17434.

Testing: .NET SDK 10.0.400: dotnet build of the new sample and LangChain.Samples.LocalRAG (0 warnings, 0 errors), dotnet format --verify-no-changes on the new project, dotnet sln LangChain.slnx list resolves it. Not run against a live llmman server.

AI-assisted, reviewed before submitting.

@CLAassistant

Copy link
Copy Markdown

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
You have signed the CLA already but the status is still pending? Let us recheck it.

llmman (https://github.com/llmmanorg/llmman) is a local model runner
serving Ollama-, OpenAI- and Anthropic-compatible APIs on port 17434.
This repo integrates Ollama via its OpenAI-compatible /v1 endpoint in
the examples, so llmman is added the same way: a minimal chat sample
modelled on LangChain.Samples.OpenAI honouring LLMMAN_HOST, registered
in LangChain.slnx, plus a one-line pointer in the LocalRAG sample.

Signed-off-by: Eric Curtin <eric.curtin@docker.com>
@HavenDV
HavenDV merged commit 841e863 into tryAGI:main Sep 8, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants