go-llm/README.md

go-llm

Go Library for chat LLM calls (gitea.neitzel.de/konrad/go-llm). Domain language is in CONTEXT.md. Decisions live in the Workspace at docs/adr/go-llm/.

v1: Chat, Stream, List Models, temperature, and max tokens. Adapters: Ollama native (/api/chat, /api/tags) and OpenAI-compatible (/v1/chat/completions, /v1/models). No embeddings, tools, raw generate, Nextcloud types, or story types.

client, err := gollm.NewClient(gollm.AdapterOpenAI, "http://localhost:8000", "")
text, err := client.Chat(ctx, []gollm.Message{{Role: gollm.RoleUser, Content: "Hello"}}, gollm.Options{Model: "llama"})