package chatoyant

  1. Overview
  2. Docs
OCaml-first LLM SDK with Melange-generated JavaScript

Install 

dune-project
 Dependency

github.com Readme Changelog Edit opam file Versions (4)

Authors

  1. A
    Anonyfox <max@anonyfox.com>

Maintainers

  1. A
    Anonyfox <max@anonyfox.com>

Sources

chatoyant-v0.12.4.tbz
sha256=fbf19dea0d39482e0263812504d94c682a9f3a6e93f68fe0c57b2d38ed4166b3
sha512=4e01be9c0ec9c16880f98360dec4ef5e0dddd9192e2113991b154e891b3bdaefb614051c2cb63afa0b714efa0e4cc4fd8054528fdc1995f3a4858fe2fcd50256

doc/chatoyant.provider/Chatoyant_provider/Local/index.html

Module Chatoyant_provider.LocalSource

Local OpenAI-compatible provider.

Targets local inference servers such as Ollama, LM Studio, mlx-lm/oMLX, llama.cpp server, and vLLM. The public surface stays provider-specific; compatibility quirks are handled internally.

Sourcetype responses_request = Openai.responses_request
Sourcetype responses_response = Openai.responses_response
Sourcetype image_request = Openai.image_request
Sourcetype image_response = Openai.image_response
Sourcetype embedding_request = Openai.embedding_request
Sourcetype embedding_response = Openai.embedding_response
Sourceval chat_request_json : request -> Chatoyant_runtime.Json.t
Sourceval responses_request_json : responses_request -> Chatoyant_runtime.Json.t
Sourceval image_request_json : image_request -> Chatoyant_runtime.Json.t
Sourceval embedding_request_json : embedding_request -> Chatoyant_runtime.Json.t
Sourceval authorization_headers : ?api_key:string -> unit -> (string * string) list
Sourceval chat_response_of_stream_chunks : string list -> (response, string) result
Sourceval response_of_stream_chunks : string list -> (responses_response, string) result