package chatoyant

  1. Overview
  2. Docs
OCaml-first LLM SDK with Melange-generated JavaScript

Install 

dune-project
 Dependency

github.com Readme Changelog Edit opam file Versions (4)

Authors

  1. A
    Anonyfox <max@anonyfox.com>

Maintainers

  1. A
    Anonyfox <max@anonyfox.com>

Sources

chatoyant-v0.12.4.tbz
sha256=fbf19dea0d39482e0263812504d94c682a9f3a6e93f68fe0c57b2d38ed4166b3
sha512=4e01be9c0ec9c16880f98360dec4ef5e0dddd9192e2113991b154e891b3bdaefb614051c2cb63afa0b714efa0e4cc4fd8054528fdc1995f3a4858fe2fcd50256

doc/chatoyant.tokens/Chatoyant_tokens/Message_budget/index.html

Module Chatoyant_tokens.Message_budgetSource

Chat message token estimation and fitting.

Sourcetype provider =
  1. | Openai
  2. | Anthropic
  3. | Xai
Sourcetype message = {
  1. role : string;
  2. content : string option;
  3. name : string option;
}
Sourcetype overhead = {
  1. per_message : int;
  2. conversation : int;
}
Sourceval get_overhead : ?provider:provider -> unit -> overhead
Sourceval estimate_message : ?provider:provider -> message -> int
Sourceval estimate_chat : ?provider:provider -> message list -> int
Sourceval estimate_system_prompt : ?provider:provider -> string -> int
Sourceval available_tokens : context_window:int -> ?system_prompt_tokens:int -> ?reserve_for_response:int -> ?history_tokens:int -> unit -> int
Sourceval fits : ?provider:provider -> max_tokens:int -> message list -> bool
Sourceval fit : ?provider:provider -> max_tokens:int -> reserve_for_response:int -> message list -> message list