package chatoyant

  1. Overview
  2. Docs
OCaml-first LLM SDK with Melange-generated JavaScript

Install 

dune-project
 Dependency

github.com Readme Changelog Edit opam file Versions (4)

Authors

  1. A
    Anonyfox <max@anonyfox.com>

Maintainers

  1. A
    Anonyfox <max@anonyfox.com>

Sources

chatoyant-v0.12.2.tbz
sha256=a885dcf4b3c6ede268e2027bedf6955a5c889f7ed01c40b719f8369655957d47
sha512=0bb8dfa12157ba2e482927717c2242c1ea914dce1427801e405987811550afbd6d6b11f07d1e1379259360d17f4ca43ff81963bf407cddb7bedd0dfbb93a55ee

doc/chatoyant.tokens/Chatoyant_tokens/Chunking/index.html

Module Chatoyant_tokens.ChunkingSource

Text and message chunking helpers for context management.

Sourcetype options = {
  1. max_tokens : int;
  2. overlap : int;
  3. separator : string option;
}
Sourceval split_text : ?overlap:int -> ?separator:string -> max_tokens:int -> string -> string list
Sourceval truncate_content : ?ellipsis:string -> max_tokens:int -> string -> string
Sourceval fit_messages : ?provider:Message_budget.provider -> max_tokens:int -> ?reserve_for_response:int -> Message_budget.message list -> Message_budget.message list
Sourceval paginate_messages : ?provider:Message_budget.provider -> tokens_per_page:int -> Message_budget.message list -> Message_budget.message list list
Sourceval estimate_chunk_count : chunk_size:int -> string -> int