package chatoyant

  1. Overview
  2. Docs
OCaml-first LLM SDK with Melange-generated JavaScript

Install 

dune-project
 Dependency

github.com Readme Changelog Edit opam file Versions (4)

Authors

  1. A
    Anonyfox <max@anonyfox.com>

Maintainers

  1. A
    Anonyfox <max@anonyfox.com>

Sources

chatoyant-v0.12.2.tbz
sha256=a885dcf4b3c6ede268e2027bedf6955a5c889f7ed01c40b719f8369655957d47
sha512=0bb8dfa12157ba2e482927717c2242c1ea914dce1427801e405987811550afbd6d6b11f07d1e1379259360d17f4ca43ff81963bf407cddb7bedd0dfbb93a55ee

doc/chatoyant.tokens/Chatoyant_tokens/Token_estimate/index.html

Module Chatoyant_tokens.Token_estimateSource

Heuristic token estimation.

These functions intentionally mirror the current TypeScript package's zero-dependency token estimates. They are fast approximations, not provider tokenizer bindings.

Sourcetype content_kind =
  1. | English
  2. | Code
  3. | Cjk
  4. | Mixed
Sourcetype prompt_estimate = {
  1. input : int;
  2. output : int;
  3. total : int;
}
Sourceval chars_per_token : content_kind -> float
Sourceval classify : string -> content_kind
Sourceval estimate : string -> int
Sourceval estimate_prompt : ?response:string -> string -> prompt_estimate
Sourceval estimate_many : string list -> int
Sourceval estimate_with_ratio : chars_per_token:float -> string -> int