package chatoyant

  1. Overview
  2. Docs
OCaml-first LLM SDK with Melange-generated JavaScript

Install 

dune-project
 Dependency

github.com Readme Changelog Edit opam file Versions (4)

Authors

  1. A
    Anonyfox <max@anonyfox.com>

Maintainers

  1. A
    Anonyfox <max@anonyfox.com>

Sources

chatoyant-v0.12.4.tbz
sha256=fbf19dea0d39482e0263812504d94c682a9f3a6e93f68fe0c57b2d38ed4166b3
sha512=4e01be9c0ec9c16880f98360dec4ef5e0dddd9192e2113991b154e891b3bdaefb614051c2cb63afa0b714efa0e4cc4fd8054528fdc1995f3a4858fe2fcd50256

doc/chatoyant.core/Chatoyant_core/Result/index.html

Module Chatoyant_core.ResultSource

Normalized generation metadata.

Sourcetype timing = {
  1. latency_ms : int;
  2. time_to_first_token_ms : int option;
}
Sourcetype token_speed = {
  1. output_tokens_per_second : float option;
  2. total_tokens_per_second : float option;
  3. measured_output_tokens : int;
  4. measured_total_tokens : int;
}

Throughput derived only from real elapsed time and reported/estimated token counts. Values are None when the denominator or numerator is zero.

Sourcetype cost = {
  1. estimated_usd : float;
  2. actual_usd : float option;
}
Sourcetype generation = {
  1. content : string;
  2. reasoning_content : string;
  3. usage : Chatoyant_tokens.Cost.usage;
  4. usage_source : Chatoyant_tokens.Cost.source;
  5. timing : timing;
  6. token_speed : token_speed;
  7. cost : cost;
  8. provider : Chatoyant_provider.Provider.id;
  9. model : string;
  10. tool_calls : Chatoyant_provider.Provider.tool_call list;
  11. finish_reason : string option;
  12. cached : bool;
  13. iterations : int;
}
Sourceval empty_timing : timing
Sourceval empty_token_speed : token_speed
Sourceval empty_cost : cost
Sourceval token_speed : latency_ms:int -> Chatoyant_tokens.Cost.usage -> token_speed
Sourceval timing_to_json : timing -> Chatoyant_runtime.Json.t
Sourceval token_speed_to_json : token_speed -> Chatoyant_runtime.Json.t
Sourceval cost_to_json : cost -> Chatoyant_runtime.Json.t
Sourceval generation_to_json : generation -> Chatoyant_runtime.Json.t