package ocaml-ai-sdk

  1. Overview
  2. Docs
OCaml AI SDK - Provider abstraction for AI models

Install 

dune-project
 Dependency

github.com Readme Changelog Edit opam file Versions (9)

Authors

  1. A
    Ahrefs

Maintainers

  1. J
    José Nogueira <jose.nogueira@ahrefs.com>

Sources

ocaml-ai-sdk-0.6.3.tbz
sha256=0cc0a957784c295877b6bcc4f80c0dba0f6507d3c282e7d6cbd71038050376de
sha512=f8e082376b4de194a877d0df193892cdaa8139a4789f51eebac651acf8b6d4064b95242e158d86c1a32776d99130d43ed4c1119e2d54e738e93bdba2a6ad9a33

doc/ocaml-ai-sdk.ai_core/Ai_core/Retry/index.html

Module Ai_core.RetrySource

Retry with exponential backoff for provider calls.

Wraps a thunk and retries on retryable Provider_error exceptions and transient network errors (Unix.Unix_error with ECONNRESET, ETIMEDOUT, etc.). Other errors are re-raised immediately. Matches upstream AI SDK retry behavior.

Sourcetype retry_reason =
  1. | Max_retries_exceeded
  2. | Error_not_retryable
Sourcetype retry_error = {
  1. message : string;
  2. reason : retry_reason;
  3. errors : exn list;
}
Sourceexception Retry_error of retry_error
Sourceval reason_to_string : retry_reason -> string
Sourceval with_retries : ?max_retries:int -> ?initial_delay_ms:int -> ?backoff_factor:int -> ?max_retry_delay_ms:int -> ?sleep:(float -> unit Lwt.t) -> ?random:(unit -> float) -> (unit -> 'a Lwt.t) -> 'a Lwt.t

Retry a thunk with exponential backoff.

  • parameter max_retries

    Number of additional attempts after the initial call (default 2, matching upstream). Total attempts = 1 + max_retries. Set to 0 to disable retries (only the initial call is made).

  • parameter initial_delay_ms

    Initial delay in milliseconds (default 2000).

  • parameter backoff_factor

    Multiplier applied to delay after each retry (default 2).

A server retry_after_s hint on the error, when present and reasonable, REPLACES the exponential backoff for that attempt (it may shorten as well as lengthen the delay — it is not a lower bound). Following upstream, a hint of ms milliseconds is reasonable iff ms >= 0 and either ms < 60000 or ms is below the un-jittered exponential delay for this attempt. Rejected hints fall back to the jittered exponential backoff. Jitter never applies to an accepted hint.

  • parameter max_retry_delay_ms

    Optional maximum retry sleep. An ordinary (backoff) delay above this limit is clamped down to it; an accepted server hint above this limit instead stops retrying immediately, without sleeping or issuing another request.

  • parameter sleep

    Function called to sleep between retries (default Lwt_unix.sleep).

  • parameter random

    Random source in [0, 1)] used for bounded jitter.