package ocaml-ai-sdk

  1. Overview
  2. Docs
OCaml AI SDK - Provider abstraction for AI models

Install 

dune-project
 Dependency

github.com Readme Changelog Edit opam file Versions (8)

Authors

  1. A
    Ahrefs

Maintainers

  1. J
    José Nogueira <jose.nogueira@ahrefs.com>

Sources

ocaml-ai-sdk-0.6.tbz
sha256=44e7f6ebef6da2828ec2844dd5b38c8f37284c08e54a29e06f6a8822df6f8e10
sha512=ce31d0868abf28bcaef7b24a0ab09b37dcfc94db3de96b38ff36a03800ae59a19e8009a35314f93191b3c8f178c40f8569630d4389f56ddc2f2cc94fb7bffc3c

doc/ocaml-ai-sdk.ai_provider/Ai_provider/Http_timeouts/index.html

Module Ai_provider.Http_timeoutsSource

HTTP timeout configuration.

These are conservative defaults meant to catch stuck connections and bugs, not to bound legitimate workloads. A 20-minute streaming response is fine as long as chunks keep arriving: stream_idle_timeout is inter-chunk, not cumulative.

Sourcetype t = private {
  1. request_timeout : float;
    (*

    Seconds until response headers arrive. Covers TCP connect, TLS handshake, request body write, and the server's processing time before it starts the response. Default: 600.0 (10 minutes).

    *)
  2. stream_idle_timeout : float;
    (*

    Seconds allowed between consecutive streaming body chunks. Resets on each chunk. Default: 300.0 (5 minutes).

    *)
}
Sourceval default : t

request_timeout = 600.0; stream_idle_timeout = 300.0.

Sourceval create : ?request_timeout:float -> ?stream_idle_timeout:float -> unit -> t

Override one or both defaults. Values must be positive; non-positive values raise Invalid_argument.