package ocaml-ai-sdk

You can search for identifiers within the package.

in-package search v0.2.0

OCaml AI SDK - Provider abstraction for AI models

Install

dune-project

Dependency

github.com Readme Changelog Edit opam file Versions (8)

Authors

A

Ahrefs

Maintainers

J

José Nogueira <jose.nogueira@ahrefs.com>

Sources

ocaml-ai-sdk-0.3.tbz

sha256=636d458cb1564ed88ca8c0250c432e91c2f822fd49ad2b923819e762bda10be6

sha512=361e476423ebc0f9cf561cc28ccd4531cf08e424e95eea43a67d6b8dbb457a49a25b418625ffa99f6327fc5df14e540e502d1aa8ed606111c5c010fe498eec2a

doc/ocaml-ai-sdk.ai_provider/Ai_provider/Http_client/index.html

Module `Ai_provider.Http_client`Source

HTTP client wrappers that apply Http_timeouts to cohttp calls.

These are the defence-in-depth layer around Cohttp_lwt_unix.Client.post and the response body stream. All provider implementations should use these instead of raw cohttp calls.

Source

val post : 
  timeouts:Http_timeouts.t ->
  provider:string ->
  headers:Cohttp.Header.t ->
  body:Cohttp_lwt.Body.t ->
  Uri.t ->
  (Cohttp.Response.t * Cohttp_lwt.Body.t) Lwt.t

Wraps Cohttp_lwt_unix.Client.post in Lwt_unix.with_timeout using timeouts.request_timeout. On expiry, fails with Provider_error.Provider_error (Timeout { phase = Request_headers; ... }) tagged with the given provider string.

Source

val wrap_body_with_idle_timeout : 
  timeouts:Http_timeouts.t ->
  provider:string ->
  Cohttp_lwt.Body.t ->
  string Lwt_stream.t

Converts a cohttp body into a line stream (splits on LF, strips CR), with an inter-chunk idle timer from timeouts.stream_idle_timeout. The returned stream:

Emits one line per LF-terminated segment.
Flushes any trailing buffered data on normal end-of-stream.
Is cleanly closed (consumers see end-of-stream) on idle timeout, body-stream exception, or normal completion — no consumer will hang.
On exception, the original exception is re-raised to Lwt.async_exception_hook after the stream is closed, so bugs stay visible in logs.
On abnormal termination (idle timeout or body-stream exception), the upstream cohttp body is drained so its socket is released.