package ocaml-ai-sdk

You can search for identifiers within the package.

in-package search v0.2.0

OCaml AI SDK - Provider abstraction for AI models

Install

dune-project

Dependency

github.com Readme Changelog Edit opam file Versions (9)

Authors

A

Ahrefs

Maintainers

J

José Nogueira <jose.nogueira@ahrefs.com>

Sources

ocaml-ai-sdk-0.6.3.tbz

sha256=0cc0a957784c295877b6bcc4f80c0dba0f6507d3c282e7d6cbd71038050376de

sha512=f8e082376b4de194a877d0df193892cdaa8139a4789f51eebac651acf8b6d4064b95242e158d86c1a32776d99130d43ed4c1119e2d54e738e93bdba2a6ad9a33

doc/ocaml-ai-sdk.ai_provider/Ai_provider/Http_client/index.html

Module `Ai_provider.Http_client`Source

HTTP client wrappers that apply Http_timeouts to cohttp calls.

These are the defence-in-depth layer around Cohttp_lwt_unix.Client.post and the response body stream. All provider implementations should use these instead of raw cohttp calls.

Source

val post : 
  timeouts:Http_timeouts.t ->
  provider:string ->
  headers:Cohttp.Header.t ->
  body:Cohttp_lwt.Body.t ->
  Uri.t ->
  (Cohttp.Response.t * Cohttp_lwt.Body.t) Lwt.t

Wraps Cohttp_lwt_unix.Client.post in Lwt_unix.with_timeout using timeouts.request_timeout. On expiry, fails with Provider_error.Provider_error (Timeout { phase = Request_headers; ... }) tagged with the given provider string.

Source

val wrap_body_with_idle_timeout : 
  timeouts:Http_timeouts.t ->
  provider:string ->
  Cohttp_lwt.Body.t ->
  string Lwt_stream.t

Converts a cohttp body into a line stream (splits on LF, strips CR), with an inter-chunk idle timer from timeouts.stream_idle_timeout. The returned stream:

Emits one line per LF-terminated segment.
Flushes any trailing buffered data on normal end-of-stream.
Is cleanly closed (consumers see end-of-stream) on idle timeout, body-stream exception, or normal completion — no consumer will hang.
On exception, the original exception is re-raised to Lwt.async_exception_hook after the stream is closed, so bugs stay visible in logs.
On abnormal termination (idle timeout or body-stream exception), the upstream cohttp body is drained so its socket is released.