package ocaml-ai-sdk

  1. Overview
  2. Docs
OCaml AI SDK - Provider abstraction for AI models

Install 

dune-project
 Dependency

github.com Readme Changelog Edit opam file Versions (9)

Authors

  1. A
    Ahrefs

Maintainers

  1. J
    José Nogueira <jose.nogueira@ahrefs.com>

Sources

ocaml-ai-sdk-0.6.3.tbz
sha256=0cc0a957784c295877b6bcc4f80c0dba0f6507d3c282e7d6cbd71038050376de
sha512=f8e082376b4de194a877d0df193892cdaa8139a4789f51eebac651acf8b6d4064b95242e158d86c1a32776d99130d43ed4c1119e2d54e738e93bdba2a6ad9a33

doc/ocaml-ai-sdk.ai_provider_openrouter/Ai_provider_openrouter/Cache_control/index.html

Module Ai_provider_openrouter.Cache_controlSource

Prompt caching control for OpenRouter requests.

Mirrors the per-part cache_control shape used by upstream @openrouter/ai-sdk-provider. The upstream TypeScript type is { type: 'ephemeral' } (see src/chat/convert-to-openrouter-chat-messages.ts); the OpenRouter documentation additionally accepts an optional ttl field ("5m" default, "1h" explicit) for Anthropic upstreams, which we surface here.

Sourcetype breakpoint =
  1. | Ephemeral
    (*

    Cache control type. Currently only Ephemeral is supported.

    *)
Sourcetype ttl =
  1. | Ttl_5m
  2. | Ttl_1h

Cache TTL. OpenRouter (Anthropic upstreams) accepts "5m" (default) or "1h".

Sourcetype t = {
  1. cache_type : breakpoint;
  2. ttl : ttl option;
}
Sourceval ephemeral : t

Ephemeral cache control with default 5-minute TTL.

Sourceval ephemeral_1h : t

Ephemeral cache control with explicit 1-hour TTL.

Sourceval to_json : t -> Yojson.Basic.t
Sourceval of_json : Yojson.Basic.t -> t