package ocaml-ai-sdk

You can search for identifiers within the package.

in-package search v0.2.0

OCaml AI SDK - Provider abstraction for AI models

Install

dune-project

Dependency

github.com Readme Changelog Edit opam file Versions (9)

Authors

A

Ahrefs

Maintainers

J

José Nogueira <jose.nogueira@ahrefs.com>

Sources

ocaml-ai-sdk-0.6.3.tbz

sha256=0cc0a957784c295877b6bcc4f80c0dba0f6507d3c282e7d6cbd71038050376de

sha512=f8e082376b4de194a877d0df193892cdaa8139a4789f51eebac651acf8b6d4064b95242e158d86c1a32776d99130d43ed4c1119e2d54e738e93bdba2a6ad9a33

doc/ocaml-ai-sdk.ai_core/Ai_core/Stream_text/index.html

Module `Ai_core.Stream_text`Source

Streaming text generation with multi-step tool execution.

Returns synchronously with streams that are filled asynchronously. Tool calls are executed between steps, with the model called again to continue generation.

Each provider call is retried on retryable errors and transient network failures with exponential backoff (see Retry.with_retries).

parameter max_retries
Number of additional attempts per provider call (default 2). Set to 0 to disable retries.

parameter max_retry_delay_ms
Caps backoff; a server Retry-After above it stops retries instead of sleeping. Uncapped by default.

Source

val stream_text : 
  model:Ai_provider.Language_model.t ->
  ?system:string ->
  ?system_provider_options:Ai_provider.Provider_options.t ->
  ?prompt:string ->
  ?messages:Ai_provider.Prompt.message list ->
  ?tools:(string * Core_tool.t) list ->
  ?tool_choice:Ai_provider.Tool_choice.t ->
  ?output:(Yojson.Basic.t, Yojson.Basic.t) Output.t ->
  ?max_steps:int ->
  ?max_retries:int ->
  ?max_retry_delay_ms:int ->
  ?stop_when:Stop_condition.t list ->
  ?max_output_tokens:int ->
  ?temperature:float ->
  ?top_p:float ->
  ?top_k:int ->
  ?stop_sequences:string list ->
  ?seed:int ->
  ?headers:(string * string) list ->
  ?provider_options:Ai_provider.Provider_options.t ->
  ?on_step_finish:(Generate_text_result.step -> unit) ->
  ?on_chunk:(Text_stream_part.t -> unit) ->
  ?on_finish:(Generate_text_result.t -> unit) ->
  ?transform:
    (Text_stream_part.t Lwt_stream.t -> Text_stream_part.t Lwt_stream.t) ->
  ?telemetry:Telemetry.t ->
  ?pending_tool_approvals:Generate_text_result.pending_tool_approval list ->
  unit ->
  Stream_text_result.t