package ocaml-ai-sdk

You can search for identifiers within the package.

in-package search v0.2.0

OCaml AI SDK - Provider abstraction for AI models

Install

dune-project

Dependency

github.com Readme Changelog Edit opam file Versions (8)

Authors

A

Ahrefs

Maintainers

J

José Nogueira <jose.nogueira@ahrefs.com>

Sources

ocaml-ai-sdk-0.5.tbz

sha256=9e3437d6ebf48ec9f5d9a8afd62eaeece124023f02dbd87e4b291205fd309b72

sha512=605c10ed62c0cbc31a151b7031cc80a284d5c94231c1ef423ae7439572e3fadddab4a45f52eaeeef83973a8e324839b9fda03f9082deef1b6781353f63975510

doc/ocaml-ai-sdk.ai_core/Ai_core/Stream_text/index.html

Module `Ai_core.Stream_text`Source

Streaming text generation with multi-step tool execution.

Returns synchronously with streams that are filled asynchronously. Tool calls are executed between steps, with the model called again to continue generation.

Each provider call is retried on retryable errors and transient network failures with exponential backoff (see Retry.with_retries).

parameter max_retries
Number of additional attempts per provider call (default 2). Set to 0 to disable retries.

Source

val stream_text : 
  model:Ai_provider.Language_model.t ->
  ?system:string ->
  ?system_provider_options:Ai_provider.Provider_options.t ->
  ?prompt:string ->
  ?messages:Ai_provider.Prompt.message list ->
  ?tools:(string * Core_tool.t) list ->
  ?tool_choice:Ai_provider.Tool_choice.t ->
  ?output:(Yojson.Basic.t, Yojson.Basic.t) Output.t ->
  ?max_steps:int ->
  ?max_retries:int ->
  ?stop_when:Stop_condition.t list ->
  ?max_output_tokens:int ->
  ?temperature:float ->
  ?top_p:float ->
  ?top_k:int ->
  ?stop_sequences:string list ->
  ?seed:int ->
  ?headers:(string * string) list ->
  ?provider_options:Ai_provider.Provider_options.t ->
  ?on_step_finish:(Generate_text_result.step -> unit) ->
  ?on_chunk:(Text_stream_part.t -> unit) ->
  ?on_finish:(Generate_text_result.t -> unit) ->
  ?transform:
    (Text_stream_part.t Lwt_stream.t -> Text_stream_part.t Lwt_stream.t) ->
  ?telemetry:Telemetry.t ->
  ?pending_tool_approvals:Generate_text_result.pending_tool_approval list ->
  unit ->
  Stream_text_result.t