package ocaml-ai-sdk

You can search for identifiers within the package.

in-package search v0.2.0

OCaml AI SDK - Provider abstraction for AI models

Install

dune-project

Dependency

github.com Readme Changelog Edit opam file Versions (8)

Authors

A

Ahrefs

Maintainers

J

José Nogueira <jose.nogueira@ahrefs.com>

Sources

ocaml-ai-sdk-0.3.tbz

sha256=636d458cb1564ed88ca8c0250c432e91c2f822fd49ad2b923819e762bda10be6

sha512=361e476423ebc0f9cf561cc28ccd4531cf08e424e95eea43a67d6b8dbb457a49a25b418625ffa99f6327fc5df14e540e502d1aa8ed606111c5c010fe498eec2a

doc/ocaml-ai-sdk.ai_core/Ai_core/Stream_text/index.html

Module `Ai_core.Stream_text`Source

Streaming text generation with multi-step tool execution.

Returns synchronously with streams that are filled asynchronously. Tool calls are executed between steps, with the model called again to continue generation.

Each provider call is retried on retryable errors and transient network failures with exponential backoff (see Retry.with_retries).

parameter max_retries
Number of additional attempts per provider call (default 2). Set to 0 to disable retries.

Source

val stream_text : 
  model:Ai_provider.Language_model.t ->
  ?system:string ->
  ?prompt:string ->
  ?messages:Ai_provider.Prompt.message list ->
  ?tools:(string * Core_tool.t) list ->
  ?tool_choice:Ai_provider.Tool_choice.t ->
  ?output:(Yojson.Basic.t, Yojson.Basic.t) Output.t ->
  ?max_steps:int ->
  ?max_retries:int ->
  ?stop_when:Stop_condition.t list ->
  ?max_output_tokens:int ->
  ?temperature:float ->
  ?top_p:float ->
  ?top_k:int ->
  ?stop_sequences:string list ->
  ?seed:int ->
  ?headers:(string * string) list ->
  ?provider_options:Ai_provider.Provider_options.t ->
  ?on_step_finish:(Generate_text_result.step -> unit) ->
  ?on_chunk:(Text_stream_part.t -> unit) ->
  ?on_finish:(Generate_text_result.t -> unit) ->
  ?transform:
    (Text_stream_part.t Lwt_stream.t -> Text_stream_part.t Lwt_stream.t) ->
  ?telemetry:Telemetry.t ->
  ?pending_tool_approvals:Generate_text_result.pending_tool_approval list ->
  unit ->
  Stream_text_result.t