package ocaml-ai-sdk
Install
dune-project
Dependency
Authors
Maintainers
Sources
sha256=636d458cb1564ed88ca8c0250c432e91c2f822fd49ad2b923819e762bda10be6
sha512=361e476423ebc0f9cf561cc28ccd4531cf08e424e95eea43a67d6b8dbb457a49a25b418625ffa99f6327fc5df14e540e502d1aa8ed606111c5c010fe498eec2a
doc/ocaml-ai-sdk.ai_core/Ai_core/Server_handler/index.html
Module Ai_core.Server_handlerSource
Convenience handler for building chat API endpoints with cohttp.
Parses the request body as JSON messages, calls stream_text, and returns an SSE response compatible with useChat().
Default CORS headers for cross-origin chat endpoints. Allows all origins, POST/OPTIONS methods, and exposes the UIMessage stream protocol header.
Parse a v6 UIMessage request body into prompt messages.
Expects a JSON object with a "messages" array where each message has "role" and "parts". Supports all v6 part types:
"text": text content"file": file attachments withmediaTypeandurlordata"reasoning": assistant reasoning blocks- Tool invocation parts (
"tool-{name}"or"dynamic-tool"): converted toAi_provider.Prompt.assistant_part.Tool_callandAi_provider.Prompt.message.Toolmessages based on the invocationstate
Returns an empty list on parse failure. Unknown part types are skipped.
val collect_pending_tool_approvals :
Yojson.Basic.t ->
Generate_text_result.pending_tool_approval listCollect pending tool approvals from re-submitted messages.
Scans the message history for tool invocation parts with state = "approval-responded", returning full tool call details. Approved tools should be executed directly before calling the LLM; denied tools should produce error results.
val handle_chat :
model:Ai_provider.Language_model.t ->
?tools:(string * Core_tool.t) list ->
?max_steps:int ->
?max_retries:int ->
?stop_when:Stop_condition.t list ->
?system:string ->
?output:(Yojson.Basic.t, Yojson.Basic.t) Output.t ->
?send_reasoning:bool ->
?max_output_tokens:int ->
?cors:bool ->
?provider_options:Ai_provider.Provider_options.t ->
?transform:
(Text_stream_part.t Lwt_stream.t -> Text_stream_part.t Lwt_stream.t) ->
?telemetry:Telemetry.t ->
Cohttp_lwt_unix.Server.conn ->
Cohttp.Request.t ->
Cohttp_lwt.Body.t ->
(Cohttp.Response.t * Cohttp_lwt.Body.t) Lwt.tHandle an incoming chat request.
Expects a v6 JSON body with a "messages" array where each message has "role" and a "parts" array of typed content parts.
Returns an SSE response with UIMessage stream protocol v1 headers. When cors is true (the default), CORS headers are included. Returns 400 Bad Request if the request body is not valid JSON.
Note: generation parameters like temperature, top_p, max_output_tokens are not exposed here. Pass them via provider_options or call Stream_text.stream_text directly with Stream_text_result.to_ui_message_sse_stream and make_sse_response for full control.
val handle_cors_preflight :
Cohttp_lwt_unix.Server.conn ->
Cohttp.Request.t ->
Cohttp_lwt.Body.t ->
(Cohttp.Response.t * Cohttp_lwt.Body.t) Lwt.tHandle a CORS preflight OPTIONS request. Returns 204 No Content with CORS headers. Use this for the OPTIONS route matching your chat endpoint.
val make_sse_response :
?status:Cohttp.Code.status_code ->
?extra_headers:(string * string) list ->
string Lwt_stream.t ->
(Cohttp.Response.t * Cohttp_lwt.Body.t) Lwt.tCreate an SSE HTTP response from a string stream. Adds UIMessage stream protocol headers automatically.