package cohttp

  1. Overview
  2. Docs
An OCaml library for HTTP clients and servers

Install

Dune Dependency

Authors

Maintainers

Sources

cohttp-2.5.6.tbz
sha256=a166aa42eae15b1ff42ed553dd24efaf8720be0fa8d98816e0147f0fc9badcf3
sha512=1fefff772484786c1401d7ca2cfa853a6e4014ef3aec6412e684186ed47f45d8daab708d39333a7df4702311c1d6f9cd72958a0244816a43451af098ac3ae0e8

Description

Cohttp is an OCaml library for creating HTTP daemons. It has a portable HTTP parser, and implementations using various asynchronous programming libraries.

See the cohttp-async, cohttp-lwt, cohttp-lwt-unix, cohttp-lwt-jsoo and cohttp-mirage libraries for concrete implementations for particular targets.

You can implement other targets using the parser very easily. Look at the IO signature in lib/s.mli and implement that in the desired backend.

You can activate some runtime debugging by setting COHTTP_DEBUG to any value, and all requests and responses will be written to stderr. Further debugging of the connection layer can be obtained by setting CONDUIT_DEBUG to any value.

Tags

org:mirage org:xapi-project

Published: 15 Dec 2021

README

ocaml-cohttp -- an OCaml library for HTTP clients and servers

Cohttp is an OCaml library for creating HTTP daemons. It has a portable HTTP parser, and implementations using various asynchronous programming libraries:

  • Cohttp_lwt_unix uses the Lwt library, and specifically the UNIX bindings.

  • Cohttp_async uses the Async library.

  • Cohttp_lwt exposes an OS-independent Lwt interface, which is used by the Mirage interface to generate standalone microkernels (use the cohttp-mirage subpackage).

  • Cohttp_lwt_xhr compiles to a JavaScript module that maps the Cohttp calls to XMLHTTPRequests. This is used to compile OCaml libraries like the GitHub bindings to JavaScript and still run efficiently.

You can implement other targets using the parser very easily. Look at the IO signature in lib/s.mli and implement that in the desired backend.

You can activate some runtime debugging by setting COHTTP_DEBUG to any value, and all requests and responses will be written to stderr. Further debugging of the connection layer can be obtained by setting CONDUIT_DEBUG to any value.

Installation

Latest stable version should be obtained from opam. Make sure to install the specific backends you want as well. E.g.

$ opam install cohttp lwt js_of_ocaml

You can also obtain the development release:

$ opam pin add cohttp --dev-repo

Findlib (Ocamlfind)

Cohttp ships with 6 findlib libraries:

  • cohttp - Base Cohttp module. No platform specific functionality.

  • cohttp-async - Async backend Cohttp_async

  • cohttp-lwt-jsoo - Jsoo (XHR) client

  • cohttp-lwt - Lwt backend without unix specifics.

  • cohttp-lwt-unix - Unix based lwt backend

  • cohttp-top - Print cohttp types in the toplevel (#require "cohttp-top")

Client Tutorial

Cohttp provides clients for Async, Lwt, and jsoo (Lwt based). In this tutorial, we will use the lwt client but it should be easily translateable to Async.

To create a simple request, use one of the methods in Cohttp_lwt_unix.Client. call is the most general, there are also http method specialized such as get, post, etc.

For example downloading the reddit frontpage:

(* client_example.ml *)
open Lwt
open Cohttp
open Cohttp_lwt_unix

let body =
  Client.get (Uri.of_string "https://www.reddit.com/") >>= fun (resp, body) ->
  let code = resp |> Response.status |> Code.code_of_status in
  Printf.printf "Response code: %d\n" code;
  Printf.printf "Headers: %s\n" (resp |> Response.headers |> Header.to_string);
  body |> Cohttp_lwt.Body.to_string >|= fun body ->
  Printf.printf "Body of length: %d\n" (String.length body);
  body

let () =
  let body = Lwt_main.run body in
  print_endline ("Received body\n" ^ body)

Build with:

ocamlbuild -pkg cohttp-lwt-unix client_example.native

There's a few things to notice:

  • We open 2 modules. Cohttp contains the backend independent stuff and Cohttp_lwt_unix is the lwt + unix specific stuff.

  • Client.get accepts a Uri.t and makes an http request. Client.get also accepts optional arguments for things like header information.

  • The http response is returned in a tuple. The first element of the tuple contains the response's status code, headers, http version, etc. The second element contains the body.

  • The body is then converted to a string and is returned (after the length is printed). Note that Cohttp_lwt.Body.to_string hence it's up to us to keep a reference to the result.

  • We must trigger lwt's event loop for the request to run. Lwt_main.run will run the event loop and return with final value of body which we then print.

Note that in order to request an HTTPS page like in the above example, you'll need Cohttp to have been compiled with SSL or TLS. For SSL, you'll need to install both ssl and lwt_ssl before installing cohttp. The TLS route will require installing tls before cohttp.

Consult the following modules for reference:

Docker Socket Client example

Cohttp provides a lot of utilites out of the box, but does not prevent the users to dig in and customise it for their needs. The following is an example of a unix socket client to communicate with Docker.

open Lwt.Infix

let t =
  let resolver =
    let h = Hashtbl.create 1 in
    Hashtbl.add h "docker" (`Unix_domain_socket "/var/run/docker.sock");
    Resolver_lwt_unix.static h in
  let ctx = Cohttp_lwt_unix.Client.custom_ctx ~resolver () in
  Cohttp_lwt_unix.Client.get ~ctx (Uri.of_string "http://docker/version") >>= fun (resp, body) ->
  let open Cohttp in
  let code = resp |> Response.status |> Code.code_of_status in
  Printf.printf "Response code: %d\n" code;
  Printf.printf "Headers: %s\n" (resp |> Response.headers |> Header.to_string);
  body |> Cohttp_lwt.Body.to_string >|= fun body ->
  Printf.printf "Body of length: %d\n" (String.length body);
  print_endline ("Received body\n" ^ body)

let _ = Lwt_main.run t

The main issue there is there no way to resolve a socket address, so you need to create a custom resolver to map a hostname to the Unix domain socket.

Basic Server Tutorial

Implementing a server in cohttp is mostly equivalent to implementing a function of type:

conn -> Cohttp.Request.t -> Cohttp_lwt.Body.t -> (Cohttp.Response.t * Cohttp_lwt.Body.t) Lwt.t

The parameters are self explanatory but we'll summarize them quickly here:

  • conn - contains connection information

  • Cohttp.Request.t - Request information such as method, uri, headers, etc.

  • Cohttp_lwt.Body.t - Contains the request body. You must manually decode the request body into json, form encoded pairs, etc. For cohttp, the body is simply binary data.

Here's an example of a simple cohttp server that outputs back request information.

(* server_example.ml *)
open Lwt
open Cohttp
open Cohttp_lwt_unix

let server =
  let callback _conn req body =
    let uri = req |> Request.uri |> Uri.to_string in
    let meth = req |> Request.meth |> Code.string_of_method in
    let headers = req |> Request.headers |> Header.to_string in
    body |> Cohttp_lwt.Body.to_string >|= (fun body ->
      (Printf.sprintf "Uri: %s\nMethod: %s\nHeaders\nHeaders: %s\nBody: %s"
         uri meth headers body))
    >>= (fun body -> Server.respond_string ~status:`OK ~body ())
  in
  Server.create ~mode:(`TCP (`Port 8000)) (Server.make ~callback ())

let () = ignore (Lwt_main.run server)

Build with:

ocamlbuild -pkg cohttp-lwt-unix server_example.native

The following modules are useful references:

Installed Binaries

Cohttp comes with a few simple binaries that are handy, useful testing cohttp itself, and serve as examples of how to use cohttp. The binaries come in two flavours - Async and Lwt based.

  • $ cohttp-curl-{lwt,async}

This is a simple curl utility implemented using cohttp. An example of an invocation is:

$ cohttp-curl-lwt -v -X GET "https://www.reddit.com/"
  • $ cohttp-server-{lwt,async}

This binary acts in a similar fashion to the Python SimpleHTTPServer. Just run cohttp-server-async in a directory and it will open up a local port and serve the files over HTTP.

$ cohttp-server-async

Assuming that the server is running in cohttp's source directory:

$ cohttp-curl-lwt 'http://0.0.0.0:8080/_oasis'

Important Links

Dependencies (15)

  1. jsonm build
  2. stdlib-shims
  3. base64 >= "3.1.0"
  4. stringext
  5. ppx_sexp_conv >= "v0.13.0"
  6. ppx_fields_conv >= "v0.9.0"
  7. sexplib0
  8. fieldslib
  9. uri-sexp
  10. uri >= "2.0.0"
  11. re >= "1.9.0"
  12. dune >= "1.1.0"
  13. base-bytes
  14. ocaml >= "5.0"
  15. ocaml >= "4.04.1" & < "5.0"

Dev Dependencies (2)

  1. alcotest with-test
  2. fmt with-test

Used by (83)

  1. aws-async
  2. aws-lwt
  3. aws-s3 >= "2.0.0" & < "4.0.0"
  4. awsm
  5. awsm-codegen
  6. azblob
  7. azblob-async
  8. azure-cosmos-db
  9. c3
  10. calculon-web < "0.5"
  11. caldav
  12. canary
  13. cca >= "0.6.2"
  14. cohttp-async >= "1.0.0" & < "2.2.0" | = "2.5.6"
  15. cohttp-lwt >= "2.0.0" & < "2.2.0" | = "2.5.6"
  16. cohttp-lwt-jsoo >= "1.2.0" & < "2.2.0" | = "2.5.6"
  17. cohttp-mirage >= "2.2.0" & != "2.5.5" & < "2.5.7"
  18. cohttp-top >= "1.0.0" & < "2.2.0" | = "2.5.6"
  19. cohttp_async_websocket
  20. comby-semantic
  21. cowabloga >= "0.0.9" & != "0.2.2"
  22. current_github >= "0.4" & < "0.6"
  23. current_slack >= "0.4" & < "0.6"
  24. current_web >= "0.4" & < "0.6"
  25. datakit < "0.10.0"
  26. dropbox >= "0.2"
  27. frenetic >= "3.3.0" & < "5.0.5"
  28. git = "1.4.10" | >= "1.5.0" & < "1.10.0"
  29. git-cohttp
  30. git-cohttp-mirage
  31. git-cohttp-unix
  32. git-http >= "2.0.0"
  33. git-paf < "3.5.0"
  34. git-unix < "1.10.0" | >= "2.0.0" & < "3.0.0"
  35. github >= "3.0.1" & < "4.4.0"
  36. github-jsoo >= "3.0.1" & < "4.4.0"
  37. github-unix >= "4.2.0" & < "4.4.0"
  38. graphql-cohttp
  39. hockmd
  40. imaplet-lwt >= "0.1.3"
  41. influxdb-async
  42. influxdb-lwt
  43. iocaml < "0.4.8"
  44. ip2location
  45. ip2locationio
  46. ip2whois
  47. irmin >= "0.9.0" & != "0.11.1" & < "1.0.0"
  48. irmin-cli
  49. irmin-graphql >= "2.3.0"
  50. irmin-http >= "2.3.0"
  51. irmin-mirage-git >= "2.3.0" & < "2.8.0"
  52. irmin-unix < "0.9.9" | >= "2.3.0"
  53. learn-ocaml != "0.12"
  54. learn-ocaml-client >= "0.13.0"
  55. letsencrypt < "0.3.0"
  56. links >= "0.7.3"
  57. magic-trace
  58. mechaml >= "1.2.0"
  59. merge-queues >= "0.2.0"
  60. mirage-http = "2.0.0"
  61. mirage-www >= "1.1.0"
  62. nsq >= "0.2.4"
  63. ocamlapi
  64. oframl
  65. ojs-base >= "0.3.0" & < "0.6.0"
  66. opium = "0.13.3"
  67. opium_kernel
  68. podge
  69. ppx_json_types
  70. prof_spacetime >= "0.3.0"
  71. prometheus-app >= "0.5" & < "1.2"
  72. quests
  73. reddit_api_kernel < "0.2.1"
  74. sentry
  75. session-cohttp
  76. sociaml-facebook-api >= "0.4.1"
  77. telegraml >= "2.2.0"
  78. tidy_email_mailgun
  79. tidy_email_sendgrid
  80. transmission-rpc
  81. webmachine >= "0.4.0"
  82. websocket >= "2.10" & < "2.15"
  83. xen-api-client >= "0.9.8" & < "0.9.14"

Conflicts

None

OCaml

Innovation. Community. Security.