package lwt

  1. Overview
  2. Docs
Promises and event-driven I/O

Install

Dune Dependency

Authors

Maintainers

Sources

5.1.1.tar.gz
md5=4ddec0f42b7aa4a310175a14c47c60a3

Description

A promise is a value that may become determined in the future.

Lwt provides typed, composable promises. Promises that are resolved by I/O are resolved by Lwt in parallel.

Meanwhile, OCaml code, including code creating and waiting on promises, runs in a single thread by default. This reduces the need for locks or other synchronization primitives. Code can be run in parallel on an opt-in basis.

Published: 07 Jan 2020

README

Lwt   

Lwt is a concurrent programming library for OCaml. It provides a single data type: the promise, which is a value that will become determined in the future. Creating a promise spawns a computation. When that computation is I/O, Lwt runs it in parallel with your OCaml code.

OCaml code, including creating and waiting on promises, is run in a single thread by default, so you don't have to worry about locking or preemption. You can detach code to be run in separate threads on an opt-in basis.

Here is a simplistic Lwt program which requests the Google front page, and fails if the request is not completed in five seconds:

let () =
  let request =
    let%lwt addresses = Lwt_unix.getaddrinfo "google.com" "80" [] in
    let google = Lwt_unix.((List.hd addresses).ai_addr) in

    Lwt_io.(with_connection google (fun (incoming, outgoing) ->
      let%lwt () = write outgoing "GET / HTTP/1.1\r\n" in
      let%lwt () = write outgoing "Connection: close\r\n\r\n" in
      let%lwt response = read incoming in
      Lwt.return (Some response)))
  in

  let timeout =
    let%lwt () = Lwt_unix.sleep 5. in
    Lwt.return None
  in

  match Lwt_main.run (Lwt.pick [request; timeout]) with
  | Some response -> print_string response
  | None -> prerr_endline "Request timed out"; exit 1

(* ocamlfind opt -package lwt.unix,lwt_ppx -linkpkg -o request example.ml
   ./request *)

In the program, functions such as Lwt_io.write create promises. The let%lwt ... in construct is used to wait for a promise to become determined; the code after in is scheduled to run in a "callback." Lwt.pick races promises against each other, and behaves as the first one to complete. Lwt_main.run forces the whole promise-computation network to be executed. All the visible OCaml code is run in a single thread, but Lwt internally uses a combination of worker threads and non-blocking file descriptors to resolve in parallel the promises that do I/O.


Overview

Lwt compiles to native code on Linux, macOS, Windows, and other systems. It's also routinely compiled to JavaScript for the front end and Node, by js_of_ocaml and BuckleScript.

In Lwt,

  • The core library Lwt provides promises...

  • ...and a few pure-OCaml helpers, such as promise-friendly mutexes, condition variables, and mvars.

  • There is a big Unix binding, Lwt_unix that binds almost every Unix system call. A higher-level module Lwt_io provides nice I/O channels.

  • Lwt_process is for subprocess handling.

  • Lwt_preemptive spawns system threads.

  • The PPX syntax allows using all of the above without going crazy!

  • There are also some other helpers, such as Lwt_react for reactive programming. See the table of contents on the linked manual pages!


Installing

  1. Use your system package manager to install a development libev package. It is often called libev-dev or libev-devel.

  2. opam install conf-libev lwt


Documentation

We are currently working on improving the Lwt documentation (drastically; we are rewriting the manual). In the meantime:

  • The current manual can be found here.

  • Mirage has a nicely-written Lwt tutorial.

  • An example of a simple server written in Lwt.

  • Concurrent Programming with Lwt is a nice source of Lwt examples. They are translations of code from the excellent Real World OCaml, but are just as useful if you are not reading the book.

Note: much of the current manual refers to 'a Lwt.t as "lightweight threads" or just "threads." This will be fixed in the new manual. 'a Lwt.t is a promise, and has nothing to do with system or preemptive threads.


Contact

Open an issue, visit Discord chat, ask on discuss.ocaml.org, or on Stack Overflow.

Release announcements are made in /r/ocaml, and on discuss.ocaml.org. Watching the repo for "Releases only" is also an option.


Contributing

  • CONTRIBUTING.md contains tips for working on the code, such as how to check the code out, how review works, etc. There is also a high-level outline of the code base.

  • Ask us anything, whether it's about working on Lwt, or any question at all about it :)

  • The documentation always needs proofreading and fixes.

  • You are welcome to pick up any other issue, review a PR, add your opinion, etc.

  • Any feedback is welcome, including how to make contributing easier!


Libraries to use with Lwt

Dependencies (8)

  1. seq
  2. result
  3. ocplib-endian
  4. ocaml >= "4.02.0" & < "4.12"
  5. mmap >= "1.1.0"
  6. dune-configurator
  7. dune >= "1.7.0"
  8. cppo build & >= "1.1.0"

Dev Dependencies (2)

  1. ocamlfind dev & >= "1.7.3-1"
  2. bisect_ppx dev & >= "1.3.0"

  1. 0install >= "2.15.1"
  2. albatross
  3. alcotest-lwt
  4. alcotest-mirage
  5. ambient-context-lwt
  6. amqp-client >= "0.9.0" & < "1.0.2" | >= "1.1.0"
  7. amqp-client-lwt >= "2.0.1"
  8. angstrom-lwt-unix
  9. anthill
  10. anycache-lwt
  11. apero-core
  12. apero-net
  13. apero-time
  14. arakoon < "1.8.6" | >= "1.8.8"
  15. archi-lwt
  16. arp >= "2.3.1"
  17. arp-mirage >= "2.2.1"
  18. awa-lwt
  19. awa-mirage < "0.2.0"
  20. aws-lwt
  21. aws-s3-lwt
  22. awsm-lwt
  23. azure-cosmos-db
  24. baardskeerder
  25. balancer
  26. bap < "1.0.0"
  27. bap-server < "0.2.0"
  28. bimage-lwt
  29. biocaml = "0.4.0"
  30. bistro >= "0.4.0"
  31. brozip
  32. builder
  33. bun >= "0.3.3"
  34. c3
  35. calculon
  36. caldav
  37. camltc = "0.9.5" | >= "0.9.7.0"
  38. canary
  39. capnp-rpc-lwt < "1.2.3"
  40. capnp-rpc-unix >= "0.9.0" & < "1.2.3"
  41. caqti-lwt >= "0.11.0" & < "2.0.1"
  42. carton-git
  43. carton-lwt
  44. cf-lwt
  45. channel
  46. charrua-client >= "1.3.0"
  47. charrua-client-lwt
  48. charrua-client-mirage
  49. charrua-core < "0.3"
  50. charrua-unix >= "0.3" & != "0.10"
  51. cmdtui-lambda-term
  52. coclobas
  53. cohttp-lwt < "6.0.0~alpha2"
  54. cohttp-lwt-jsoo
  55. cohttp-lwt-unix >= "1.1.1"
  56. cohttp-lwt-unix-nossl
  57. cohttp-lwt-unix-ssl
  58. cohttp-mirage
  59. comby
  60. comby-semantic
  61. conan-lwt
  62. conduit-lwt
  63. conduit-lwt-unix
  64. cowabloga >= "0.2.2"
  65. crunch >= "2.0.0"
  66. cstruct-lwt
  67. csv-lwt
  68. csvprovider
  69. ctypes >= "0.15.0" & < "0.21.1"
  70. ctypes-foreign >= "0.21.1"
  71. current < "0.6.4"
  72. current_docker < "0.6.4"
  73. current_examples < "0.6.4"
  74. current_git < "0.6.4"
  75. current_github < "0.6.4"
  76. current_gitlab < "0.6.4"
  77. current_ocluster < "0.2"
  78. current_slack < "0.6.4"
  79. current_web < "0.6.4"
  80. DkSDKFFIOCaml_Std
  81. dap
  82. data-encoding < "0.1.1"
  83. datakit
  84. datakit-bridge-github
  85. datakit-bridge-local-git
  86. datakit-ci
  87. datakit-client >= "0.11.0"
  88. datakit-github
  89. datakit-server
  90. devkit >= "1.2"
  91. dht < "0.2.0"
  92. distributed-lwt
  93. dkim-mirage
  94. dlm
  95. dns >= "0.19.1" & < "0.20.1"
  96. dns-certify
  97. dns-cli >= "4.6.3"
  98. dns-client < "7.0.0"
  99. dns-client-lwt
  100. dns-client-mirage
  101. dns-forward >= "0.9.0"
  102. dns-forward-lwt-unix
  103. dns-lwt
  104. dns-mirage
  105. dns-resolver
  106. dns-server
  107. dns-stub
  108. dnssd
  109. docker_hub
  110. dream
  111. dream-httpaf
  112. dream-pure
  113. dropbox
  114. dune_watch
  115. earlybird < "1.0.0"
  116. elasticsearch-cli >= "0.4"
  117. eris-lwt
  118. ethernet
  119. ez_api
  120. ezcurl-lwt
  121. ezirmin
  122. ezjsonm >= "0.4.2" & < "0.5.0"
  123. ezjsonm-lwt
  124. ezresto
  125. ezresto-directory >= "0.5"
  126. faraday-lwt
  127. faraday-lwt-unix >= "0.6.0"
  128. fat-filesystem >= "0.12.0"
  129. fiber-lwt
  130. flowtype >= "0.72.0"
  131. frenetic < "2.0.0"
  132. fsevents-lwt
  133. fswatch_lwt
  134. fuseau-lwt
  135. gamepad
  136. gdb
  137. gdbprofiler >= "0.3"
  138. git != "1.4.3" & != "1.7.2"
  139. git-paf
  140. git-unix = "1.11.1" | >= "3.0.0" & < "3.10.0"
  141. github
  142. github-hooks < "0.2.0" | >= "0.4.0"
  143. github-unix >= "4.4.0"
  144. gitlab-unix
  145. gluten-lwt
  146. gluten-lwt-unix < "0.4.0"
  147. gluten-mirage < "0.4.0"
  148. graphql-lwt
  149. gremlin
  150. gufo
  151. h2-lwt
  152. h2-lwt-unix < "0.10.0"
  153. h2-mirage
  154. happy-eyeballs-lwt
  155. happy-eyeballs-mirage
  156. hardcaml < "1.1.0"
  157. hardcaml-examples >= "0.3.0"
  158. hardcaml-framework
  159. hiredis != "0.4"
  160. hl_yaml
  161. horned_worm < "0.3.1"
  162. http-lwt-client
  163. http-multipart-formdata >= "2.0.0" & < "3.0.0"
  164. http2https
  165. httpaf-lwt-unix
  166. hvsock >= "1.0.2"
  167. i3ipc >= "0.1.4"
  168. imaplet-lwt
  169. influxdb-lwt
  170. inotify >= "2.4"
  171. inquire < "0.3.0"
  172. interface-prime-lwt
  173. iocaml < "0.4.6"
  174. iocaml-kernel >= "0.4.3" & < "0.4.6"
  175. iocamljs-kernel
  176. ip2location
  177. ip2locationio
  178. ipv6-multicast-lwt
  179. irc-client-lwt
  180. irc-client-lwt-ssl
  181. irc-client-tls
  182. irmin < "0.9.6" | = "0.9.10" | >= "0.11.0" & < "2.7.0"
  183. irmin-bench < "2.7.0"
  184. irmin-chunk < "2.7.0"
  185. irmin-containers < "2.7.0"
  186. irmin-fs >= "2.3.0" & < "2.7.0"
  187. irmin-git >= "2.3.0" & < "2.7.0"
  188. irmin-graphql >= "2.3.0" & < "2.7.0"
  189. irmin-http >= "2.3.0" & < "2.7.0"
  190. irmin-indexeddb
  191. irmin-layers < "2.7.0"
  192. irmin-mem >= "2.3.0"
  193. irmin-mirage-git >= "2.3.0" & < "2.7.0"
  194. irmin-mirage-graphql >= "2.3.0" & < "2.7.0"
  195. irmin-pack < "2.7.0"
  196. irmin-test >= "2.3.0" & < "2.7.0"
  197. irmin-unix >= "2.3.0" & < "2.7.0"
  198. irmin-watcher >= "0.3.0"
  199. jerboa
  200. jitsu
  201. joolog
  202. jose < "0.9.0"
  203. js_of_ocaml < "2.5"
  204. js_of_ocaml-lwt >= "3.5.0"
  205. jsoo_broadcastchannel
  206. jsoo_router
  207. jsoo_storage
  208. jupyter >= "2.3.0"
  209. jupyter-kernel >= "0.4"
  210. kafka >= "0.3" & < "0.5"
  211. kafka_lwt
  212. kappa-library
  213. ke >= "0.5"
  214. ketrew >= "3.2.0"
  215. kinetic-client < "0.0.3" | >= "0.0.9"
  216. kubecaml
  217. lablqml < "0.6"
  218. lambda-runtime
  219. lambda-term >= "1.13"
  220. launchd
  221. learn-ocaml >= "0.13.0"
  222. learn-ocaml-client >= "0.13.0"
  223. letsencrypt
  224. letsencrypt-app
  225. letsencrypt-dns
  226. libres3
  227. links != "0.9"
  228. linol-lwt
  229. lru_cache < "v0.16.0"
  230. lwt-binio < "0.2.0"
  231. lwt-canceler
  232. lwt-dllist
  233. lwt-exit
  234. lwt-parallel >= "1.0.0"
  235. lwt-pipe
  236. lwt-pipeline
  237. lwt-watcher
  238. lwt-zmq < "1.0.0"
  239. lwt_camlp4
  240. lwt_domain < "0.3.0"
  241. lwt_eio < "0.4"
  242. lwt_glib >= "1.0.1"
  243. lwt_log >= "1.1.0"
  244. lwt_ppx
  245. lwt_ppx_let
  246. lwt_react >= "1.0.1"
  247. lwt_ssl >= "1.0.1"
  248. mariadb < "0.5.1"
  249. markup = "0.7.6"
  250. markup-lwt
  251. mdx
  252. mechaml
  253. metrics-influx
  254. metrics-lwt
  255. metrics-mirage
  256. metrics-unix
  257. mindstorm-lwt
  258. mirage >= "0.4.1" & != "0.6.1" & < "0.8.0" | >= "0.10.0" & < "2.7.0"
  259. mirage-block < "1.0.0" | >= "2.0.0"
  260. mirage-block-ccm
  261. mirage-block-combinators
  262. mirage-block-lwt
  263. mirage-block-ramdisk
  264. mirage-block-solo5
  265. mirage-block-unix < "2.3.0" | = "2.8.2"
  266. mirage-block-xen
  267. mirage-bootvar-solo5 >= "0.2.0"
  268. mirage-bootvar-unix
  269. mirage-bootvar-xen >= "0.4.0"
  270. mirage-channel >= "4.0.0"
  271. mirage-channel-lwt
  272. mirage-clock-freestanding < "3.0.0"
  273. mirage-clock-lwt
  274. mirage-clock-unix >= "1.3.0" & < "3.0.0"
  275. mirage-console >= "3.0.0"
  276. mirage-console-lwt
  277. mirage-console-solo5 >= "0.2.0"
  278. mirage-console-unix >= "2.2.1"
  279. mirage-console-xen >= "5.0.0"
  280. mirage-console-xen-backend
  281. mirage-console-xen-cli
  282. mirage-crypto-entropy
  283. mirage-crypto-rng >= "0.7.0" & < "0.11.0"
  284. mirage-crypto-rng-lwt
  285. mirage-crypto-rng-mirage >= "0.8.8"
  286. mirage-device >= "2.0.0"
  287. mirage-dns < "3.0.0"
  288. mirage-entropy
  289. mirage-flow >= "1.0.3" & < "1.2.0" | >= "2.0.0"
  290. mirage-flow-combinators
  291. mirage-flow-lwt
  292. mirage-flow-rawlink
  293. mirage-flow-unix >= "1.3.0"
  294. mirage-fs >= "3.0.0"
  295. mirage-fs-lwt
  296. mirage-fs-unix < "1.1.1" | >= "1.3.0"
  297. mirage-http
  298. mirage-http-unix
  299. mirage-http-xen
  300. mirage-kv >= "3.0.0"
  301. mirage-kv-lwt
  302. mirage-kv-unix < "3.0.0"
  303. mirage-logs != "0.3.0"
  304. mirage-nat < "3.0.0"
  305. mirage-net >= "3.0.1"
  306. mirage-net-fd
  307. mirage-net-lwt
  308. mirage-net-macosx
  309. mirage-net-solo5
  310. mirage-net-unix >= "2.2.0"
  311. mirage-net-xen
  312. mirage-os-shim >= "3.0.0"
  313. mirage-profile
  314. mirage-protocols >= "4.0.0" & < "8.0.0"
  315. mirage-protocols-lwt
  316. mirage-qubes < "0.2" | >= "0.4" & < "0.9.4"
  317. mirage-qubes-ipv4 < "0.9.4"
  318. mirage-random-stdlib >= "0.1.0"
  319. mirage-runtime >= "3.7.0"
  320. mirage-solo5
  321. mirage-stack >= "2.0.0" & < "4.0.0"
  322. mirage-stack-lwt
  323. mirage-time >= "2.0.0"
  324. mirage-time-lwt
  325. mirage-time-unix
  326. mirage-types-lwt < "3.7.1"
  327. mirage-unix >= "3.0.0"
  328. mirage-vnetif
  329. mirage-vnetif-stack
  330. mirage-www >= "1.1.0"
  331. mirage-xen
  332. mirror
  333. monorobot
  334. moonpool-lwt
  335. mqtt = "0.0.2"
  336. mrmime >= "0.5.0"
  337. multipart-form-data >= "0.2.0"
  338. multipart_form >= "0.2.0" & < "0.4.0"
  339. multipart_form-lwt < "0.6.0"
  340. mwt
  341. naboris
  342. nanomsg
  343. nbd = "2.1.1" | >= "4.0.3"
  344. nbd-tool
  345. nbd-unix
  346. netchannel
  347. nocrypto >= "0.5.4"
  348. nottui-lwt
  349. nproc
  350. nsq >= "0.4.0"
  351. obrowser
  352. obuilder < "0.4"
  353. obus >= "1.2.1"
  354. ocaml-variants >= "4.00.1+mirage-unix" & < "4.00.1+open-types"
  355. ocluster < "0.2"
  356. ocluster-api < "0.2"
  357. ocplib-concur
  358. ocplib-resto
  359. ocsigen-start >= "4.1.0" & < "4.7.0"
  360. ocsigenserver >= "2.10"
  361. ocsipersist
  362. ocsipersist-dbm
  363. ocsipersist-lib
  364. ocsipersist-pgsql
  365. ocsipersist-sqlite
  366. odoc >= "2.0.0" & < "2.1.0"
  367. ojquery
  368. ojs-base < "0.6.0"
  369. opam-compiler < "0.2.0"
  370. opam-sync-github-prs
  371. openflow < "0.2.0"
  372. opium >= "0.11.0" & != "0.16.0" & < "0.19.0"
  373. opium_kernel
  374. opomodoro
  375. order-i3-xfce
  376. ordma >= "0.0.3"
  377. osc-lwt
  378. oskel >= "0.3.0"
  379. ounit-lwt < "2.2.0"
  380. ounit2-lwt
  381. owork
  382. ox < "1.1.0"
  383. paf
  384. paf-cohttp
  385. pcap-format >= "0.3.3" & < "0.5.0"
  386. pgx_lwt
  387. pgx_lwt_mirage
  388. pgx_lwt_unix < "2.0"
  389. plist-xml-lwt
  390. plotkicadsch >= "0.4.0"
  391. ppx_defer >= "0.4.0"
  392. ppx_deriving_rpc
  393. ppx_json_types
  394. ppx_netblob
  395. ppx_rapper_lwt
  396. ppx_sqlexpr
  397. prof_spacetime
  398. prometheus
  399. prometheus-app
  400. promise_jsoo_lwt
  401. protocol-9p >= "0.10.0"
  402. protocol-9p-unix
  403. qcow >= "0.8.1"
  404. qcow-format < "0.3"
  405. qcow-tool
  406. qfs = "0.5" | >= "0.7"
  407. quests
  408. rawlink >= "1.0" & < "2.1"
  409. rawlink-lwt
  410. redis-lwt
  411. resource-pooling >= "0.3.2"
  412. resp
  413. resp-mirage >= "0.10.0"
  414. resp-unix >= "0.10.0"
  415. resto
  416. resto-cohttp-client >= "0.4"
  417. resto-cohttp-self-serving-client
  418. resto-cohttp-server >= "0.4"
  419. resto-directory >= "0.4"
  420. riak
  421. ringo-lwt
  422. river
  423. rpc >= "1.5.1" & < "7.1.0"
  424. rpclib-js
  425. rpclib-lwt
  426. SZXX < "2.0.0"
  427. sanddb
  428. scgi
  429. sendmail-lwt
  430. serial
  431. session-cohttp-lwt
  432. session-cookie-lwt
  433. session-postgresql-lwt >= "0.4.1"
  434. sessions
  435. shared-block-ring < "2.3.0" | >= "3.0.0"
  436. shared-memory-ring >= "1.2.0" & < "2.0.0"
  437. shared-memory-ring-lwt
  438. slack
  439. slacko
  440. socket-daemon < "0.3.0"
  441. spin < "0.6.0"
  442. spotify-web-api < "0.2.1"
  443. sqlexpr = "0.7.1" | >= "0.9.0"
  444. statsd-client
  445. stog >= "0.16.0" & < "0.19.0"
  446. syndic >= "1.4" & < "1.6.0"
  447. tar-format >= "0.4.1"
  448. tar-mirage < "2.2.0"
  449. tar-unix
  450. tcpip >= "3.1.1" & < "3.4.1" | >= "4.1.0"
  451. teash
  452. telegraml
  453. tezos-error-monad >= "8.0" & < "9.0"
  454. tezos-lwt-result-stdlib >= "9.0" & < "11.0"
  455. tezos-p2p >= "11.0" & < "13.0"
  456. tezos-stdlib < "9.3"
  457. tezos-stdlib-unix < "9.0"
  458. tftp
  459. themoviedb
  460. tls = "0.10.1" | >= "0.10.6" & < "0.16.0"
  461. tls-lwt < "0.17.4"
  462. tls-mirage
  463. transmission-rpc
  464. tube >= "4.3.0"
  465. tuntap >= "1.0.0" & < "1.7.0" | >= "2.0.0"
  466. typerex-lldb
  467. u2f
  468. uring
  469. uspf
  470. uspf-lwt
  471. utop >= "1.4.0"
  472. uwt >= "0.3.0"
  473. vchan >= "0.9.7" & < "2.0.0" | >= "2.0.3"
  474. vchan-unix
  475. vchan-xen
  476. vercel
  477. vhd-format >= "0.7.0" & < "0.8.0"
  478. vhd-format-lwt >= "0.12.0"
  479. vhd-tool < "0.12.0"
  480. vmnet >= "1.3.2"
  481. vpnkit >= "0.2.0"
  482. vue-jsoo < "0.3"
  483. webauthn
  484. websocket < "2.3"
  485. xe-unikernel-upload
  486. xen-api-client < "0.9.14"
  487. xen-block-driver
  488. xen-evtchn < "1.0.6" | >= "2.0.0"
  489. xen-evtchn-unix
  490. xen-gnt >= "2.2.3"
  491. xen-gnt-unix >= "4.0.2"
  492. xenctrl < "0.9.29" | >= "0.9.32"
  493. xenstore >= "1.3.0"
  494. xenstore_transport >= "1.0.0"
  495. xentropyd
  496. yurt < "0.3"
  497. zmq-lwt

Conflicts (1)

  1. ocaml-variants = "4.02.1+BER"