package angstrom
Install
Dune Dependency
Authors
Maintainers
Sources
sha256=4a4efc55aa6b7a4ff9932d61cabd4b161fa5f96a6fcb378c293927cfd29934c1
md5=d28420819001b4d47000b2b6dfbeaf9b
Description
Angstrom is a parser-combinator library that makes it easy to write efficient, expressive, and reusable parsers suitable for high-performance applications. It exposes monadic and applicative interfaces for composition, and supports incremental input through buffered and unbuffered interfaces. Both interfaces give the user total control over the blocking behavior of their application, with the unbuffered interface enabling zero-copy IO. Parsers are backtracking by default and support unbounded lookahead.
Published: 29 Apr 2020
README
Angstrom
Angstrom is a parser-combinator library that makes it easy to write efficient, expressive, and reusable parsers suitable for high-performance applications. It exposes monadic and applicative interfaces for composition, and supports incremental input through buffered and unbuffered interfaces. Both interfaces give the user total control over the blocking behavior of their application, with the unbuffered interface enabling zero-copy IO. Parsers are backtracking by default and support unbounded lookahead.
Installation
Install the library and its dependencies via OPAM:
opam install angstrom
Usage
Angstrom is written with network protocols and serialization formats in mind. As such, its source distribution includes implementations of various RFCs that are illustrative of real-world applications of the library. These include an HTTP parser and a JSON parser.
In addition, it is an informal tradition for OCaml parser-combinator libraries to include in their READMEs a parser for a simple arithmetic expression language. The code below implements a parser for such a language and computes the numerical result of the expression as it is being parsed. Because Angstrom is written with network protocols and serialization libraries in mind, it does not include combinators for creating infix expression parsers. Such combinators, e.g., chainl1
, are nevertheless simple to define.
open Angstrom
let parens p = char '(' *> p <* char ')'
let add = char '+' *> return (+)
let sub = char '-' *> return (-)
let mul = char '*' *> return ( * )
let div = char '/' *> return (/)
let integer =
take_while1 (function '0' .. '9' -> true | _ -> false) >>| int_of_string
let chainl1 e op =
let rec go acc =
(lift2 (fun f x -> f acc x) op e >>= go) <|> return acc in
e >>= fun init -> go init
let expr : int t =
fix (fun expr ->
let factor = parens expr <|> integer in
let term = chainl1 factor (mul <|> div) in
chainl1 term (add <|> sub))
let eval (str:string) : int =
match parse_string ~consume:All expr str with
| Ok v -> v
| Error msg -> failwith msg
For an explanation of the infix operators and other combinators used in the implementation of this example, see the documentation in the mli
.
Comparison to Other Libraries
There are several other parser-combinator libraries available for OCaml that may suit your needs, and are worth considering. Most of them are derivatives of or inspired by Parsec. As such, they require the use of a try
combinator to achieve backtracking, rather than providing it by default. They also all use something akin to a lazy character stream as the underlying input abstraction. While this suits Haskell quite nicely, it requires blocking read calls when the entire input is not immediately available—an approach that is inherently incompatible with monadic concurrency libraries such as Async and Lwt, and writing high-performance, concurrent applications in general. Another consequence of this approach to modeling and retrieving input is that the parsers cannot iterate over sections of input in a tight loop, which adversely affects performance.
Below is a table that compares the features of Angstrom against the those of other parser-combinator libraries.
Feature \ Library | Angstrom | mparser | planck | opal |
---|---|---|---|---|
Monadic interface | ✅ | ✅ | ✅ | ✅ |
Backtracking by default | ✅ | ❌ | ❌ | ❌ |
Unbounded lookahead | ✅ | ✅ | ✅ | ❌ |
Reports line numbers in errors | ❌ | ✅ | ❌ | ❌ |
Efficient take_while /skip_while |
✅ | ❌ | ❌ | ❌ |
Unbuffered (zero-copy) interface | ✅ | ❌ | ❌ | ❌ |
Non-blocking incremental interface | ✅ | ❌ | ❌ | ❌ |
Async Support | ✅ | ❌ | ❌ | ❌ |
Lwt Support | ✅ | ❌ | ❌ | ❌ |
Development
To install development dependencies, pin the package from the root of the repository:
opam pin add -n angstrom .
opam install --deps-only angstrom
After this, you may install a development version of the library using the install command as usual.
For building and running the tests during development, you will need to install the alcotest
package:
opam install alcotest
make test
Acknowledgements
This library started off as a direct port of the inimitable attoparsec library. While the original approach of continuation-passing still survives in the source code, several modifications have been made in order to adapt the ideas to OCaml, and in the process allow for more efficient memory usage and integration with monadic concurrency libraries. This library will undoubtedly diverge further as time goes on, but its name will stand as an homage to its origin.
License
BSD3, see LICENSE file for its text.
Dependencies (4)
- result
- bigstringaf
-
dune
>= "1.0"
-
ocaml
>= "4.04.0"
Dev Dependencies (1)
-
alcotest
with-test & >= "0.8.1"
Used by (36)
-
angstrom-async
>= "0.11.0"
- angstrom-lwt-unix
-
angstrom-unix
>= "0.11.0"
-
caqti
>= "1.7.0"
-
coin
< "0.1.3"
-
colombe
>= "0.3.0"
- confero
- dap
-
dream
< "1.0.0~alpha3"
- dream-httpaf
-
earlybird
< "1.0.0"
-
emile
>= "0.9"
-
encore
>= "0.5"
-
git
>= "2.1.3"
-
h2
!= "0.5.0"
- hpack
-
httpaf
>= "0.4.1" & != "0.6.6"
- httpun-ws
-
hxd
= "0.2.0"
-
icalendar
>= "0.1.4"
-
jasmin
>= "2024.07.0"
-
mrmime
>= "0.3.0"
- multipart_form
- multipart_form-eio
- multipart_form-lwt
- pb-plugin
-
pf-qubes
>= "0.1.1"
- piaf
- received
-
safemoney
< "0.2.0"
-
semver2
>= "1.1.0"
-
ssh-agent
= "0.2.1" | = "0.3.1"
- tldr
- unstrctrd
-
uri
>= "4.0.0"
-
uuuu
< "0.3.0"
Conflicts
None