package alcotest
Build not yet checkedInstall
dune-project
Dependency
Authors
Maintainers
Sources
sha256=62c095deda5cdd66c30684f7b1f25b5775d1d3d3ded927c7b893b4a6834ddb47
sha512=6f779fa96faf96b5b462ddc428aeaaa73a6be96771dbbad6a05b7bb00dae246648891c211e26174729c1f40128410ad96f2512101ae8b7d61f968ee61534b3d0
doc/alcotest.engine/Alcotest_engine/V1/Cli/Make/index.html
Module Cli.MakeSource
Parameters
module _ : Platform.MAKERSignature
The return type of each test case run by Alcotest. For the standard Alcotest module, return = unit. The concurrent backends Alcotest_lwt and Alcotest_async set return = unit Lwt.t and return = unit Async.Deferred.t respectively.
When a test runs. The command line sets up a context, a set of tags that starts with quick and slow: -q removes slow, and --tags adds or removes tags. `Quick, `Slow and `Tag s hold when quick, slow and s are in the context, `And, `Or and `Not combine them, and `Always always holds.
A test case is a UTF-8 encoded documentation string, when it runs and a function to execute. Typically, the testing function calls the helper functions provided below (such as check and fail).
test_case n t f is the test case n using the function f, which runs when t holds.
test name f is the test case name using the function f. It only runs when tags hold, which defaults to `Always.
group name cases is a test case that stands for cases, which run in place under the test name test.name, so that they can be selected together. Groups nest. name must not be empty. cases only run when tags hold as well as their own, and tags defaults to `Always.
A group is recognised by physical equality on the returned tuple, so it can appear several times and under different parents. A new tuple built from it is a plain test case, whose function runs all of cases. Functions on a list of test cases, like List.filter, see the group and not its cases.
The test subcommand matches names as a regular expression, so test top also selects top.name. Use test '^top$' to select only the cases outside of groups. A test called top.name next to a group name in top is a duplicate test path if their indices overlap.
A test is a UTF-8 encoded name and a list of test cases. The name can be used for filtering which tests to run on the CLI.
suite name cases is the test name with the test cases cases.
type 'a with_options =
?stdout:Formatters.stdout ->
?stderr:Formatters.stderr ->
?and_exit:bool ->
?verbose:bool ->
?compact:bool ->
?tail_errors:[ `Unlimited | `Limit of int ] ->
?quick_only:bool ->
?show_errors:bool ->
?json:bool ->
?filter:(name:string -> index:int -> [ `Run | `Skip ]) ->
?log_dir:string ->
?bail:bool ->
?record_backtrace:bool ->
?ci:[ `Github_actions | `Unknown | `Disabled ] ->
'aThe various options taken by the tests runners run and run_with_args:
stdout(default toFmt.stdout). The formatter used to print on the standard output.stderr(default toFmt.stderr). The formatter used to print ont the standard error output.and_exit(defaulttrue). Once the tests have completed, exit with return code0if all tests passed, otherwise1.verbose(defaultfalse). Display the test std.out and std.err (rather than redirecting to a log file).compact(defaultfalse). Compact the output of the tests.tail_errors(default unlimited). Show only the last N lines of output of failed tests.quick_only(defaultfalse). Do not run the`Slowtests, unless--tagsselects them.show_errors(defaultfalse, ortruewhen a CI is detected). Display the test errors.json(defaultfalse). Print test results in a JSON-compatible format.filter. Filter tests according to~name, the name of the test, and~index, the number of the test case.log_dir(default"$PWD/_build/_tests/", or"$DUNE_SOURCEROOT/_build/_tests/"under dune). The directory in which to log the output of the tests. Each run also writes a JUnit XML report in itsjunitdirectory, where a failedcheckorfailis a<failure>and any other exception is an<error>.bail(defaultfalse). If true, stop running the tests after the first failure.record_backtrace(defaulttrue). Enable backtrace recording before beginning testing.ci(default auto-detected). Whether to enable specific logging for a CI system.
run n t runs the test suite t. n is the name of the tested library.
The optional argument and_exit controls what happens when the function ends. By default, and_exit is set, which makes the function exit with 0 if everything is fine or 1 if there is an issue. If and_exit is false, then the function raises Test_error on error.
The optional argument argv specifies command line arguments sent to alcotest like "--json", "--verbose", etc. Note that this array will be treated like a regular Sys.argv, so the array must have at least one element, and the first element will be treated as if it was the command name and thus ignored for the purposes of option processing. So ~argv:[||] is an error, ~argv:[| "--verbose" |] will have no effect, and ~argv:[| "ignored"; "--verbose" |] will successfully pass the verbose option.
val run_with_args :
(?argv:string array ->
string ->
'a Cmdliner.Term.t ->
'a test list ->
return)
with_optionsrun_with_args n a t Similar to run a t but take an extra argument a. Every test function will receive as argument the evaluation of the Cmdliner term a: this is useful to configure the test behaviors using the CLI.