package b0
Install
dune-project
Dependency
Authors
Maintainers
Sources
sha512=e9aa779e66c08fc763019f16d4706f465d16c05d6400b58fbd0313317ef33ddea51952e2b058db28e65f7ddb7012f328c8bf02d8f1da17bb543348541a2587f0
doc/b0.memo/B0_memo/index.html
Module B0_memo
Source
Build memoizer
Memoizer
The type for memoizers. Provides a context to issue memoizable operations.
Tool spawns
TODO explain better how this all works and try to simplify. If the path given to Tool.t
is not made of a single path segment it is not search in the environmet and it is the duty of the client to ensure it gets ready at some point. Either by a direct call to ready_file
or by another file write.
The type for tool lookups. Given a command line tool specification returns a file path to the tool executable or an error message mentioning the tool if it cannot be found.
env_tool_lookup ~sep ~var env
is a tool lookup that gets the value of the var
variable in env
treats it as a sep
separated search path and uses the result to lookup with B0_std.Os.Cmd.get
with the memo's win_exe
. var
defaults to PATH
and sep
to B0_std.Fpath.search_path_sep
.
The type for memoized tool invocations.
The type for memoized tools.
tool m t
is tool t
memoized. Use the resulting function to spawn the tool with the given arguments.
tool_opt m t
is like tool
, except None
is returned if the tool cannot be found. y
val spawn :
t ->
?stamp:string ->
?reads:B0_std.Fpath.t list ->
?writes:B0_std.Fpath.t list ->
?env:B0_std.Os.Env.t ->
?cwd:B0_std.Fpath.t ->
?stdin:B0_std.Fpath.t ->
?stdout:B0_zero.Op.Spawn.stdo ->
?stderr:B0_zero.Op.Spawn.stdo ->
?success_exits:B0_zero.Op.Spawn.success_exits ->
?post_exec:(B0_zero.Op.t -> unit) ->
?k:(B0_zero.Op.t -> int -> unit) ->
cmd ->
unit
spawn m ~reads ~writes ~env ~cwd ~stdin ~stdout ~stderr ~success_exits cmd
spawns cmd
once reads
files are ready and makes files writes
ready if the spawn succeeds and the file exists. The rest of the arguments are:
stdin
reads input from the given file. If unspecified reads from the standard input of the program running the build. Warning. The file is not automatically added toreads
, this allows for example to useB0_std.Fpath.null
.stdout
andstderr
, the redirections for the standard outputs of the command, seeB0_zero.Op.Spawn.stdo
. Path to files are created if needed. Warning. File redirections are not automatically added towrites
; this allows for example to useB0_std.Fpath.null
.success_exits
the exit codes that determine if the build operation is successful (defaults to0
, use[]
to always succeed)env
, environment variables added to the build environment. This overrides environment variables read by the tool in the build environment except for forced one. It also allows to specify enovironment that may not be mentioned by the running tool's environment specification.cwd
the current working directory. Default is the memo'scwd
. In general it's better to avoid using relative file paths and tweaking thecwd
. Construct make your paths absolute and invocations independent from thecwd
.post_exec
, if specified is called with the build operation after it has been executed or revived. If it was executed this is called before the operation gets recorded. It can be used to define thereads
andwrites
of the operation if they are difficult to find out before hand. Do not accessm
in that function.k
, if specified a function invoked once the spawn has succesfully executed with the operation and the exit code.stamp
is used for caching if two spawns diff only in their stamp they will cache to different keys. This can be used to memoize tool whose outputs may not entirely depend on the environment, the cli stamp and the the content of read files.
Note. If the tool spawn acts on a sort of "main" file (e.g. a source file) it should be specified as the first element of reads
, this is interpreted specially by certain build tracer.
val spawn' :
t ->
?stamp:string ->
?reads:B0_std.Fpath.t list ->
writes_root:B0_std.Fpath.t ->
?writes:(B0_zero.Op.t -> B0_std.Fpath.t list) ->
?env:B0_std.Os.Env.t ->
?cwd:B0_std.Fpath.t ->
?stdin:B0_std.Fpath.t ->
?stdout:B0_zero.Op.Spawn.stdo ->
?stderr:B0_zero.Op.Spawn.stdo ->
?success_exits:B0_zero.Op.Spawn.success_exits ->
?k:(B0_zero.Op.t -> int -> unit) ->
cmd ->
unit
spawn'
is like spawn
except the actual file paths written by the spawn need not be determined before the spawn. Only the root directory of writes need to be specified via writes_root
. After the spawn executes the writes can be determined via the writes
function, the returned paths must be absolute and be prefixed by writes_root
(defaults to recursively list all the files rooted in writes_root
).
Procedures and failing them
run_proc m proc
calls proc ()
and handles any fail
ure. This also catches non-asynchronous uncaught exceptions and turns them into `Fail
notification operations.
fail m fmt ...
fails the procedure via a notify
operation.
fail_if_error m r
is v
if r
is Ok v
and fail m "%s" e
if r
is Error _
.
Files and directories
read_file m p
declares path p
to be ready, that is exists and is up-to-date in b
. This is typically used with source files and files external to the build like installed libraries.
ready_files m ps
is List.iter (ready_files m) ps
.
read m file k
is a future that determines with the contents s
of file file
when it becomes ready in m
.
val write :
t ->
?stamp:string ->
?reads:B0_std.Fpath.t list ->
?mode:int ->
B0_std.Fpath.t ->
(unit -> (string, string) result) ->
unit
write m ~reads file w
writes file
with data w ()
and mode mode
(defaults to 0o644
) when reads
are ready. w
's result must only depend on reads
, mode
and stamp
(defaults to ""
) and should not perform other side effects on the file system.
copy m ~mode ?linenum src ~dst
copies file src
to dst
with mode mode
(defaults to 0o644
) when src
is ready. If linenum
is specified, the following line number directive is prependend in dst
to the contents of src
:
#line $(linenum) "$(src)"
val copy_to_dir :
t ->
?mode:int ->
?linenum:int ->
?src_root:B0_std.Fpath.t ->
B0_std.Fpath.t ->
dst_dir:B0_std.Fpath.t ->
B0_std.Fpath.t
copy_to_dir ~src_root src dir
is copy src ~dst_dir
with dst
defined as B0_std.Fpath.reroot
~src_root ~dst_root:dst_dir src
Otherwise said, src
gets copied in a subpath of dst
defined by Fpath.strip_prefix
src_root src
. src_root
defaults to Fpath.parent src
which means that src
gets copied at the root of dst
.
val ready_and_copy_to_dir :
t ->
?mode:int ->
?linenum:int ->
?src_root:B0_std.Fpath.t ->
B0_std.Fpath.t ->
dst_dir:B0_std.Fpath.t ->
B0_std.Fpath.t
ready_and_copy_to_dir
is like copy_to_dir
but calls ready_file
on the copied file.
val ready_and_copy_dir :
?rel:bool ->
?follow_symlinks:bool ->
?prune:(Unix.stats -> string -> B0_std.Fpath.t -> bool) ->
t ->
?mode:int ->
?linenum:int ->
recurse:bool ->
?src_root:B0_std.Fpath.t ->
B0_std.Fpath.t ->
dst:B0_std.Fpath.t ->
B0_std.Fpath.t list
ready_and_copy_dir m ~recurse src ~dst
lists files of src
and applies ready_and_copy_to_dir
with the corresponding arguments.
src_root
defaults to src
which is the B0_std.Fpath.parent
of the copied files. So elements of src
are rooted at dst
by default.
mkdir m dir p
is a future that determines with ()
when the directory path p
has been created with mode mode
(defaults to 0o755
). The behaviour with respect to file permission of intermediate path segments matches B0_std.Os.Dir.create
.
delete m p
is a future that determines with ()
when path p
is deleted (trashed in fact) and free to reuse.
wait_files m files
is a future that deterines with ()
when all files
are ready in m
. FIXME Unclear whether we really want this, but somehow it's part of the primitives.
Activity marks
Activity marks are just identifiers used for UI purposes to watermark the activity – notably build operations – occuring in the memo.
mark m mark
is m
but operations performed on m
are marked by mark
.
Feedback
XXX This needs a bit of reviewing.
val notify :
?k:(unit -> unit) ->
t ->
notify_kind ->
('a, Format.formatter, unit, unit) format4 ->
'a
notify m kind msg
is a notification msg
of kind kind
. Note that a `Fail
notification will entail an an has_failures
on the memo, see also fail
and fail_if_error
.
notify_if_error m kind ~use r
is v
if r
is Ok v
. If r
is Error e
, a notification of kind kind
is added to m
and use
is returned. Note that a `Fail
notification will entail an has_failures
on the memo, see also fail
and fail_if_error
.
Creating
The type for memoizer feedback.
val make_zero :
?clock:B0_std.Os.Mtime.counter ->
?cpu_clock:B0_std.Os.Cpu.Time.counter ->
feedback:(feedback -> unit) ->
cwd:B0_std.Fpath.t ->
?win_exe:bool ->
?tool_lookup:tool_lookup ->
?env:B0_std.Os.Env.t ->
?forced_env_vars:Tool.env_vars ->
B0_zero.Guard.t ->
B0_zero.Reviver.t ->
B0_zero.Exec.t ->
(t, string) result
val make :
?hash_fun:(module B0_hash.T) ->
?win_exe:bool ->
?tool_lookup:tool_lookup ->
?env:B0_std.Os.Env.t ->
?forced_env_vars:Tool.env_vars ->
?cwd:B0_std.Fpath.t ->
?jobs:int ->
?feedback:([ feedback | B0_zero.Exec.feedback ] -> unit) ->
cache_dir:B0_std.Fpath.t ->
trash_dir:B0_std.Fpath.t ->
unit ->
(t, string) result
make
is a simpler make_zero
hash_fun
defaults toB0_std.Hash.Xxh3_64
.jobs
defaults toB0_std.Os.Cpu.logical_count
.env
defaults toB0_std.Os.Env.current
cwd
defaults toB0_std.Os.Dir.cwd
cache_dir
is the cache directory.trash_dir
is the trash directory.feedback
defaults to a nop.forced_env_vars
, defaults to[]
.
with_feedback m feedback
is m
with feedback replaced by feedback
.
Low-level operations
delete_trash ~block m
is B0_zero.Trash.delete
~block (trash m)
.
hash_string m s
is B0_zero.Reviver.hash_string
(reviver m) s
.
hash_file m f
is B0_zero.Reviver.hash_file
(reviver m) f
. Note that these file hashes operations are memoized.
stir ~block m
runs the memoizer a bit. If block
is true
blocks until the memoizer is stuck with no operation to execute.
status m
looks for aggregate errors in m
in ops m
, see B0_zero.Op.aggregate_error
for details.
Usually called after a blocking stir
to check everything executed as expected. The function itself has no effect more operations can be on m
afterwards. If you are only interested in checking if a failure occured in the memo has_failures
is faster.
timestamp m
gets a clock
time stamp.
Properties
clock m
is m
's clock.
cpu_clock m
is m
's cpu clock.
env m
is the environment of m
. The environment read by the tools' declared environment variables.
exec m
is m
's executors.
forced_env_vars m
are the forced environment variables of m
. These variables are put in the stamped environment of any tool despite what it declares to access.
guard m
is m
's guard.
ops m
is the list of operations that were submitted to the memoizer
reviver m
is m
's reviver.
tool_lookup m
is m
's tool lookup function.
trash m
is m
's trash.