package irmin-pack

  1. Overview
  2. Docs
Irmin backend which stores values in a pack file

Install 

dune-project
 Dependency

github.com Readme Changelog ISC License Edit opam file Versions (9)

Authors

  1. T
    Thomas Gazagnaire

Maintainers

  1. T
    thomas@gazagnaire.org

Sources

irmin-3.5.2.tbz
sha256=2a1e6a7577e498fbfeb678d666da210dc48d1344637e8ecb653e1dd88c640b5f
sha512=3fb6f49a1af2f8bab1df5b6f5affaaa09f09fe892a08eb2d9de58138e56646d4a6797f3c087b22875e36e3411218ab2435fe5437ac78f323dd661932af021fad

doc/irmin-pack.unix/Irmin_pack_unix/Chunked_suffix/Make/index.html

Module Chunked_suffix.MakeSource

Abstraction for a chunked suffix. It is functionally equivalent to Append_only_file but with a chunked implementation that is parameterized by

  • start_idx for create_rw to know the starting file name, and
  • start_idx and chunk_num for the open functions to know the starting file name and how many files there are.

Parameters

module Io : Io.S
module Errs : Io_errors.S with module Io = Io

Signature

module Io = Io
module Errs = Errs

Abstraction for irmin-pack's append only files (i.e. suffix and dict).

Sourcetype t
Sourcetype create_error = Io.create_error
Sourcetype open_error = [
  1. | Io.open_error
  2. | `Closed
  3. | `Invalid_argument
  4. | `Inconsistent_store
  5. | `Read_out_of_bounds
]
Sourcetype add_new_error = [
  1. | open_error
  2. | Io.close_error
  3. | `Pending_flush
  4. | `File_exists of string
  5. | `Multiple_empty_chunks
]
Sourceval create_rw : root:string -> start_idx:int -> overwrite:bool -> auto_flush_threshold:int -> auto_flush_procedure:Ao.auto_flush_procedure -> (t, [> create_error ]) result
Sourceval open_rw : root:string -> appendable_chunk_poff:Optint.Int63.t -> start_idx:int -> chunk_num:int -> dead_header_size:int -> auto_flush_threshold:int -> auto_flush_procedure:Ao.auto_flush_procedure -> (t, [> open_error ]) result
Sourceval open_ro : root:string -> appendable_chunk_poff:Optint.Int63.t -> dead_header_size:int -> start_idx:int -> chunk_num:int -> (t, [> open_error ]) result
Sourceval add_chunk : auto_flush_threshold:int -> auto_flush_procedure:Ao.auto_flush_procedure -> t -> (unit, [> add_new_error ]) result
Sourceval start_idx : t -> int
Sourceval chunk_num : t -> int
Sourceval close : t -> (unit, [> Io.close_error | `Pending_flush ]) result
Sourceval empty_buffer : t -> bool
Sourceval flush : t -> (unit, [> Io.write_error ]) result
Sourceval fsync : t -> (unit, [> Io.write_error ]) result
Sourceval appendable_chunk_poff : t -> Optint.Int63.t

appendable_chunk_poff t is the number of bytes of the chunk file that is currently appendable. It does not perform IO.

RW mode

It also counts the bytes not flushed yet.

RO mode

This information originates from the latest reload of the control file. Calling refresh_appendable_chunk_poff t updates appendable_chunk_poff.

Sourceval refresh_appendable_chunk_poff : t -> Optint.Int63.t -> (unit, [> `Rw_not_allowed ]) result

Ingest the new end offset of the appendable chunk file. Typically happens in RO mode when the control file has been re-read.

RW mode

Always returns Error `Rw_not_allowed.

Sourceval end_soff : t -> Optint.Int63.t

end_soff t is the end offset for the chunked suffix. The valid range of offsets is 0 <= off < end_soff. Therefore, end_soff also represents the length of the chunked suffix.

Sourceval read_exn : t -> off:Optint.Int63.t -> len:int -> bytes -> unit
Sourceval append_exn : t -> string -> unit
Sourceval readonly : t -> bool
Sourceval auto_flush_threshold : t -> int option
Sourceval fold_chunks : (acc:'a -> idx:int -> start_suffix_off:Optint.Int63.t -> end_suffix_off:Optint.Int63.t -> is_appendable:bool -> 'a) -> 'a -> t -> 'a