package parany
Install
Dune Dependency
Authors
Maintainers
Sources
sha256=f21d89999c176a822b02139d70c115ea7962e483be41eeb94aa57f4c531cbecf
md5=721637080520affb02ea2be3c3d0158e
Description
Generalized map reduce for parallel computers (not distributed computing). Can process in parallel an infinite stream of elements.
Can process a very large file in parallel on a multicore computer; provided there is a way to cut your file into independent blocks (the 'demux' function). The processing function is called 'work'. The function gathering the results is called 'mux'. The number of processors running your computation in parallel is called 'nprocs'. The chunk size (number of items) processed by one call to the 'work' function is called 'csize'.
There is a minimalist Parmap module, if you want to switch to/from Parmap easily.
Read the corresponding ocamldoc before using.
Published: 15 Dec 2022
README
parany
Parallelize any kind of computation
Generalized map reduce for parallel computers (not distributed computing).
Can process a very large file in parallel on a multicore computer; provided there is a way to cut your file into independent blocks (the "demux" function).
Can process in parallel an infinite stream of elements.
The processing function is called "work". The function gathering the results is called "mux". The number of processors running your computation in parallel is called "nprocs".
Dependencies (3)
-
ocaml
>= "5.0.0"
-
dune
>= "1.6.0"
-
domainslib
>= "0.5.0"
Dev Dependencies
None
Used by (12)
Conflicts
None