package pardi

  1. Overview
  2. Docs
Parallel execution of command lines, pardi!

Install

Dune Dependency

Authors

Maintainers

Sources

v3.2.2.tar.gz
sha256=a340c038bdbf3bec1000966b7e55442e98f43272fcc69f343cc61dbb1f9a1da0
md5=0fc687f48a2a34973d414994618dea19

Description

Almost like GNU parallel; just better.

Pardi pushes further the point at which you have to use a supercomputer. Alternatively, it can be used on a supercomputer to make life in there much more fun and productive.

Put back the fun into computing: use pardi!

usage: pardi ... {-i|--input} : where to read from {-o|--output} : where to write to (default=stdout) [-s|--shell]: only shell commands in input file [{-n|--nprocs} ]: max jobs in parallel (default=all cores) [{-c|--chunks} ]: how many chunks per job (default=1) [{-d|--demux} {l|b:|r:|s:}]: how to cut input file into chunks (line/bytes/regexp/sep_line; default=line) {-w|--work} : command to execute on each chunk %IN and %OUT are special tokens [{-m|--mux} {c|n}]: how to mux job results in output file (cat/null; default=cat) [{-ie|--input-ext} ]: append file extension to work input files [{-oe|--output-ext} ]: append file extension to work output files [{-p|--preserve}]: mux results while preserving input order

Published: 16 Apr 2021

README

ParDi

Parallel and Distributed execution of command lines, pardi !

Example

Compress a file in parallel using 1MB chunks:

pardi -d b:1048576 -p -i <YOUR_BIG_FILE> -o <YOUR_BIG_FILE>.xz -w 'xz -c -9 %IN > %OUT'

Standardize molecules in parallel:

pip3 install chemo-standardizer
pardi -i input.smi -o output_std.smi -c 400 -d l -ie '.smi' -oe '.smi' \
      -w 'standardiser -i %IN -o %OUT 2>/dev/null'

Install

For beginners or non opam users: download and execute the latest self-installer shell script from (https://github.com/UnixJunkie/pardi/releases).

Then, execute:

./pardi-2.0.1.sh ~/usr/pardi-2.0.1

This will create ~/usr/pardi-2.0.1/bin/pardi.

For opam users:

opam install pardi

Do not hesitate to contact the author in case of troubles or if you have any question.

Dependencies (6)

  1. ocaml >= "4.05.0"
  2. minicli >= "5.0.0"
  3. parany >= "11.0.0"
  4. dolog >= "4.0.0"
  5. batteries
  6. dune >= "1.11"

Dev Dependencies

None

Used by

None

Conflicts

None

OCaml

Innovation. Community. Security.