package daft

  1. Overview
  2. Docs
DAFT Allows File Transfers

Install

Dune Dependency

Authors

Maintainers

Sources

v0.0.4.tar.gz
md5=8f1ac7772a8845339160cf3477e62a89

Description

Summary:

Distributed file transfer application in user space.

Securely move data files during distributed computational experiments and provide a global view of all files, even when there is no distributed filesystem and probably faster than NFS for large files.

Available commands:

put filename: add/publish a given file into the system.

bcast filename: equivalent to put then send the file to all nodes.

get filename: retrieve a file previously published into the system.

ls [-l]: list all files known to the system and optionally where
         their chunks are.

Published: 11 Jan 2023

README

DAFT

DAFT Allows File Transfers

Summary

Distributed file transfer application in user space.

Securely move data files during distributed computational experiments and provide a global view of all files, even when there is no distributed filesystem and probably faster than NFS for large files.

Provided commands

  • put filename: add/publish a given file into the system.

  • bcast filename: equivalent to put then send the file to all nodes.

  • get filename: retrieve a file previously published into the system.

  • ls [-l]: list all files known to the system and optionally where their chunks are.

Installation

Prerequisite: you need opam installed; c.f. [opam] http://opam.ocaml.org/doc/Install.html.

opam install depext
opam depext ZMQ
opam depext cryptokit
opam install dolog batteries fileutils ZMQ cryptokit
make config
make build
make install

Example user session

TODO

Specification

To maintain complexity low, the system will be Write Once Read Many (WORM). Files put under the system's control are never modified. There will be several data servers (one per node) and at least one meta-data server (on the node where the user is interacting with the system, or remote).

Dependencies

[batteries] http://batteries.forge.ocamlcore.org/

[zeromq] http://zeromq.org/

[dolog] https://github.com/UnixJunkie/dolog/

[fileutils] http://ocaml-fileutils.forge.ocamlcore.org/

[cryptokit] https://forge.ocamlcore.org/projects/cryptokit/

Dependencies (8)

  1. base-unix
  2. cryptokit
  3. zmq >= "5.0.0" & < "5.1.4"
  4. fileutils
  5. batteries
  6. dolog >= "4.0.0"
  7. dune >= "1.1"
  8. ocaml >= "5.0.0"

Dev Dependencies

None

Used by

None

Conflicts

None