package llama-cpp-ocaml

  1. Overview
  2. Docs
Ctypes bindings to llama.cpp

Install

Dune Dependency

Authors

Maintainers

Sources

0.0.1.tar.gz
md5=c06de6ef9bb6e7d6083d44a0c5cf5c79
sha512=afcc59fb8f80a64378d501b22ff63f1d03100d3151e39b552a0e70759a3ab6ec31003fb0bad06b1d7225b800a59f2198f80643d220b269c5845d60fef6552652

Description

llama-cpp-ocaml is a MIT-licensed set of ctypes bindings to llama.cpp, a performant and lightweight library to perform inference on various kinds of large language models.

Tags

experimental

Published: 18 Sep 2023

README

llama-cpp-ocaml

llama-cpp-ocaml is a MIT-licensed set of ctypes bindings to llama.cpp, a performant and lightweight library to perform inference on various kinds of large language models (LLMs).

An example was ported from the original distribution, see examples/simple.

To obtain model files compatible with llama.cpp, please refer to the README of https://github.com/ggerganov/llama.cpp/

Dependencies (7)

  1. dune-configurator >= "2.8"
  2. bigarray-compat >= "1.1.0"
  3. integers >= "0.7.0"
  4. ctypes-foreign >= "0.21.1"
  5. ctypes >= "0.21.1"
  6. ocaml >= "4.14.1"
  7. dune >= "2.8"

Dev Dependencies (1)

  1. odoc with-doc

Used by

None

Conflicts

None

OCaml

Innovation. Community. Security.