package llama-cpp-ocaml

  1. Overview
  2. Docs
Ctypes bindings to llama.cpp

Install

Dune Dependency

Authors

Maintainers

Sources

0.0.1.tar.gz
md5=c06de6ef9bb6e7d6083d44a0c5cf5c79
sha512=afcc59fb8f80a64378d501b22ff63f1d03100d3151e39b552a0e70759a3ab6ec31003fb0bad06b1d7225b800a59f2198f80643d220b269c5845d60fef6552652

README.md.html

llama-cpp-ocaml

llama-cpp-ocaml is a MIT-licensed set of ctypes bindings to llama.cpp, a performant and lightweight library to perform inference on various kinds of large language models (LLMs).

An example was ported from the original distribution, see examples/simple.

To obtain model files compatible with llama.cpp, please refer to the README of https://github.com/ggerganov/llama.cpp/

OCaml

Innovation. Community. Security.