Alex's Slip-box

These are my org-mode notes in sort of Zettelkasten style


# Using it locally

This can be done easily enough in Jupyter lab

# Download a model

From I downloaded nous-hermes-llama2-13b.Q4_0.gguf at the time of writing this.

# llama-cpp-python

See also

pip install llama-cpp-python
from llama_cpp import Llama
llm = Llama(model_path="path/to/model")
llm("How do I add two numbers using elisp?")

Search Results