Alex's Slip-box

These are my org-mode notes in sort of Zettelkasten style

Llama

# Using it locally

This can be done easily enough in Jupyter lab

# Download a model

From https://gpt4all.io/index.html I downloaded nous-hermes-llama2-13b.Q4_0.gguf at the time of writing this.

# llama-cpp-python

See also https://github.com/abetlen/llama-cpp-python

pip install llama-cpp-python
from llama_cpp import Llama
llm = Llama(model_path="path/to/model")
llm("How do I add two numbers using elisp?")

Search Results