llama.cpp

ggerganov/llama.cpp (opens in a new tab)

LLM inference in C/C++

Inference of Meta's LLaMA model (and others) in pure C/C++