llama.cpp

AI Tools

Run Llama and other LLMs locally in pure C/C++ — tiny, fast, and runs on almost any laptop.