jr/olomana
1
0
Fork 0
mirror of https://github.com/runyanjake/olomana.git synced 2026-11-10 13:54:52 -08:00
Code Issues Packages Projects Releases Wiki Activity
olomana/ai/llama_cpp/README.md

199 B
Raw Blame History

Llama.cpp

A general purpose llm server that projects can connect to.

Network

Create the ai docker network, applications can access the OpenAI spec server through http://llm-server:8080/v1.