olomana/ai/llama_cpp/README.md

6 lines
199 B
Markdown

# Llama.cpp
A general purpose llm server that projects can connect to.
## Network
Create the `ai` docker network, applications can access the OpenAI spec server through `http://llm-server:8080/v1`.