olomana/ai/llama_cpp

Llama.cpp

A general purpose llm server that projects can connect to.

Network

Create the ai docker network, applications can access the OpenAI spec server through http://llm-server:8080/v1.