Results for “llama.cpp”

LLMKube

Kubernetes operator for llama.cpp-native LLM inference with GPU scheduling, Apple Silicon Metal support, and OpenAI-compatible API. ([Source Code](https://github.com/defilantech/LLMKube)) `Apache-2.0` `Go/Docker/K8S`

llama.cpp (GitHub)

Dépôt GitHub: llama.cpp par ggerganov