Results for “MLC LLM”

Cactus Compute

Open-source on-device AI runtime that runs LLMs, vision models and speech models directly on phones, laptops and wearables — no cloud round-trip required.

Patronus AI

A safety checker for AI systems that catches hallucinations, unsafe answers and factual mistakes before they reach a user, using its own purpose-built judge models instead of relying on a general-purpose LLM to grade itself.

Laminar

A dashboard that shows you exactly what your AI agent did, step by step, when it fails — every tool call, every sub-agent, every LLM response — instead of leaving you to guess from a wall of logs.

Morph

API that instantly merges AI-generated code edits into your actual files, so coding agents can make changes without rewriting whole files.

PromptLayer

Collaboration platform for AI teams to manage, test and monitor the prompts that power their LLM applications.

promptfoo

Open-source LLM eval and red teaming: test prompts, compare models, catch jailbreaks and data leaks locally and in CI.

Helicone

Open-source AI gateway and LLM observability: one API for 100+ models, cost and latency tracking, prompt management.

Braintrust

AI eval and observability platform: tracing, LLM and human scoring, quality gates. Used by Vercel, Notion and Replit.

Enforster AI

copyright: — Enforster AI performs Contextual Code Security SAST, leveraging LLMs and artificial intelligence to reduce and enrich the detection of Logic Flaws, Secrets, Data leaks, Supply chain and technical vulnerabilities.

sim

Sim Studio's interface is a lightweight, intuitive way to quickly build and deploy LLMs that connect with your favorite tools.

Fiddler AI

The all-in-one AI Observability and Security platform for responsible AI. It provides monitoring, analytics, and centralized controls to operationalize ML, GenAI, and LLM applications with trust. Fiddler helps enterprises scale LLM and ML deployments to deliver high performance AI, reduce costs, and be responsible in governance.

Localforge

Is an [open source](https://github.com/rockbite/localforge) on-prem AI coding autonomous assistant that lives inside your repo, edits and tests files at SSD speed. Think Claude Code but with UI. plug in any LLM (OpenAI, Gemini, Ollama, etc.) and let it work for you.

Phoenix

Uncover insights, surface problems, monitor and fine tune your generative LLM, CV and tabular models.

WatchFullMovie

WatchFullMovie

Onyx Community Edition

Chat UI that works with any LLM. It comes loaded with advanced features like agents, web search, RAG, MCP, deep research, Connectors to 40+ knowledge sources, and more. ([Source Code](https://github.com/onyx-dot-app/onyx)) `MIT` `Docker/K8S`

LLMKube

Kubernetes operator for llama.cpp-native LLM inference with GPU scheduling, Apple Silicon Metal support, and OpenAI-compatible API. ([Source Code](https://github.com/defilantech/LLMKube)) `Apache-2.0` `Go/Docker/K8S`

Khoj

Your AI second brain. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI. ([Demo](https://app.khoj.dev/), [Source Code](https://github.com/khoj-ai/khoj)) `AGPL-3.0` `Python/Docker`

AnythingLLM

All-in-one desktop & Docker AI application with built-in RAG, AI agents, No-code agent builder, MCP compatibility, and more. ([Source Code](https://github.com/Mintplex-Labs/anything-llm)) `MIT` `Nodejs/Docker`

Agenta

LLMOps platform for prompt management, LLM evaluation, and observability. Build, evaluate, and monitor production-grade LLM applications with collaborative prompt engineering. ([Source Code](https://github.com/agenta-ai/agenta)) `MIT` `Docker`

MLCOURSE.AI

Open Machine Learning course by OpenDataScience