Browsing Tag
Self-hosting
27 posts
Local MoE model: what Colibri asks of your disk
Local MoE model with Colibri: RAM, NVMe disk, published speeds and monitoring via /metrics. What the README says before you download 400 GB.
traceroot AI agent observability: licence, setup and limits
traceroot AI agent observability: traces, detectors and cost, a four-command Docker start, Apache 2.0 licence plus Enterprise folders, limits checked.
Ollama vLLM llama.cpp: which local engine should you choose for LLMs?
Ollama vLLM llama.cpp: compare these three local inference engines by use case, hardware and monitoring (metrics, health checks, traces).
NVIDIA OpenShell agent runtime: isolate and audit AI agents
NVIDIA OpenShell agent runtime: README getting started, default-deny network policy, OCSF logs, SIEM export and the limits of a 0.x release.
Paperclip AI agent orchestration: install and monitor
Paperclip AI agent orchestration, open source: README install steps, agent activity, costs and budgets to supervise, and limits of a very young project.
Octop self-hosted AI assistant: install and secure it
Octop self-hosted AI assistant from TencentCloud: install per the README, interface tour, data, agent rights and observability with Langfuse.
freellmapi: free LLM unified API, risks and install
freellmapi free LLM unified API: OpenAI-compatible router, README install steps, provider terms of use, quotas and what happens to your prompts.
freehire job search engine: open source in Go
freehire job search engine, open source in Go: MIT licence, installation from the README, limits and how to monitor the API and its scheduled jobs.
ComfyUI diffusion node interface: install and monitor
ComfyUI diffusion node interface: GPL-3.0 licence explained, installation from the README, a tour of the graph and monitoring of a GPU server.
Twenty CRM open source: install, licence and monitoring
Twenty CRM open source: AGPL, MIT and Enterprise-file licensing, Docker install from the docs, health checks and what to monitor when self-hosting.