Category: Local LLM

How to Use LangChain with Ollama: Chat, RAG and Agents Locally (2026 Guide)
Use LangChain with Ollama on LangChain 1.x: install langchain-ollama, ChatOllama basics, chains, streaming, structured output, tool calling, a local create_agent agent and a complete chat-with-your-PDF RAG app, plus…

Ollama Decision Models: Run Nimble, Clef, pplx-decider and AutoTrust Locally (/v1/systemone Guide)
Every local decision model in Ollama compared, plus CLI, /v1/systemone API and Python examples for routing, moderation and grading with probabilities.

Ollama Guide (2026): Install, Best Models, Commands, API and Fixes
The complete Ollama guide: install on Windows, Mac and Linux, pick a model for your VRAM, key commands and settings, Open WebUI, the API, storage and fixes.

How to Use the Ollama API: Python, curl and OpenAI-Compatible Guide (2026)
Use the Ollama API step by step: endpoints, curl and Python examples, chat history, streaming, JSON outputs, tool calling, thinking, embeddings, the OpenAI-compatible /v1 API, remote access and…

LongCat-2.5 Open Weights: Meituan’s 1.6T MIT Model, Benchmarks, API Price and Hardware
Meituan released LongCat-2.5 weights under MIT on 9 Nov 2026: 1.6T MoE, ~48B active, vision and video. Specs, vendor benchmarks, $0.30/$1.20 API, Claude Code setup and self-hosting needs.

LM Studio Not Loading Models? How to Fix “Failed to Load Model” and Search Errors
Fix LM Studio failed to load model, missing models and broken search: read the log, memory settings, runtimes, folder layout, files and lms commands.

RTX 4060 Ti 16GB for AI in 2026: LLM Speed, Prices and Is It Still Worth It?
Is the RTX 4060 Ti 16GB still good for AI in 2026? Real tokens per second for gpt-oss-20b and Qwen3 14B, November prices, best settings and how it…

llama-modchip: Run DeepSeek V4-Flash 284B on 64 GB RAM With No GPU (Setup, Speed, Limits)
llama-modchip squeezes the 284B DeepSeek V4-Flash into 56.56 GiB so it runs on a 64 GB PC with no GPU. Hardware needed, exact commands, developer-reported speeds, quality caveats…

Run Qwen3.8-27B Locally in GitHub Copilot With Foundry Local (2026): 24 GB GPU Setup Guide
Microsoft’s Foundry Local now runs a tuned 4-bit Qwen3.8-27B as a local coding agent inside GitHub Copilot. Specs, 24 GB GPU needs, exact commands, Copilot and VS Code…

How to Move Ollama Models to Another Drive (Windows, Mac, Linux, Docker) 2026
Move Ollama models to another drive without re-downloading: default folders, the Model location setting, OLLAMA_MODELS on Windows, macOS and Linux, Docker volumes, tokens per second and fixes.