loading tag register... ok
loading matching posts... ok
loading related topics... ok
teds read --tag llm-systems
LLM Systems
Practical thinking on retrieval, generation, evaluation, prompting, deployment, and reliability.
Related service
Need help making an LLM system more useful and reliable? Talk to us about AI engineering consulting.
EAGLE-3 Speculative Decoding in vLLM for Qwen3-30B-A3B-Instruct-2507
A current guide to EAGLE-3 speculative decoding with vLLM, using Qwen3-30B-A3B-Instruct-2507, a matching Red Hat AI speculator, and a tokenizer sanity check that works in Transformers 5.12.1.
BlogRAG Is a Product Pattern, Not a Magic Trick
Why retrieval-augmented generation only becomes trustworthy when content quality, retrieval, ranking, UX, evaluation, and feedback are treated as product work.
BlogLet AutoScheme Pick the GGUF: Mixed Quantization with AutoRound and Qwen3.6
A clean, current tutorial for exporting mixed-quantized GGUF files from Qwen3.6 with AutoRound, AutoScheme, llama.cpp, and Transformers 5.12.1.
BlogHow to Know If Generative AI Fits Your Problem
A practical decision tree for choosing between prompting, RAG, fine-tuning, vision-language models, traditional ML, rules, or no AI.
BlogHow to Evaluate an AI Agent (Before It Ships)
Agent evaluation is not LLM evaluation. A practical three-layer framework — component, trajectory, outcome — for evaluating AI agents before they reach production, plus a maturity model to figure out where your team is and what to build next.
BlogThe Hidden Work Behind Just Add AI
A reality check on the operational work behind AI features: data, evaluation, reliability, UX, safety, compliance, monitoring, and trust.
BlogThe Generative AI Stack, Explained Without Vendor Fog
A plain-English map of the generative AI stack: models, data, retrieval, orchestration, evaluation, deployment, UX, and security.
BlogFrom Prompts to Practice: Instruction Tuning Qwen3 with Transformers 5
A modern walkthrough for instruction tuning a small Qwen3 instruct model with Hugging Face Transformers, TRL, PEFT, QLoRA, and chat templates.
BlogFrom Prompt to Product
A practical lifecycle for turning a prompt experiment into a reliable AI workflow with evaluation, feedback, production constraints, and launch proof.
BlogFrom Chat Window to Workflow: A Non-Technical Guide to AI Model APIs
A plain-language guide to AI model APIs for people who use chat windows but want to automate. Covers requests, responses, parameters, costs, and where to get hands-on practice.
BlogThe FRAME Method for Picking AI Projects
A practical framework for deciding which generative AI ideas are worth building before teams waste time on demos that never become products.
BlogWhy Evaluation Is the New Prompt Engineering
Prompting helps you ask better questions, but evaluation is the production discipline that makes AI systems reliable, comparable, and trustworthy.
BlogEnglish Is the New Interface
Natural language is becoming a primary way people operate software, but AI interfaces still need state, constraints, corrections, and product judgment.
BlogCompress Qwen3.5 with AutoRound in Transformers 5.12.1
A current, practical guide to quantizing Qwen3.5 with AutoRound, using the modern Transformers 5.12.1 stack and a clean W4A16 workflow that scales from 0.8B to larger checkpoints.
BlogCoDeC Contamination Detection in Transformers 5.12.1 with Qwen3, Qwen2.5, and Gemma 3
A cleaned-up CoDeC walkthrough with a current Transformers 5.12.1 implementation, model-loading notes for Qwen3, Qwen2.5, and Gemma 3, and a practical scoring script.
BlogAI Agents for Commercial Real Estate: From Deal Flow to Due Diligence
How autonomous AI agents — not chatbots — can compress the slowest parts of a commercial real estate practice: prospecting, underwriting, due diligence, zoning research, and reporting.