loading tag register... ok
loading matching posts... ok
loading related topics... ok
teds read --tag vision-multimodal
Vision & Multimodal
Hands-on work with computer vision, vision-language models, object detection, visual grounding, and multimodal systems.
Related service
Need help with a vision or multimodal AI system? Talk to us about AI engineering consulting.
Teaching PaliGemma 2 to Spot Construction-Site Hazards
Fine-tune PaliGemma 2 with Transformers 5, QLoRA, and a construction safety dataset so a vision-language model can return object labels and bounding boxes for job-site hazards.
BlogPreference-Aligning Vision Models: DPO Fine-Tuning Qwen3.5-4B in Transformers 5.12.1
A modern rewrite of an older SmolVLM notebook: align Qwen3.5-4B with Direct Preference Optimization (DPO), LoRA adapters, and current Transformers + TRL APIs.
BlogMultimodal AI Changes the Shape of Software
How text, image, audio, video, and document models change product design by letting users ask, point, upload, inspect, and correct.
BlogModern Visual Question Answering Fine-Tuning: Qwen3-VL-4B with QLoRA in Transformers 5.12.1
A current replacement for an older PaliGemma notebook: fine-tune Qwen3-VL-4B on a small VQAv2 split with QLoRA, modern Transformers APIs, and a cleaner multimodal training loop.
BlogModerating Memes with Qwen2.5-VL: Zero-Shot Hateful Content Detection in Transformers 5.12.1
A cleaned-up multimodal moderation walkthrough that uses Qwen2.5-VL with Transformers 5.12.1, the Hateful Memes validation split, and a reproducible zero-shot evaluation script.
BlogHuman Preference Tuning for Small VLMs: SmolVLM2 + DPO in Transformers 5.12.1
A modern guide to preference-tuning SmolVLM2 with Direct Preference Optimization, TRL, PEFT LoRA adapters, and the current Transformers image-text API.
BlogFrom Prompt to Pixels: Generate Images with Qwen-Image, Diffusers, and Transformers
A current text-to-image tutorial using Qwen-Image, Hugging Face Diffusers, and the latest Transformers stack, with reproducible prompts, aspect ratios, seeds, and a fast FLUX.1-schnell fallback.
BlogFrom Messy Labels to Production Boxes: Ultralytics YOLO26 + Transformers 5.12.1
A modern, reproducible object detection workflow that replaces legacy SuperGradients/YOLO-NAS setups with Ultralytics YOLO26 and current Transformers tooling.
BlogTrain a Modern VLM on One GPU: Qwen3-VL with Unsloth and Transformers 5.12.1
A current vision-language fine-tuning guide that replaces an old Qwen2-VL notebook with a cleaner Qwen3-VL workflow, modern Transformers APIs, and a practical DocumentVQA example.
BlogFine-Tuning Qwen3.6-VL for Brain Tumor MRI Detection with Transformers 5
A practical, up-to-date tutorial for adapting Qwen3.6-VL to brain tumor MRI yes/no detection with Transformers 5, QLoRA, and reproducible multimodal training.
BlogFine-Tune ViTPose++ for Keypoint Detection with Transformers
A practical Transformers-native guide to fine-tuning ViTPose++ on COCO-style keypoints with generated heatmap targets, RT-DETR inference, and current pose-estimation caveats.
BlogFind What You Mean: Zero-Shot Visual Grounding with Qwen3-VL and Transformers
Use Qwen3-VL with the latest Transformers API to detect objects, ground natural-language phrases, and visualize bounding boxes from structured multimodal outputs.
BlogDETR Explained: Set Prediction Object Detection in Transformers 5.12.1
Learn DETR object detection with a modern Transformers 5.12.1 example, pinned requirements, and a clean explanation of set prediction, Hungarian matching, and object queries.
BlogDetect What You Can Name: PaliGemma 2 Object Detection with Transformers
A practical tutorial for using current PaliGemma 2 mix checkpoints with Transformers 5 to run prompt-driven object detection and draw bounding boxes from generated location tokens.
BlogCaption by Consensus: Ranking Image Descriptions with SigLIP2 and Transformers
Use SigLIP2 with the latest Transformers APIs to score candidate image captions, choose the best description, and understand when a contrastive vision-language encoder is the right tool.
BlogYOLOv12 in Practice: A Real-Time Object Detection Guide
A practical guide to YOLOv12's attention-centric real-time detector, with a current install path, an inference example, and notes on the official detection, segmentation, and classification weights.