claude-video-vision

★ 1.4k

vs

groundingLMM

★ 969

claude-video-vision vs groundingLMM

claude-video-vision: A Claude Code plugin that gives Claude the ability to watch and understand videos. It extracts frames via ffmpeg and processes audio through multiple backends (Gemini, local Whisper, or OpenAI). Claude receives frames as images and audio transcriptions with timestamps, acting as a perception layer.; groundingLMM: GLaMM (Grounding Large Multimodal Model) is an end-to-end trained LMM capable of generating natural language responses integrated with object segmentation masks, enabling visual grounding and versatile interaction with images at multiple granularity levels. It introduces the novel task of Grounded Conversation Generation (GCG), supports various downstream applications like referring expression segmentation and region-level captioning, and is underpinned by the large-scale GranD dataset.