#vision-language
- 13 Nov 2025 · Paper summary
Paper summary: Lumine: An Open Recipe for Building Generalist Agents in 3D Open Worlds
Lumine is an open recipe for a generalist game-playing agent built on a vision-language model: pixels in at 5 Hz, keyboard and mouse out at 30 Hz, completing a five-hour storyline and transferring zero-shot to other games.
- 20 Feb 2025 · Paper summary
Paper summary: Qwen2.5-VL Technical Report
Qwen2.5-VL adds precise object localisation, robust document parsing and hour-long video understanding through a natively dynamic-resolution ViT and absolute time encoding; the 72B model is reported to match GPT-4o and Claude 3.5 Sonnet.
- 5 Dec 2024 · Paper summary
Paper summary: PaliGemma 2: A Family of Versatile VLMs for Transfer
PaliGemma 2 pairs the SigLIP-So400m vision encoder with Gemma 2 language models from 2B to 27B at three resolutions, and studies what drives transfer across a broad set of fine-tuning tasks.
- 28 May 2024 · Paper summary
Paper summary: An Introduction to Vision-Language Modeling
A tutorial-style introduction to vision-language models from a large group of authors: what VLMs are, the main training families, how to train and evaluate them, and the move to video.
- 13 Nov 2023 · Paper summary
Paper summary: Florence-2: Advancing a Unified Representation for a Variety of Vision Tasks
Florence-2 is a single sequence-to-sequence vision model that takes a text prompt as the task instruction and answers in text, covering captioning, detection, grounding and segmentation, trained on 5.4B annotations.