🪢 Compositional Learning Journal Club
Join us this week for a fascinating dive into how multimodal language models can think visually by drawing — mimicking a human’s use of sketches to guide reasoning and solve complex tasks.
🌟 This Week's Presentation
📄 Paper:
Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Models
🧠 Abstract:
Multimodal LLMs are strong at visual reasoning, but they typically rely on text-only intermediate steps. This paper introduces Visual Sketchpad, which gives MLLMs a lightweight drawing interface (e.g., lines, boxes, marks) so they can create visual intermediate steps while reasoning—similar to how humans sketch when solving problems. By integrating these sketch actions (and optionally leveraging vision modules during sketching), the approach improves performance across a wide range of tasks, including math/geometry, graphs, and spatial reasoning.
🎙 Presenter: Amir Kasaei
Session Details:
- 📅 Date: Tuesday, December 30
- 🕒 Time: 3:00 - 4:00 PM
- 🌐 Location: Online at vc.sharif.edu/ch/rohban
We look forward to your participation! ✌️
arXiv.org
Visual Sketchpad: Sketching as a Visual Chain of Thought for...
Humans draw to facilitate reasoning: we draw auxiliary lines when solving geometry problems; we mark and circle when reasoning on maps; we use sketches to amplify our ideas and relieve our...
December 29, 2025 5.2K 19
