OpenReview, 2026
We introduce ICIR-MCQ, a controlled probe for analyzing in-context image retrieval in LVLMs at attention-head granularity, revealing that causally important retrieval heads must not only point to the target image but also write its information into the residual stream.