January 01, 1970
Fine-grained visual reasoning remains challenging for vision-language models, especially when small but critical visual cues are buried in high-resolution images. Existing approaches rely on repeated cropping or test-time visual search to introduce local evidence, but they typically do not explicitly distinguish perception from reasoning. In this paper, we propose Perceive-to-Reason (P2R), a unified framework that formulates fine-grained visual reasoning as a two-stage process: the model first localizes question-relevant evidence as a Perceiver, and then answers the question as a Reasoner based on the annotated image and cropped regions. To better align training with this decoupled formulation, we further introduce Perception-Reasoning Alternating GRPO (PRA-GRPO), a role-aware reinforcement learning strategy that alternates between perception-focused and reasoning-focused updates using only final-answer supervision. Built on top of Qwen3-VL-Instruct-2B/4B/8B, P2R consistently improves performance across model scales. In particular, P2R-4B achieves 93.2% on V-Star, 81.9% on HR-Bench-4K, and 80.5% on HR-Bench-8K, substantially outperforming its corresponding backbone. Further experiments show that the benefits of P2R extend beyond high-resolution benchmarks to broader multimodal reasoning tasks. These results suggest that explicitly decoupling perception from reasoning provides an effective framework for fine-grained visual reasoning.
Vision-language models (VLMs) have recently achieved strong performance on general visual understanding and reasoning tasks [1], [2]. Yet fine-grained visual reasoning remains challenging [3]–[5], especially for tasks such as fine-grained text recognition and precise spatial relation understanding. Solving such tasks requires both locating subtle question-relevant evidence in high-resolution images and reasoning over it, that is, determining where to look and how to reason.
A simple diagnostic study suggests that perception is a major bottleneck in fine-grained visual reasoning. On V-Star [3], Qwen3-VL-Instruct-4B [6] improves from 81.7% to 90.6% when given oracle bounding boxes and cropped regions, indicating that many errors stem from failing to localize the right visual evidence (details in Appendix 6).
Existing approaches mainly address this challenge by injecting local evidence through region cropping or search [7], [8]. They largely fall into two categories. Thinking with Images methods [9], [10] interleave region exploration with reasoning, often producing long and noisy contexts. Visual search methods [11], [12] locate key regions through test-time search, but typically rely on complex pipelines that are difficult to optimize [13], [14]. More importantly, these approaches either entangle evidence localization with reasoning or externalize perception into a separate search process, so the model is not directly optimized for where to look decisions, as illustrated in Figure 1.
These observations motivate a two-stage formulation of fine-grained visual reasoning: first localize the relevant evidence, then reason over it. However, training such a decoupled process is difficult under answer-only supervision, since errors may arise from either poor localization or flawed reasoning, making credit assignment ambiguous.
To address this issue, we propose Perceive-to-Reason (P2R), a unified framework that explicitly decomposes fine-grained visual reasoning into perception and reasoning. At inference time, P2R first localizes question-relevant evidence as a Perceiver, and then answers the question as a Reasoner based on the annotated image and cropped regions. This formulation makes evidence localization an explicit intermediate step rather than an implicit byproduct of answer generation.
To train this decoupled formulation, we further propose Perception-Reasoning Alternating GRPO (PRA-GRPO), a role-aware reinforcement learning strategy built upon GRPO [15]. PRA-GRPO alternates between perception-focused and reasoning-focused optimization while keeping the other role fixed, thereby converting final-answer correctness into a more attributable training signal for the active stage. In this way, P2R improves both evidence localization and answer generation using only final-answer supervision, without requiring ground-truth bounding box annotations.
Built on top of Qwen3-VL-Instruct [6], P2R consistently improves over its base models across all scales. In particular, P2R-4B achieves 93.2% on V-Star [3], 81.9% on HR-Bench-4K [4], and 80.5% on HR-Bench-8K [4], with substantial gains over the corresponding backbone. Further experiments show that the benefits of P2R extend beyond high-resolution benchmarks to broader multimodal reasoning tasks. Our main contributions are summarized as follows:
We propose P2R, a unified framework for fine-grained visual reasoning that formulates the task as a two-stage perceive-to-reason process, explicitly decoupling evidence localization from answer generation.
We introduce PRA-GRPO, a role-aware reinforcement learning strategy that aligns training with the decoupled perceive-to-reason formulation, using only final-answer supervision without requiring bounding box annotations.
Built on top of Qwen3-VL-Instruct models, P2R consistently delivers substantial gains across model scales and achieves state-of-the-art results on high-resolution fine-grained visual reasoning benchmarks.
Fine-grained visual reasoning requires models to identify subtle visual evidence and reason over it, and remains challenging for current VLMs [3]–[5], [16]–[18]. Existing methods mainly tackle this challenge by localizing key regions. One line of work follows the Thinking with Images paradigm [19]–[24], where models iteratively zoom into relevant regions or invoke visual tools for interleaved visual-textual reasoning. For example, DeepEyes [9] leverages reinforcement learning to improve visual tool use. Another line of work adopts visual search or test-time scaling [7], [25]–[27] to identify informative subregions during inference; for instance, ZoomEye [11] performs hierarchical search over zoomed-in regions. However, these methods either entangle perception and reasoning within a single process or rely on external pipelines, without explicitly formulating fine-grained visual reasoning as a perceive-to-reason process. Our method, in contrast, explicitly decomposes the task and aligns training accordingly.
Recent studies have extended reinforcement learning (RL) from LLMs to VLMs, leading to notable progress in visual reasoning [2], [28]–[35]. Representative works such as Vision-R1 [1] and MM-Eureka [36] show that RL can significantly improve reasoning capabilities in VLMs, especially for visual mathematical reasoning. Perception-oriented methods such as VLM-R1 [37] and Perception-R1 [2] use rewards based on IoU or F1 to improve grounding and counting. However, existing RL approaches optimize perception and reasoning in isolation, without addressing their coordination. Our PRA-GRPO instead optimizes both within a unified framework via alternating updates.
P2R is a unified framework that formulates fine-grained visual reasoning as a perceive-to-reason process. It consists of two tightly coupled components: a two-stage inference paradigm that explicitly separates evidence localization and answer generation, assigning these roles to a Perceiver and a Reasoner, and PRA-GRPO, a role-aware reinforcement learning strategy that aligns training with this decoupled formulation.
Given an image-question pair \((I, Q)\), P2R structures fine-grained visual reasoning into two consecutive stages: perception and reasoning, as illustrated in Figure 2 (a). We use a single underlying VLM with shared parameters \(\theta\) throughout both stages. For notational convenience, we denote its role-conditioned behavior in the perception and reasoning stages as \(\pi_p(\cdot;\theta)\) and \(\pi_r(\cdot;\theta)\), corresponding to the Perceiver and Reasoner, respectively.
In the first stage, the model acts as a Perceiver to make an explicit localization decision for the visual evidence most relevant to answering the question. Let \(\tilde{Q}_p = \mathcal{T}_p(Q)\) denote a perception-oriented prompt derived from the original question. The Perceiver predicts one or more bounding boxes as: \[\mathcal{B} \sim \pi_p(\cdot \mid I, \tilde{Q}_p; \theta)\] where \(\mathcal{B} = \{B_k\}_{k=1}^{K}\) denotes a set of rectangular regions in the image, and each \(B_k = (x_1, y_1, x_2, y_2)\) specifies one region.
The predicted boxes are then transformed into two complementary visual inputs: an annotated image \(I_a = \mathrm{annotate}(I, \mathcal{B})\) and cropped evidence images \(I_c = \mathrm{crop}(I, \mathcal{B})\), where \(\mathrm{annotate}(\cdot)\) overlays the predicted boxes on the original image and \(\mathrm{crop}(\cdot)\) extracts the corresponding local regions.
In the second stage, the model acts as a Reasoner and generates the final answer as: \[Y \sim \pi_r(\cdot \mid I_a, I_c, Q; \theta)\]
This two-stage formulation turns fine-grained visual reasoning into an explicitly structured process: the Perceiver determines where to look, while the Reasoner focuses on how to reason from the evidence. By making evidence localization an explicit intermediate step rather than an implicit byproduct of answer generation, P2R offers a more suitable formulation for fine-grained visual reasoning.
While the two-stage P2R inference process explicitly separates perception from reasoning, training remains challenging because the final prediction depends on both stages. Incorrect evidence localization can mislead downstream reasoning, while correct evidence alone does not guarantee a correct answer if the subsequent reasoning is still flawed. As a result, it is difficult to improve fine-grained visual reasoning by treating the entire pipeline as a single undifferentiated optimization problem. Since supervision is only available at the level of the final answer, it is difficult to determine how the learning signal should be attributed across the two stages, especially when perception must be learned from downstream reasoning outcomes alone.
To address this issue, we propose PRA-GRPO, a role-aware reinforcement learning strategy that aligns optimization with the perceive-to-reason structure of P2R, as illustrated in Figure 3. The key idea is to convert final answer correctness into a more attributable training signal by alternating perception-focused and reasoning-focused updates. Intuitively, better evidence localization should increase the likelihood of successful downstream reasoning; therefore, even without ground-truth bounding box annotations, the final answer can serve as an indirect supervision signal for learning perception.
Concretely, PRA-GRPO alternates between optimizing the Perceiver and the Reasoner, while keeping the other role fixed. This turns final answer correctness into a role-aware supervision signal: in the perception phase, the quality of the predicted evidence is evaluated through the answer produced by a fixed Reasoner; in the reasoning phase, answer generation is optimized conditioned on evidence provided by a fixed Perceiver.
We now formalize this role-aware alternating optimization under the GRPO framework. Given an image-question-answer triplet \((I, Q, Y)\), we sample a group of \(G\) rollouts from the role currently being optimized. In the perception phase, \(o_i\) is a set of bounding boxes \(\mathcal{B}_i \sim \pi_p(\cdot \mid I, \mathcal{T}_p(Q); \theta)\). Based on \(\mathcal{B}_i\), we construct the annotated image \(I_a^i\) and cropped evidence images \(I_c^i\), which are then fed into a fixed Reasoner to obtain the final answer \(Y_i\). In the reasoning phase, \(o_i\) is an answer \(Y_i \sim \pi_r(\cdot \mid I_a, I_c, Q; \theta)\), where \((I_a, I_c)\) are constructed from the bounding boxes predicted by the fixed Perceiver.
To keep supervision minimal and task-agnostic, we define a binary reward based solely on final-answer correctness: \[r_i = \mathbb{I}[Y_i = Y]\] where \(\mathbb{I}[\cdot]\) is the indicator function.
We compute the group-relative advantage following GRPO [15], [38]: \[A_i = \frac{r_i - \mathrm{mean}(\{r_j\}_{j=1}^{G})}{\mathrm{std}(\{r_j\}_{j=1}^{G}) + \epsilon}\] where \(\epsilon\) is a small constant for numerical stability. We then optimize the active role in the current phase using the standard GRPO objective: \[\small \begin{align} \mathcal{J}_{\mathrm{GRPO}}^{\phi}(\theta) = \mathbb{E}_{x,\{o_i\}_{i=1}^{G}} \Bigg[ \frac{1}{G}\sum_{i=1}^{G} \min \Big( \rho_i A_i,\, \\ \mathrm{clip}(\rho_i, 1\pm\varepsilon)A_i \Big) -\beta\,\mathrm{KL}\!\left[\pi_{\phi,\theta}\,\|\,\pi_{\mathrm{ref}}\right] \Bigg] \end{align}\] where \[\rho_i = \frac{\pi_{\phi,\theta}(o_i \mid x)}{\pi_{\phi,\theta_{\mathrm{old}}}(o_i \mid x)}\] and \(\phi \in \{p, r\}\) denotes the active role in the current optimization phase. Specifically, \(x = (I, \mathcal{T}_p(Q))\) and \(o_i = \mathcal{B}_i\) in the perception phase, while \(x = (I_a, I_c, Q)\) and \(o_i = Y_i\) in the reasoning phase.
| Method | V-Star | HR-Bench-4K | HR-Bench-8K | Avg. | ||||||
|---|---|---|---|---|---|---|---|---|---|---|
| 2-4 (lr)5-7 (lr)8-10 | Attr | Spatial | Overall | FSP | FCP | Overall | FSP | FCP | Overall | |
| GPT-4o [39] | - | - | 66.0 | 70.0 | 48.0 | 59.0 | 62.0 | 49.0 | 55.0 | 60.0 |
| o3 OpenAI [40] | - | - | 95.7 | - | - | - | - | - | - | - |
| Qwen3-VL-Instruct-2B [6] | 73.0 | 77.6 | 74.9 | 81.0 | 59.8 | 70.4 | 70.8 | 58.5 | 64.6 | 70.0 |
| Qwen3-VL-Instruct-4B [6] | 79.1 | 85.5 | 81.7 | 81.8 | 66.0 | 73.8 | 73.8 | 60.3 | 67.0 | 74.2 |
| Qwen3-VL-Instruct-8B [6] | 84.3 | 82.9 | 83.8 | 81.0 | 68.5 | 74.8 | 73.3 | 70.1 | 70.1 | 76.2 |
| Qwen3-VL-Instruct-32B [6] | 86.1 | 88.2 | 86.9 | 86.0 | 71.3 | 78.6 | 78.8 | 68.5 | 73.6 | 79.7 |
| DyFo-7B [12] | 80.0 | 82.9 | 81.2 | - | - | - | - | - | - | - |
| ZoomEye-7B [11] | 93.9 | 85.5 | 90.6 | 84.3 | 55.0 | 69.6 | 88.5 | 50.0 | 69.3 | 76.5 |
| DeepEyes-7B [9] | 91.3 | 88.2 | 90.1 | 91.3 | 59.0 | 75.1 | 86.8 | 58.5 | 72.6 | 79.3 |
| PixelReasoner-7B [10] | 83.5 | 76.3 | 80.6 | 86.0 | 60.3 | 72.9 | 80.0 | 54.3 | 66.9 | 73.5 |
| Thyme-7B [41] | 83.5 | 80.3 | 82.2 | 91.0 | 63.0 | 77.0 | 86.5 | 57.5 | 72.0 | 77.1 |
| P2R-2B | 84.3 | 84.2 | 84.3 | 89.8 | 60.1 | 75.1 | 86.8 | 62.7 | 74.8 | 78.1 |
| \(\Delta\) (vs Qwen3-VL-Instruct-2B) | +11.3 | +6.6 | +9.4 | +8.8 | +0.3 | +4.7 | +16.0 | +4.2 | +10.2 | +8.1 |
| P2R-4B | 92.2 | 94.7 | 93.2 | 92.3 | 71.5 | 81.9 | 92.0 | 69.0 | 80.5 | 85.2 |
| \(\Delta\) (vs Qwen3-VL-Instruct-4B) | +13.1 | +9.2 | +11.5 | +10.5 | +5.5 | +8.1 | +18.2 | +8.7 | +13.5 | +11.0 |
| P2R-8B | 92.2 | 96.1 | 93.7 | 93.5 | 71.5 | 81.5 | 94.5 | 70.8 | 82.6 | 85.9 |
| \(\Delta\) (vs Qwen3-VL-Instruct-8B) | +7.9 | +13.2 | +9.9 | +12.5 | +3.0 | +6.7 | +21.2 | +0.7 | +12.5 | +9.7 |
As both roles are instantiated by the same underlying VLM with shared parameters \(\theta\), PRA-GRPO improves both evidence localization and answer generation within a unified model. More importantly, it allows perception to be learned from downstream reasoning outcomes through final-answer supervision alone, without requiring ground-truth bounding boxes or task-specific dense rewards.
See Appendix 7 for more method details.
| Method | Overall | Perception | Reasoning | |||||||
|---|---|---|---|---|---|---|---|---|---|---|
| 3-7 (lr)8-11 | OCR | RS | DT | MO | AD | OCR | DT | MO | AD | |
| Qwen3-VL-Instruct-2B [6] | 47.3 | 85.2 | 38.7 | 74.0 | 32.9 | 39.1 | 69.0 | 67.0 | 40.7 | 30.8 |
| Qwen3-VL-Instruct-4B [6] | 47.7 | 88.0 | 38.0 | 80.0 | 34.8 | 33.7 | 74.0 | 77.0 | 34.7 | 31.8 |
| Qwen3-VL-Instruct-8B [6] | 50.4 | 88.8 | 49.3 | 85.0 | 36.4 | 33.1 | 81.0 | 79.0 | 38.7 | 34.3 |
| Qwen3-VL-Instruct-32B [6] | 52.3 | 86.8 | 50.0 | 89.0 | 38.6 | 36.0 | 82.0 | 88.0 | 44.0 | 34.5 |
| DeepEyes-7B [9] | 53.2 | 90.0 | 52.7 | 89.0 | 43.3 | 33.4 | 76.0 | 69.0 | 44.0 | 35.0 |
| PixelReasoner-7B [10] | 49.7 | 89.6 | 52.0 | 86.0 | 38.9 | 30.9 | 71.0 | 72.0 | 46.0 | 32.5 |
| P2R-2B | 51.3 | 88.4 | 43.3 | 78.0 | 39.8 | 40.6 | 76.0 | 68.0 | 44.0 | 35.5 |
| \(\Delta\) (vs Qwen3-VL-Instruct-2B) | +4.0 | +3.2 | +4.6 | +4.0 | +6.9 | +1.5 | +7.0 | +1.0 | +3.3 | +4.7 |
| P2R-4B | 54.8 | 88.8 | 50.0 | 86.0 | 46.1 | 39.1 | 79.0 | 78.0 | 46.7 | 39.5 |
| \(\Delta\) (vs Qwen3-VL-Instruct-4B) | +7.1 | +0.8 | +12.0 | +6.0 | +11.3 | +5.4 | +5.0 | +1.0 | +12.0 | +7.7 |
| P2R-8B | 57.4 | 92.4 | 58.7 | 89.0 | 44.5 | 46.9 | 81.0 | 81.0 | 46.7 | 39.0 |
| \(\Delta\) (vs Qwen3-VL-Instruct-8B) | +7.0 | +3.6 | +9.4 | +4.0 | +8.1 | +13.8 | +0.0 | +2.0 | +8.0 | +4.7 |
We compare P2R against three groups of representative baselines: (1) general-purpose VLMs, including proprietary models such as GPT-4o [39] and o3 [40], as well as open-source Qwen3-VL [6] models of different sizes; (2) visual search methods, including DyFo [12] and ZoomEye [11]; and (3) thinking-with-images methods, including DeepEyes [9], PixelReasoner [10], and Thyme [41]. Our primary evaluation targets high-resolution fine-grained visual reasoning benchmarks, including V-Star [3] and HR-Bench [4], which require precise perception of subtle visual evidence followed by downstream reasoning. We further report results on MME-RealWorld-Lite [5] to assess whether the benefits of P2R extend to broader real-world multimodal reasoning scenarios.
We build a 10K training set by sampling 3K examples from DeepEyes [9], 3K from VisualProbe [20], and 4K from ZwZ [16].
We instantiate P2R on top of Qwen3-VL-Instruct [6] models using GRPO [15] on 4 H100 GPUs. In each alternating stage, the Perceiver phase and the Reasoner phase are each trained for one epoch. For each prompt, we sample 8 rollouts, and set the KL coefficient [42] to 0.01.
See Appendix 8 and 9 for more details.
Table 1 reports the results on V-Star [3], HR-Bench-4K [4], and HR-Bench-8K [4]. P2R consistently outperforms its corresponding Qwen3-VL-Instruct baselines across all scales, indicating that the proposed perceive-to-reason formulation is effective for fine-grained visual reasoning. Averaged over the three benchmarks, P2R-2B, P2R-4B, and P2R-8B improve upon their Qwen3-VL-Instruct counterparts by 8.1%, 11.0%, and 9.7%, respectively. The gains are especially pronounced on HR-Bench-8K, highlighting the advantage of P2R in challenging high-resolution settings. P2R also compares favorably with prior visual search and thinking-with-images methods, with P2R-8B achieving the best average performance among all open-source models. A summary comparison is also shown in Figure 2 (b).
Table 2 reports the results on MME-RealWorld-Lite [5], a broad benchmark covering diverse real-world multimodal perception and reasoning tasks. P2R consistently improves over its Qwen3-VL-Instruct backbones, with overall gains of 4.0%, 7.1%, and 7.0% for the 2B, 4B, and 8B models, respectively. Notably, these improvements are broad rather than concentrated in a few categories: P2R improves performance across nearly all sub-tasks in both perception and reasoning. This suggests that the benefits of the perceive-to-reason formulation extend beyond high-resolution fine-grained settings to more general multimodal understanding scenarios. P2R-8B achieves the best overall performance among all compared methods.
Figure 4 compares direct chain-of-thought [43] prompting with the proposed P2R inference on both Qwen3-VL-Instruct-4B and P2R-4B. P2R inference consistently improves performance across all three benchmarks for both models, suggesting that the perceive-to-reason decomposition is beneficial already at inference time. On V-Star, for example, replacing direct CoT with P2R inference improves the score from 81.7% to 89.0% for Qwen3-VL-Instruct-4B, and from 84.8% to 93.2% for P2R-4B. Moreover, P2R-4B remains stronger than Qwen3-VL-Instruct-4B even under direct CoT prompting, indicating that the benefits of PRA-GRPO are not limited to the dedicated P2R inference pipeline. Combining P2R training with P2R inference yields the strongest performance on all three benchmarks.
Figure 5 compares different PRA-GRPO training strategies on top of Qwen3-VL-Instruct-4B with P2R inference. Optimizing either role alone already improves over the no-training baseline, suggesting that both perception and reasoning can benefit from role-aware training. Alternating updates over both roles leads to further gains across benchmarks. On V-Star, the order \(P \rightarrow R\) achieves 93.2%, outperforming \(R \rightarrow P\) at 90.6%, suggesting that localizing evidence first better supports reasoning by providing more accurate visual inputs. These results support the effectiveness of aligning training with the decoupled perceive-to-reason formulation.
5pt
Figure 6 shows the training dynamics of PRA-GRPO. During the Perceiver phase, both V-Star Hit Rate and Avg. IoU improve steadily, indicating more accurate localization of question-relevant evidence. We define Hit Rate as 1 if the center of a predicted box falls inside the ground-truth box, making it a simple proxy for localization. Performance on the high-resolution benchmark average and MME-RealWorld-Lite also improves in this phase. After switching to the Reasoner phase, benchmark performance continues to increase while the localization metrics remain stable or improve slightly, suggesting complementary gains from the two roles. More training dynamics are provided in Appendix 10.1.
To study the effect of parameter sharing, we initialize the Perceiver and Reasoner in P2R inference with different checkpoints, including the base model, the P-Only and R-Only checkpoints, and the final PRA-GRPO checkpoint, and evaluate their combinations on three fine-grained visual reasoning benchmarks.
Table 3 reveals clear cross-role transfer under shared parameters. Replacing the Base Reasoner with the P-Only checkpoint improves the average score from 82.4% to 83.5% (P-Only + Base vs.P-Only + P-Only), indicating that Perceiver-only training also benefits the model when reused in the Reasoner role. Likewise, replacing the Base Perceiver with the R-Only checkpoint increases the average score from 82.7% to 83.4% (Base + R-Only vs.R-Only + R-Only), suggesting that Reasoner-only training also transfers to the Perceiver role. However, simply combining separately trained checkpoints remains weaker than the final alternating model (84.8% vs. 85.2%), suggesting that PRA-GRPO better integrates both capabilities within a single shared model. In addition, this shared-parameter design is deployment-friendly, requiring only one model at inference time.
| Method | \(\mathbf{Acc@0.5}_{\mathbf{test}}\) | \(\mathbf{Acc@0.5}_{\mathbf{val}}\) | Avg. |
|---|---|---|---|
| Qwen3-VL-4B | 59.1 | 64.1 | 61.6 |
| P2R-4B | 59.6 | 65.9 | 62.7 |
| \(\Delta\) | +0.5 | +1.8 | +1.1 |
We further evaluate P2R-4B on the reasoning grounding task in ReasonSeg [44] to assess whether PRA-GRPO transfers to localization tasks that require reasoning over the query. As shown in Table 4, P2R-4B consistently outperforms Qwen3-VL-Instruct-4B on both the test and validation splits, improving Acc@0.5 by 0.5% and 1.8%, respectively, for an average gain of 1.1%.
Notably, P2R is trained without any grounding-specific data or ground-truth bounding box annotations, relying only on final-answer supervision from fine-grained visual reasoning data. This suggests that the improvements induced by PRA-GRPO transfer beyond the original training setup and can enhance localization of query-relevant visual evidence in downstream grounding tasks.
Figure 8 shows the performance growth of PRA-GRPO and text-only GRPO over three training iterations on MME-RealWorld-Lite. While both methods improve with additional training, PRA-GRPO scales faster, rising from 54.8% to 57.1% with a fitted slope of 0.77, compared with 53.8% to 55.1% and a slope of 0.43 for text-only GRPO.
A plausible explanation is that PRA-GRPO benefits from positive interaction between the two roles: a stronger Perceiver provides better visual evidence for the Reasoner, while a stronger Reasoner can yield more reliable answer-based feedback for training the Perceiver. This allows improvements in the two stages to reinforce each other over training.
Figure 7 presents two examples from V-Star that highlight the differences between Qwen3-VL-Instruct-4B and P2R-4B. In the first, the baseline misses a small but decisive red chair and therefore fails to determine its spatial relation to the road. P2R-4B, by contrast, successfully localizes the chair and correctly infers that it is on the right side of the road. In the second, the baseline attends to the correct bicycle region but fails on the fine-grained detail, misrecognizing its color. P2R-4B instead identifies the bicycle as yellow.
These examples illustrate the complementary roles encouraged by PRA-GRPO. The first example highlights improved localization of relevant evidence, while the second reflects more precise reasoning over localized fine-grained details.
See Appendix 10 for additional analysis.
We propose P2R, a unified framework that decouples perception from reasoning for fine-grained visual reasoning, and PRA-GRPO, a training strategy aligned with this formulation. Built on Qwen3-VL-Instruct models, P2R achieves consistently strong performance across challenging high-resolution fine-grained visual reasoning benchmarks and also improves broader multimodal performance.
This work has several limitations. First, although P2R is simple and effective, its two-stage pipeline introduces additional inference cost compared with direct prompting. Second, due to limited computational resources, we have not explored PRA-GRPO at larger training scales, so its full scaling behavior remains unclear. Third, PRA-GRPO relies only on final-answer supervision, which avoids the need for bounding box annotations but also provides a sparse learning signal. Finally, our evaluation mainly focuses on fine-grained visual reasoning and related multimodal benchmarks; broader generalization to interactive or long-horizon settings remains for future work.
This work raises several ethical considerations. First, improving fine-grained visual perception may benefit useful applications, but it could also increase risks in privacy-sensitive settings by enabling models to identify small or sensitive details in high-resolution images. Second, although P2R provides intermediate outputs such as bounding boxes and cropped regions, these should not be interpreted as fully faithful explanations of model decisions. Finally, like other vision-language models, our method may inherit biases and failure modes from its base model and training data, so careful evaluation is needed before deployment in real-world or high-stakes settings.
| Method | V-Star | ||
|---|---|---|---|
| 2-4 | Attr | Spatial | Overall |
| + Direct CoT | 79.1 | 85.5 | 81.7 |
| + Oracle Hint | 87.8 | 94.7 | 90.6 |
We conduct a simple diagnostic study on V-Star [3] to probe a key question behind this work: is fine-grained visual reasoning limited more by reasoning or by perception? Using Qwen3-VL-4B, we compare a standard Direct CoT setting with an Oracle Hint setting that provides ground-truth bounding boxes from the official V-Star annotation file, together with the corresponding cropped regions. Table 5 shows that Oracle Hint improves overall accuracy from 81.7% to 90.6%, with consistent gains on both attribute and spatial questions. The result suggests that many failures are caused not by the inability to reason over evidence, but by the inability to first find the right evidence to reason over.
P2R inference consists of a Perceiver stage for localizing question-relevant evidence and a Reasoner stage for answering based on the localized evidence. We use the following prompts.
Prompt for Perceiver System Prompt: “You are a helpful assistant.”
User Prompt: {question} + “Please carefully observe the image first to identify the object(s) referred to in the question. Note that each object type appears only once in the image. Then provide the 2D bounding box
coordinates and labels of the related objects in JSON format.”
Prompt for Reasoner System Prompt: “You are a helpful assistant.”
User Prompt: {question} + “The key visual regions have been highlighted and cropped for you. Think step by step.”
The predicted boxes are highlighted on the original image and cropped into local patches. Both the highlighted image and the local crops are then provided to the Reasoner.
Algorithm 9 presents the training procedure of PRA-GRPO. Training alternates between Perceiver and Reasoner phases. In each phase, the active role is optimized while the other role is frozen using the checkpoint from the previous stage. For each training sample, we draw a group of rollouts from the active role, compute binary rewards from final-answer correctness, and derive group-relative advantages under GRPO. The resulting objective is then used to update only the active role.
The predicted bounding boxes are parsed from the model outputs using regular expressions. During post-processing, to keep the visual context within the input limit, we do not restrict the number of boxes rendered on the original image, but crop local patches from only the first three predicted boxes.
We construct a 10K training set by random sampling from three complementary data sources: 3K examples from DeepEyes [9], 3K from VisualProbe [20], and 4K from ZwZ [16]. These sources provide diverse supervision for fine-grained visual perception and evidence localization, while also covering different difficulty levels: DeepEyes is relatively easier, ZwZ presents medium-difficulty fine-grained perception cases, and VisualProbe is the most challenging due to small targets, cluttered scenes, and many distractors.
DeepEyes: We sample 3K examples from DeepEyes as a relatively easy source of training data. DeepEyes is curated for visually useful evidence and fine-grained perception, with filtering procedures for difficulty, answer validity, and perception utility. This makes it a suitable starting point for learning basic evidence localization behavior.
ZwZ: We sample 4K examples from ZwZ as a medium-difficulty source of fine-grained perception data. ZwZ is synthetically generated by Region-to-Image distillation: strong teacher models first create question-answer pairs on micro-cropped regions, and the supervision is then distilled back to the full image with explicit region grounding. The resulting samples emphasize subtle local details while remaining more controlled than naturally hard search problems.
VisualProbe: We sample 3K examples from VisualProbe as the hardest portion of the training mixture. Built from high-resolution images with very small targets and many distractors, it places strong demands on identifying sparse and localized visual evidence under clutter, making it particularly suitable for training robust perception behavior.
Overall, this mixture provides a coarse-to-hard spectrum of training difficulty, from relatively accessible grounding examples in DeepEyes, to medium-difficulty fine-grained cases in ZwZ, and finally to challenging visual search instances in VisualProbe. Despite using only 10K training examples in total, our method achieves significant performance gains, highlighting both the effectiveness of the proposed training framework and its strong data efficiency.
Table 6 summarizes the main training hyper-parameters. We implement PRA-GRPO using the VeRL [45] framework. The Perceiver and Reasoner share the same training configuration and differ only in the prompt and response length limits. During training, we cap the maximum image resolution at \(2048 \times 32 \times 32\) pixels as the image pixel budget.
| Parameter | Value |
|---|---|
| algorithm.adv_estimator | grpo |
| train_batch_size | 64 |
| truncation | error |
| filter_overlong_prompts | True |
| rollout.n | 8 |
| lr | \(1\times10^{-6}\) |
| ppo_mini_batch_size | 64 |
| ppo_micro_batch_size_per_gpu | 8 |
| use_kl_loss | True |
| kl_loss_coef | \(1\times10^{-2}\) |
| kl_loss_type | low_var_kl |
| entropy_coeff | 0 |
| use_kl_in_reward | False |
| n_gpus_per_node | 4 |
| nnodes | 1 |
| total_epochs | 1 |
| perceiver_max_prompt_length | 2560 |
| perceiver_max_response_length | 1024 |
| reasoner_max_prompt_length | 8704 |
| reasoner_max_response_length | 2048 |
We evaluate P2R on three benchmark suites used in the main results: V-Star [3], HR-Bench (4K and 8K) [4], and MME-RealWorld-Lite [5]. These benchmarks provide complementary evaluation settings, ranging from high-resolution fine-grained perception to broader real-world multimodal perception and reasoning.
V-Star: V-Star is designed to evaluate multimodal models in challenging visual scenarios where the required evidence is difficult to locate. It is built from 191 high-resolution images, with an average resolution of \(2246\times1582\), and contains two sub-tasks: attribute recognition and spatial relationship reasoning. The questions are manually curated so the correct answer cannot be reliably guessed without accurate visual grounding.
HR-Bench: HR-Bench focuses on fine-grained perception in high-resolution images. It contains two sub-tasks: Fine-grained Single-instance Perception (FSP), which evaluates recognition of detailed attributes such as color and material, and Fine-grained Cross-instance Perception (FCP), which evaluates relative position understanding across objects. Each sub-task contains 100 samples. We report results on both HR-Bench-4K and HR-Bench-8K, corresponding to cropped 4K images and original 8K images, respectively.
MME-RealWorld-Lite: We further evaluate on MME-RealWorld-Lite, a lightweight subset of MME-RealWorld commonly used for efficient evaluation. Following the official lite setting, it contains 50 samples per task, or all samples when a task has fewer than 50 examples. The benchmark covers diverse real-world scenarios, including OCR in the wild, remote sensing, diagrams and tables, autonomous driving, and monitoring, and therefore serves as a broader test of multimodal perception and reasoning beyond the high-resolution benchmarks above.
Together, these benchmarks allow us to evaluate P2R in both fine-grained high-resolution settings and more general real-world multimodal understanding scenarios.
For evaluation, we use greedy decoding with temperature 0 to ensure reproducible results. In addition, we increase the maximum image resolution to \(4096 \times 32 \times 32\) pixels at evaluation time.
Figure 10 shows the evaluation accuracy on V-Star, HR-Bench-4K, and HR-Bench-8K across the Perceiver and Reasoner training phases. We observe consistent gains on all three benchmarks, with average performance steadily improving throughout training. This result suggests that both stages of PRA-GRPO contribute to better fine-grained visual perception on challenging high-resolution images. In particular, the gains continue not only during the Perceiver phase, where the model directly learns to localize informative evidence, but also during the Reasoner phase, indicating that improving downstream reasoning can further enhance the overall perceive-to-reason pipeline.
Figure 11 plots the average bounding box count and size on V-Star throughout training. Importantly, we do not observe a monotonic increase in either the number of predicted boxes or their spatial extent. This suggests that the model is not exploiting the reward by simply proposing more regions or enlarging boxes to cover as much of the image as possible. Instead, the model remains focused on identifying compact and informative regions that are most relevant to the final answer. At the same time, both statistics exhibit a rise-then-fall pattern, which is consistent with an exploration process: the model initially explores broader region proposals and then gradually refines them toward more selective and targeted localization. Interestingly, these box statistics also change during the Reasoner training phase. Although only the Reasoner is updated in that stage, its improvement still affects the overall role interaction in PRA-GRPO, which in turn influences the Perceiver’s learned bounding-box behavior in the final pipeline.
Figure 12 compares throughput and average performance on the high-resolution benchmarks. Overall, P2R achieves a favorable efficiency-accuracy trade-off: compared with the corresponding Qwen3-VL-Instruct base models, P2R substantially improves benchmark performance while retaining relatively high inference efficiency. The official tool-use baseline follows the Thinking with Images paradigm, and P2R is both more accurate and much faster than this variant. Although P2R is slower than the base models due to the additional interaction, it remains practical in terms of inference cost.
For fairness, we do not include direct efficiency comparisons with visual search methods. Our experiments use a unified vLLM [46] backend, whereas visual search methods typically rely on more complex multi-stage pipelines and often use different backends. Direct wall-clock comparisons would therefore be confounded by implementation differences. Still, prior work [14], [25] suggests that visual search methods usually incur much higher latency; for example, methods such as ZoomEye [11] are often reported to require more than \(5\times\) the inference time of the underlying base model. This further suggests that P2R offers a more favorable practical efficiency-performance trade-off.
Figure 13 highlights the importance of bounding boxes in our framework. Compared with the no-bounding-box setting, using bounding boxes leads to substantial performance gains, showing that explicitly focusing on relevant regions is critical for fine-grained visual reasoning. This confirms the importance of decoupling perception and reasoning in the P2R framework. In contrast, random bounding boxes hurt performance, further showing that accurate region localization is essential.
After PRA-GRPO training, the model’s self-generated bounding boxes already achieve performance very close to that of ground-truth bounding boxes. For P2R-4B, the gap between self-generated and oracle boxes is only 0.5% (93.2% vs.%), indicating that the learned Perceiver can accurately identify key regions without external box supervision at inference time. In addition, P2R-4B is more robust to random bounding boxes than the base model, with a much smaller degradation under noisy box inputs. This suggests that PRA-GRPO improves both region localization quality and robustness to imperfect visual hints.
DAPO [47] is an improved variant of GRPO [48]–[52] that has shown strong performance on mathematical reasoning tasks. Compared with standard GRPO, DAPO introduces several modifications, including removing the KL divergence term, clip-higher, dynamic sampling, token-level policy gradient loss, and overlong reward shaping. Prior work [53], [54] has shown that these changes can lead to clear gains over GRPO on text-based reasoning benchmarks, and recent work [16], [20] on fine-grained visual perception has also adopted this training recipe.
However, in our setting, we find that DAPO is less suitable for training the Perceiver. In particular, during the Perceiver phase, DAPO causes the predicted bounding box count to drop rapidly and quickly converge to one. This behavior is problematic for tasks that require multiple boxes. For example, many samples in the spatial relationship reasoning split of V-Star require comparing the relative positions of two objects. If the model outputs only a single bounding box, it cannot reliably capture both objects, leading to a clear performance drop. On the 4B model, DAPO achieves only 85.8% on V-Star Spatial, whereas GRPO reaches 94.7%.
We hypothesize that this issue is related to the removal of the KL divergence term in DAPO. Without KL regularization, the policy can more easily drift away from the original response pattern and collapse to a simpler mode that generates only one bounding box. While such behavior may not be problematic in pure text reasoning, it is harmful in our setting, where the model must maintain flexible multi-box perception behavior. We therefore use GRPO instead of DAPO in all main experiments.
Figures 14, 15, 16, 17, 18, and 19 show additional successful cases of P2R-4B across diverse benchmarks and task types, including fine-grained attribute recognition, spatial relation reasoning, chart understanding, remote sensing perception, and OCR-intensive reasoning. Overall, these examples exhibit a consistent perceive-to-reason pattern: the model first identifies a compact region relevant to the query, and then uses the zoomed-in crop to extract fine-grained evidence for the final answer. This behavior is particularly useful when the target evidence is small, subtle, or embedded in cluttered high-resolution scenes. Across these cases, P2R-4B can successfully localize and reason over key visual evidence such as small symbols, distant objects, fine-grained text, chart segments, and tiny structures in remote-sensing images.
We also show two representative failure cases in Figures 20 and 21. In Figure 20, the model correctly localizes the clock tower and zooms into the relevant clock face, indicating that the Perceiver identifies the right evidence. The error instead comes from fine-grained visual recognition in the cropped region: the model mistakenly interprets the hour hand as pointing to 12 rather than 11, which leads to the wrong answer. This example suggests that even with accurate localization, P2R-4B can still fail on subtle visual reading tasks that require precise interpretation of small details.
In Figure 21, the model also successfully detects the river, but the selected box covers only part of the river rather than the full river region on the left side of the image. As a result, the cropped evidence does not fully preserve the spatial context needed to distinguish whether the answer should be “left” or “upper.” This incomplete localization introduces ambiguity in the reasoning stage. If the full left-side river region were captured, this ambiguity would likely be avoided. This case highlights that, beyond finding the relevant object, the spatial extent of the selected region is also crucial for correct downstream reasoning.