Dynamic Multi-Scale Layout Analysis
Deploy an adaptive coarse-to-fine layout analysis strategy that dynamically re-crops and processes high-density sub-regions of document images at higher resolutions.
Source paper
Junbo Niu, Zheng Liu, Zhuangcheng Gu, Bin Wang, Linke Ouyang, Zhiyuan Zhao, Tao Chu, Tianyao He, Fan Wu, Qintong Zhang, Zhenjiang Jin, Guang Liang, Rui Zhang, Wenzheng Zhang, Yuan Qu, Zhifei Ren, Yuefeng Sun, Yuanhong Zheng, Dongsheng Ma, Zirui Tang, Boyu Niu, Ziyang Miao, Hejun Dong, Siyi Qian, Junyuan Zhang, Jingzhou Chen, Fangdong Wang, Xiaomeng Zhao, Liqun Wei, Wei Li, Shasha Wang, Ruiliang Xu, Yuanyuan Cao, Lu Chen, Qianqian Wu, Huaiyu Gu, Lindong Lu, Keming Wang, Dechen Lin, Guanlin Shen, Xuanhe Zhou, Linfeng Zhang, Yuhang Zang, Xiaoyi Dong, Jiaqi Wang, Bo Zhang, Lei Bai, Pei Chu, Weijia Li, Jiang Wu, Lijun Wu, Zhenxiang Li, Guangyu Wang, Zhongying Tu, Chao Xu, Kai Chen, Yu Qiao, Bowen Zhou, Dahua Lin, Wentao Zhang, Conghui He
Generated by AI. The paper’s authors did not write these.
Deploy an adaptive coarse-to-fine layout analysis strategy that dynamically re-crops and processes high-density sub-regions of document images at higher resolutions.
Condition local document crop recognition on a compressed global semantic vector extracted from the vision encoder to improve layout-aware document understanding without high-resolution full-image processing.
Synthesize hard training document images using generative models that specifically target identified failure modes like heavy watermarks and extreme aspect ratios, replacing heuristic mining.
MinerU2.5 is a 1.2B-parameter vision-language model designed for efficient, high-resolution document parsing. It achieves state-of-the-art accuracy by decoupling the process into two stages: global layout analysis on a downsampled image and fine-grained content recognition on native-resolution crops, supported by a sophisticated data engine that mines 'hard cases' via inference consistency.
The model utilizes a NaViT vision encoder and Qwen2-Instruct language decoder within a two-stage pipeline. Stage 1 performs layout detection on a 1036x1036 thumbnail to identify regions; Stage 2 crops these regions from the original high-resolution image and processes them independently for text, table, and formula recognition using specific prompts.