Skip to content

Source paper

MinerU: An Open-Source Solution for Precise Document Content Extraction

Bin Wang, Chao Xu, Xiaomeng Zhao and 15 more

Bin Wang, Chao Xu, Xiaomeng Zhao, Linke Ouyang, Fan Wu, Zhiyuan Zhao, Rui Xu, Kaiwen Liu, Yuan Qu, Fukai Shang, Bo Zhang, Liqun Wei, Zhihao Sui, Wei Li, Botian Shi, Yu Qiao, Dahua Lin, Conghui He

arXiv 2409.18839 · 202435 upvotes on Hugging Face

Research ideas from this paper (3)

Generated by AI. The paper’s authors did not write these.

AI summary

This paper introduces MinerU, an open-source document extraction tool designed to convert diverse and complex PDF documents—such as textbooks, academic papers, and exams—into high-quality machine-readable formats like Markdown and JSON. The authors address the limitations of existing tools by creating a pipeline that integrates specialized deep learning models for layout analysis, formula detection, and content recognition, validated against a newly constructed diverse evaluation dataset.

How it works (AI summary)

MinerU employs a multi-stage pipeline called 'PDF-Extract-Kit'. First, it uses PyMuPDF for preprocessing. Second, it utilizes specific models for content parsing: a fine-tuned LayoutLMv3 for layout analysis, YOLO for formula detection, UniMERNet for formula recognition, TableMaster for tables, and PaddleOCR for text. Finally, it applies rule-based post-processing to manage bounding box overlaps and reconstruct the reading order.