Skip to content

Source paper

NextFlow: Unified Sequential Modeling Activates Multimodal Understanding and Generation

Huichao Zhang, Liao Qu, Yiheng Liu and 33 more

Huichao Zhang, Liao Qu, Yiheng Liu, Hang Chen, Yangyang Song, Yongsheng Dong, Shikun Sun, Xian Li, Xu Wang, Yi Jiang, Hu Ye, Bo Chen, Yiming Gao, Peng Liu, Akide Liu, Zhipeng Yang, Qili Deng, Linjie Xing, Jiyang Liu, Zhao Wang, Yang Zhou, Mingcong Liu, Yi Zhang, Qian He, Xiwei Hu, Zhongqi Qi, Jie Shao, Zhiye Fu, Shuai Wang, Fangmin Chen, Xuezhi Chai, Zhihua Wu, Yitong Wang, Zehuan Yuan, Daniel K. Du, Xinglong Wu

arXiv 2601.02204 · 202647 upvotes on Hugging Face

Research ideas from this paper (3)

Generated by AI. The paper’s authors did not write these.

AI summary

This paper introduces NextFlow, a unified 7B-parameter decoder-only transformer capable of both multimodal understanding and generation. By utilizing a "next-scale" prediction paradigm (coarse-to-fine) rather than traditional raster scanning, and a dual-codebook tokenizer, the model achieves state-of-the-art generation speed and visual quality while maintaining the reasoning capabilities of Large Language Models.

How it works (AI summary)

The model uses a decoder-only transformer architecture initialized from Qwen2.5-VL. For visual generation, it employs a Vector Quantized (VQ) approach with a "next-scale" prediction strategy, generating images layer-by-layer (from coarse layout to fine detail) which allows for O(log N) inference steps. It uses a dual-codebook tokenizer to align semantic and pixel-level features and incorporates a specific Reinforcement Learning strategy (GRPO with prefix-tuning) to align the model's visual outputs with human preferences.