GFlowGR: Fine-tuning Generative Recommendation Frameworks with Generative Flow Networks
Yejing Wang, Shengyu Zhou, Jinyu Lu, Qidong Liu, Xinhang Li, Wenlin Zhang, Feng Li, Pengjie Wang, Chuan Yu, Jian Xu, Bo Zheng, Xiangyu Zhao · 2026
Generative recommendation (GR) has shown great promise in industrial applications, particularly for candidate generation and end-to-end recommendations. However, existing GR training paradigms suffer from two fundamental mismatches with real-world deployment requirements. First, they optimize for point-wise prediction of a single ground-truth item, whereas practical systems must produce a diverse, high-value set of candidates. Second, they treat all user interactions as equally informative, ignoring their inherent differences in utility. Although reward-based fine-tuning offers a partial remedy, it often lacks token-level supervision. To address these challenges, we reformulate GR as a sequential set-generation problem and propose GFlowGR, a GFlowNet-based fine-tuning framework that explicitly aligns generation probabilities with item-level utilities. GFlowGR comprises three tightly integrated components, each addressing a key limitation of conventional fine-tuning: a trajectory sampler that constructs training trajectories from candidate sets to enable set-wise learning, a behavior-aware reward model that quantifies item utility to support value-aware optimization, and a GFlowNet objective that provides token-level supervision. Extensive experiments on three real-world datasets with two representative LLM-based GR backbones show consistent and significant improvements over strong baselines, validating the effectiveness of our approach. For real-world deployment, GFlowGR has been integrated into Taobao 's search advertising businesses, delivering a 0.4% relative improvement in annual revenue since its launch in mid-2025, corresponding to billion-level monetary gains. Code is available at https://github.com/Applied-Machine-Learning-Lab/SIGIR26_GFlowGR.