MHRR: MOOCs Recommender Service With Meta Hierarchical Reinforced Ranking
Yuchen Li, Haoyi Xiong, Linghe Kong, Rui Zhang, Fanqin Xu, Guihai Chen, Minglu Li · IEEE Transactions on Services Computing · 2023
The exponential growth of Massive Open Online Courses (MOOCs) surges the needs of advanced models for personalized Online Education Services (OES). Existing solutions successfully recommend MOOCs courses via deep learning models, they however generate weak “course embeddings” with original profiles, which contain noisy and few enrolled courses. On the other hand, existing algorithms provide recommendation orders according to the score of each course while ignoring personalized demands of users. To tackle the above challenges, we propose aMetaHierarchicalReinforcedRankingapproachMHRR, which consists of a meta hierarchical reinforcement learning pre-trained mechanism and an over-parameterized ranking regressor to enhance the representation learning of courses and learners while refining the ranking result of recommended courses. Specifically,MHRRcombines a user profile reviser and a meta embedding generator to provide course embedding representation enhancement for recommender services. Furthermore,MHRRtransforms learned representations generated from recommender services with Gaussian kernel approximation to over-parameterize the downstream learning to rank (LTR) models with representations in ultra-high dimensionality. We deployMHRRon a real-world MOOCs platform and evaluate it with a large number of baseline models. The results show thatMHRRoutperforms baseline algorithms on two major metrics, including Hit Ratio (HR) and Normalized Discounted Cumulative Gain (NDCG). Also, we conduct a 7-day online evaluation using the realistic traffic of a large-scale real-world MOOCs platform, where we can still observe significant improvement in real-world applications.MHRRperforms consistently both in the online and offline evaluation.