Efficient Learning to Learn a Robust CTR Model for Web-scale Online Sponsored Search Advertising
Xin Wang, Peng Yang, Shaopeng Chen, Lin Liu, Zhao Lian, Jiacheng Guo, Mingming Sun, Ping Li · 2021
Click-through rate (CTR) prediction is crucial for online sponsored search advertising. Several successful CTR models have been adopted in the industry, including the regularized logistic regression (LR). Nonetheless, the learning process suffers from two limitations: 1) Feature crosses for high-order information may generate trillions of features, which are sparse for online learning examples; 2) Rapid changing of data distribution brings challenges to the accurate learning since the model has to perform a fast adaptation on the new data. Moreover, existing adaptive optimizers are ineffective in handling the sparsity issue for high-dimensional features.