Accelerating E-Commerce Search Engine Ranking by Contextual Factor Selection

by   Yusen Zhan, et al.

In industrial large-scale search systems, such as search for commodities, the quality of the ranking result is getting continually improved by introducing more factors from complex procedures, e.g., deep neural networks for extracting image factors. Meanwhile, the increasing of the factors demands more computation resource and raises the system response latency. It has been observed that a search instance usually requires only a small set of effective factors, instead of all factors. Therefore, removing ineffective factors significantly improves the system efficiency. This paper studies the Contextual Factor Selection (CFS), which selects only a subset of effective factors for every search instance, for a well balance between the search quality and the response latency. We inject CFS into the search engine ranking score to accelerate the engine, considering both ranking effectiveness and efficiency. The learning of the CFS model involves a combinatorial optimization, which is transformed as a sequential decision-making problem. Solving the problem by reinforcement learning, we propose the RankCFS, which has been assessed in an off-line environment as well as a real-world on-line environment ( The empirical results show that, the proposed CFS approach outperforms several existing supervised/unsupervised methods for feature selection in the off-line environment, and also achieves significant real-world performance improvement, in term of service latency, in daily test as well as Singles' Day Shopping Festival in 2017.


Towards a Better Tradeoff between Effectiveness and Efficiency in Pre-Ranking: A Learnable Feature Selection based Approach

In real-world search, recommendation, and advertising systems, the multi...

Cascade Ranking for Operational E-commerce Search

In the 'Big Data' era, many real-world applications like search involve ...

Demystifying Core Ranking in Pinterest Image Search

Pinterest Image Search Engine helps hundreds of millions of users discov...

Feature Importance Ranking for Deep Learning

Feature importance ranking has become a powerful tool for explainable AI...

AdCraft: An Advanced Reinforcement Learning Benchmark Environment for Search Engine Marketing Optimization

We introduce AdCraft, a novel benchmark environment for the Reinforcemen...

Reinforcement Learning to Rank in E-Commerce Search Engine: Formalization, Analysis, and Application

In e-commerce platforms such as Amazon and TaoBao, ranking items in a se...

Style Miner: Find Significant and Stable Explanatory Factors in Time Series with Constrained Reinforcement Learning

In high-dimensional time-series analysis, it is essential to have a set ...

Please sign up or login with your details

Forgot password? Click here to reset