Deep Search Relevance Ranking in Practice
Abstract
Machine Learning techniques for developing industry-scale search engines have long been a prominent part of most domains and their online products. Search relevance algorithms are key components of products across different fields, including e-commerce, streaming services, and social networks. In this tutorial, we plan to give a introduction to such large-scale search ranking systems, specifically focusing on deep learning techniques in this area. The topics we plan to cover are the following: (1) Overview of search ranking systems in practice, including popular techniques such as page rank algorithm and BM25; (2) Introduction to sequential and language models in the context of search ranking; (3) Knowledge distillation approaches for this area. For each of the aforementioned sessions we plan to first give an introductory talk and then go over an hands-on tutorial to really hone in on the concepts. We plan to cover fundamental concepts using demos, case studies, and hands-on examples, including the latest Deep Learning methods that have achieved state-of-the-art results in generating the most relevant search results. Moreover, we plan to show example implementations of these methods in python, leveraging a variety of open-source machine-learning libraries as well as real industrial data or open-source data.
Outline
No | Deep Search Relevance Ranking | Topics | Notebooks | Slides |
---|---|---|---|---|
1 | Overview of Search Relevance Ranking | Search Relevance Ranking Overview Traditional Algorithms Latest Deep Learning Approaches Evaluation Metrics |
Notebook Links
Notebook (1) Notebook (2) |
PPT |
2 | Attention based Models for Search Relevance | Transformer Sequence Models such as RNN and LSTM Attention/self-Attention Transformer |
Notebook (1)
Notebook (2) Triplet Data:triplet.csv; val_triplet.csv |
PPT
Video(session2.2) |
3 | Knowledge Distillation for Search Relevance | Deep Structured Semantic Models (DSSM) Bidirectional Encoder Representations from Transformers (BERT) |
Notebook |
PPT |
Presenters
Linsey Pang
Salesforce
Wei Liu
University of Technology Sydney
Keng-Hao Chang
Microsoft
Xue Li
Microsoft
Moumita Bhattacharya
Netflix
Abby(Xianjing) Liu
Stephen Guo
Walmart Global Tech