Advanced30 minSearch RelevanceEngagement MetricsPosition Bias
Search Ranking Quality Evaluation for Bookshelf Online Marketplace
Bookshelf is an online marketplace for new and used books. Sellers list inventory and buyers search for titles by keyword.
The product team recently noticed that click-through rates on search results have been declining quarter over quarter, and conversion from search to purchase has softened.
The business question
Is the decline in search engagement from poor relevance or position bias?