Live Session
Hall 406 CX
Paper
22 Sep
 
16:05
SGT
Session 17: Interactive Recommendation 2
Add Session to Calendar 2023-09-22 04:05 pm 2023-09-22 05:25 pm Asia/Singapore Session 17: Interactive Recommendation 2 Session 17: Interactive Recommendation 2 is taking place on the RecSys Hub. Https://recsyshub.org
Research

Incentivizing Exploration in Linear Bandits under Information Gap

View on ACM Digital Library

Huazheng Wang (Oregon State University), Haifeng Xu (University of Chicago), Chuanhao Li (University of Virginia), Zhiyuan Liu (University of colorado,boulder) and Hongning Wang (University of Virginia)

View Paper PDFView Poster
Abstract

Contextual bandit algorithms have been popularly used to address interactive recommendation, where the users are assumed to be cooperative to explore all recommendations from a system. In this paper, we relax this strong assumption and study the problem of incentivized exploration with myopic users, where the users are only interested in recommendations with their currently highest estimated reward. As a result, in order to obtain long-term optimality, the system needs to offer compensation to incentivize the users to take the exploratory recommendations. We consider a new and practically motivated setting where the context features employed by the user are more \emph{informative} than those used by the system: for example, features based on users’ private information are not accessible by the system. We develop an effective solution for incentivized exploration under such an information gap, and prove that the method achieves a sublinear rate in both regret and compensation. We theoretically and empirically analyze the added compensation due to the information gap, compared with the case where the system has access to the same context features as the user does, i.e., without information gap. Moreover, we also provide a compensation lower bound of this problem.

Join the Conversation

Head to Slido and select the paper's assigned session to join the live discussion.

Conference Agenda

View Full Agenda →
No items found.