Live Session
Hall 405
22 Sep
 
8:30
SGT
Friday Posters
Add Session to Calendar 2023-09-22 08:30 am 2023-09-22 04:05 pm Asia/Singapore Friday Posters Friday Posters is taking place on the RecSys Hub. Https://recsyshub.org
Industry Poster

Navigating the Feedback Loop in Recommender Systems: Insights and Strategies from Industry Practice

View on ACM Digital Library

Ding Tong (Netflix), Qifeng Qiao (Netflix), Ting-Po Lee (Netflix), James McInerney (Netflix) and Justin Basilico (Netflix).

View Paper PDFView Poster
Abstract

Understanding and measuring the impact of feedback loops in industrial recommender systems is challenging, leading to the underestimation of the deterioration. In this study, we define open and closed feedback loops and investigate the unique reasons behind the emergence of feedback loops in the industry, drawing from real-world examples that have received limited attention in prior research. We highlight the measurement challenges associated with capturing the full impact of feedback loops using traditional online A/B tests. To address this, we propose the use of offline evaluation frameworks as surrogates for long-term feedback loop bias, supported by a practical simulation system using real data. Our findings provide valuable insights for optimizing the performance of recommender systems operating under feedback loop conditions.

Join the Conversation

Head to Slido and select the paper's assigned session to join the live discussion.

Conference Agenda

View Full Agenda →
No items found.