earticle

영어

Popularity based top-N news recommender systems have often been criticized for limitations like monotonicity and popularity amplification. The probabilistic selection of news articles has been found to theoretically address some of the major limitations of top-N recommendation, but its potential impact on reader behavior has not been examined. Based on the variety-seeking nature of consumption, we hypothesize that the probabilistic system should outperform the top-N system across measures of web traffic, user satisfaction, and reader engagement selected using the Balanced Score Card. For evaluation, we conducted a couple of laboratory based experiments. In the first part, 68 participants were randomly assigned to two groups who were shown the same website. Based on the measures, we calculated the sample size for A/B testing. Web traffic and user satisfaction scores were higher for readers who were shown the probabilistic recommendations by 20% and 10%, respectively. Results regarding reader engagement were statistically insignificant. Based on our findings, we conclude that the probabilistic system can be used by media houses as an alternative to the top-N system.