Poster Papers

A 3D Approach to Recommender System Evaluation

AuthorAlan Said, Brijnesh Johannes Jain, Sahin Albayrak
SourceProceedings of the 16th ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW'13) Companion [to appear] 
LinksDownload   |   BibTeX 

In this work we describe an approach at multi-objective recommender system evaluation based on a previously introduced 3D benchmarking model. The benchmarking model takes user-centric, business-centric and technical constraints into consideration in order to provide a means of comparison of recommender algorithms in similar scenarios. We present a comparison of three recommendation algorithms deployed in a user study using this 3D model and compare to standard evaluation methods. The proposed approach simplifies benchmarking of recommender systems and allows for simple multi-objective comparisons.