User credibility evaluation for reputation measurement of online service
Yahan Xiong, Xiaodong Fu
International Journal of Web Information Systems, Vol. 20, No. 2, pp.176-194

Users often struggle to select choosing among similar online services. To help them make informed decisions, it is important to establish a service reputation measurement mechanism. User-provided feedback ratings serve as a primary source of information for this mechanism, and ensuring the credibility of user feedback is crucial for a reliable reputation measurement. Most of the previous studies use passive detection to identify false feedback without creating incentives for honest reporting. Therefore, this study aims to develop a reputation measure for online services that can provide incentives for users to report honestly.

In this paper, the authors present a method that uses a peer prediction mechanism to evaluate user credibility, which evaluates users’ credibility with their reports by applying the strictly proper scoring rule. Considering the heterogeneity among users, the authors measure user similarity, identify similar users as peers to assess credibility and calculate service reputation using an improved expectation-maximization algorithm based on user credibility.

Theoretical analysis and experimental results verify that the proposed method motivates truthful reporting, effectively identifies malicious users and achieves high service rating accuracy.

The proposed method has significant practical value in evaluating the authenticity of user feedback and promoting honest reporting.