Quantifying and suppressing ranking bias in a large citation network

03/23/2017
by   Giacomo Vaccario, et al.
0

It is widely recognized that citation counts for papers from different fields cannot be directly compared because different scientific fields adopt different citation practices. Citation counts are also strongly biased by paper age since older papers had more time to attract citations. Various procedures aim at suppressing these biases and give rise to new normalized indicators, such as the relative citation count. We use a large citation dataset from Microsoft Academic Graph and a new statistical framework based on the Mahalanobis distance to show that the rankings by well known indicators, including the relative citation count and Google's PageRank score, are significantly biased by paper field and age. We propose a general normalization procedure motivated by the z-score which produces much less biased rankings when applied to citation count and PageRank score.

READ FULL TEXT
research
01/30/2023

Citation Analysis of Computer Systems Papers

Citation analysis is used extensively in the bibliometrics literature to...
research
10/25/2017

Early identification of important patents through network centrality

One of the most challenging problems in technological forecasting is to ...
research
01/15/2020

Unbiased evaluation of ranking metrics reveals consistent performance in science and technology citation data

Despite the increasing use of citation-based metrics for research evalua...
research
01/13/2020

An Evaluation of Percentile Measures of Citation Impact, and a Proposal for Making Them Better

Percentiles are statistics pointing to the standing of a paper's citatio...
research
08/29/2018

Revisiting Relative Indicators and Provisional Truths

Following discussions in 2010 and 2011, scientometric evaluators have in...
research
09/06/2020

Utilizing Citation Network Structure to Predict Citation Counts: A Deep Learning Approach

With the advancement of science and technology, the number of academic p...

Please sign up or login with your details

Forgot password? Click here to reset