🤖 AI Summary
This study investigates the measurement error introduced by summing or averaging citation counts after nonlinear field normalization and its implications for research impact assessment. Addressing the mathematical problem that nonlinear transformations violate metric isometry and distort aggregation, the authors systematically compare six linear and nonlinear normalization methods through empirical analysis on publication datasets from multiple universities, using raw citations and linearly normalized results as baselines. Results show that while aggregation after nonlinear normalization introduces bias, the overall error magnitude remains relatively small; critically, error amplification is strongly contingent on publication sample homogeneity—heterogeneous samples exhibit significantly larger errors. This work provides the first quantitative characterization of the interaction effect between normalization choice and aggregation operation, establishing a foundational methodological framework for selecting, interpreting, and justifying normalization strategies in scientometric evaluation.
📝 Abstract
Summing or averaging nonlinearly field-normalized citation counts is a common but methodologically problematic practice, as it violates mathematical principles. The issue originates from the nonlinear transformation, which disrupts the equal-interval property of the data. Such unequal data do not satisfy the necessary conditions for summation. In our study, we normalized citation counts of papers from all sample universities using six linear and nonlinear methods, and then computed the total and average scores for each university under each method. By benchmarking against raw citations and linear normalized scores, we explore how large the error effect is from summing or averaging the nonlinear field normalized citation counts. Our empirical results indicate that the error exists but is relatively small. We further found that the magnitude of the error is significantly influenced by whether the sample publications are homogeneous or heterogeneous. This study has significant implications for whether the results obtained through nonlinear methods on a single level can be directly summed or averaged when calculating the overall impact of a research unit.