Distinguishing Knowledge Impact from Citation Impact: A Methodology for Analysing Knowledge Impact for the Literature Review Genre

46 Pages Posted: 18 May 2020

See all articles by Guido Schryen

Guido Schryen

Paderborn University, Department of Management Information Systems

Gerit Wagner

HEC Montreal

Alexander Benlian

Technical University of Darmstadt

Date Written: April 21, 2020

Abstract

The scientific impact of research papers is multi-dimensional and can be determined quantitatively by means of citation analysis and qualitatively by means of content analysis. Accounting for the widely acknowledged limitations of pure citation analysis, we adopt a knowledge-based perspective on scientific impact to develop a methodology for content-based citation analysis which allows determining how papers have enabled knowledge development in subsequent research (knowledge impact). As knowledge development differs between research genres, we develop a new knowledge-based citation analysis methodology for the genre of standalone literature reviews (LRs). We apply the suggested methodology to the IS business value domain by manually coding 22 LRs and 1,228 citing papers (CPs) and show that the results challenge the assumption that citations indicate knowledge impact. We derive implications for distinguishing knowledge impact from citation impact in the LR genre. Finally, we develop recommendations for authors of LRs, scientific evaluation committees and editorial boards of journals how to apply and benefit from the suggested methodology, and we discuss its efficiency and automatization.

Keywords: Scientific impact, knowledge impact, content-based citation analysis, methodology

JEL Classification: M15

Suggested Citation

Schryen, Guido and Wagner, Gerit and Benlian, Alexander, Distinguishing Knowledge Impact from Citation Impact: A Methodology for Analysing Knowledge Impact for the Literature Review Genre (April 21, 2020). Available at SSRN: https://ssrn.com/abstract=3581789 or http://dx.doi.org/10.2139/ssrn.3581789

Guido Schryen (Contact Author)

Paderborn University, Department of Management Information Systems ( email )

Paderborn
Germany

Gerit Wagner

HEC Montreal ( email )

3000, Chemin de la Côte-Sainte-Catherine
Montreal, Quebec H2X 2L3
Canada

Alexander Benlian

Technical University of Darmstadt ( email )

Universitaets- und Landesbibliothek Darmstadt
Magdalenenstrasse 8
Darmstadt, Hesse D-64289
Germany

Do you have negative results from your research you’d like to share?

Paper statistics

Downloads
55
Abstract Views
717
Rank
684,709
PlumX Metrics