Design and Evaluation of an IT-Based Peer Assessment to Increase Learner Performance in Large-Scale Lectures

Lehmann, K.; Söllner,M. & Leimeister, J. M. (2016): Design and Evaluation of an IT-based Peer Assessment to Increase Learner Performance in Large-Scale Lectures. In: International Conference on Information Systems (ICIS), Dublin, Ireland.

22 Pages Posted: 27 Apr 2018

See all articles by Katja Lehmann

Katja Lehmann

University of Kassel - Information Systems

Matthias Söllner

University of Kassel - Information Systems; University of St. Gallen - Institute of Information Management

J. M. Leimeister

University of St. Gallen; University of Kassel - Information Systems

Date Written: December 11, 2016

Abstract

In this study, we propose an IT-based peer assessment (ITPA) for enhancing interaction and feedback in universities’ large-scale lectures. These lectures often lack interaction and feedback, and focus on mainly imparting factual knowledge. Hence, these formats often cannot go beyond the basic cognitive levels of educational objectives. Using the ITPA within the learning process helps integrating assignments focusing on high cognitive levels to comprehensively acquire the learning content. We follow a design science research approach to develop and evaluate the ITPA. Thus, we first identify requirements from theory and derive a set of design elements afterwards. A pre-test shows that the ITPA is seen as useful and learners intend to use it. The subsequent quasi-experiment in a large-scale lecture shows that learners who participated in the ITPA performed better in the part of the final exam trained by the ITPA, whereas they did not perform better in the others parts.

Keywords: IT-based peer assessment, technology-mediated learning, large-scale lectures, learning performance, educational objectives, design science research

Suggested Citation

Lehmann, Katja and Söllner, Matthias and Leimeister, Jan Marco, Design and Evaluation of an IT-Based Peer Assessment to Increase Learner Performance in Large-Scale Lectures (December 11, 2016). Lehmann, K.; Söllner,M. & Leimeister, J. M. (2016): Design and Evaluation of an IT-based Peer Assessment to Increase Learner Performance in Large-Scale Lectures. In: International Conference on Information Systems (ICIS), Dublin, Ireland. , Available at SSRN: https://ssrn.com/abstract=3159160 or http://dx.doi.org/10.2139/ssrn.3159160

Katja Lehmann

University of Kassel - Information Systems ( email )

Pfannkuchstraße 1
Kassel, 34121
Germany

Matthias Söllner

University of Kassel - Information Systems ( email )

Pfannkuchstraße 1
Kassel, 34121
Germany

University of St. Gallen - Institute of Information Management ( email )

Müller-Friedberg-Str. 8
St. Gallen, 9000
Switzerland

Jan Marco Leimeister (Contact Author)

University of St. Gallen ( email )

Varnbuelstr. 14
Saint Gallen, St. Gallen CH-9000
Switzerland

University of Kassel - Information Systems ( email )

Pfannkuchstraße 1
Kassel, 34121
Germany

Do you have negative results from your research you’d like to share?

Paper statistics

Downloads
58
Abstract Views
534
Rank
653,722
PlumX Metrics