Investigating user group behavior patterns in digital examinations
DOI:
https://doi.org/10.15584/sar.2022.19.4Keywords:
language education, language testing, digital assessment, technology, pandemicAbstract
Computer Mediated Communication (CMC), as well as Electronically Mediated Communication (EMC), is becoming a staple feature of many working environments. More recently, Computer Mediated Assessment (CMA) in the form of Testing Assessment Systems (TMS) has joined the ranks of arrangements where learning, information exchange and assessment take place in digital landscapes, where on top of deploying assessment, they constitute a meeting ground for teachers, assessors, and students/learners. Any such system has the potential to offer numerous other opportunities including amongst others a training platform, a system for creating learner portfolios, a vetting system for rating scale construction or a multimedia annotated corpus of learner language. Additionally, information stored in a TMS may be used for research purposes, collaborative arrangements for professional development, vetting and training solutions. This paper presents what has emerged from developing procedures and functionalities in digital exams, and what may appear as attractive opportunities offering insights into the functioning of digital assessment and digital testing environments. While, admittedly, functionalities presented here have been gradually, and while in most cases, added ad hoc to the system, over the course of eleven years since the environment was first put into operation, have come, not only to complement one another, but also to function as a coherent system. In their current state, they offer practical solutions in quality control, training, research, and systems forensics.Downloads
References
Biber, Douglas, Johansson, Stig, Leech, Goeffrey, Conrad, Susan, and Finegan, Edward (1999). Longman Grammar of Spoken and Written English. Pearson Education Limited.
Blackmore, Chris (2010). Social Learning Systems and Communities of Practice. Springer London. Bond, Trevor, and Fox, Christine., 2007, Applying the Rasch Model. Fundamental Measurement in the Human Sciences. University of Toledo Press
Botley, Simon, Mcenery, Tony and Wilson, Andrew (2000). Multilingual Corpora in Teaching and Research. Editions Rodopi
Brown Cati, Snodgrass Tony, Kemper Susan, Herman Ruth and Covington, Michael (2008) Automatic Measurement of Propositional Idea Density from Part-of-speech Tagging, Behavioral Research Methods; 40(2): 540–545.
Brown, Annie., 2006, An examination of the rating process in the revised IELTS Speaking Test., IELTS Research Reports Volume 6, IELTS Australia, Canberra and British Council, London, pp 41–65
Cohen, Andrew (2014). Strategies in Learning and Using a Second Language. Taylor & Francis
De Velle, Sacha., 2008, The revised IELTS Pronunciation scale., ESOL Research Notes, vol 34, pp 36–38
Drasgow, Fritz. 2015. Technology and Testing: Improving Educational and Psychological Measurement. NCME Applications of Educational Measurement and Assessment Book Series. Taylor & Francis.
Dror, Itiel (2011). Technology Enhanced Learning and Cognition. John Benjamins Publishing Company.
Gadomska, Agnieszka, & Krakowian, Przemysław. (2017). Implementing Blogs for Developing Academic Writing Skills in a Variety of Higher Educational Contexts. International Journal of Continuing Engineering Education and Life-long Learning, 27(4), 1.
Gardenfors, Peter, & Johansson, Petter. (2014). Cognition, Education, and Communication Technology. Taylor &Francis
Gilquin, Gaëtanelle & Paquot, Magali, (2008). Too Chatty: Learner Academic Writing and Register Variation. English Text Construction 1(1):41–61.
Gledhill Christopher, (2000), Collocations in Science Writing. Language in Performance Series no. 22, Tübingen, Gunter Narr Verlag.
Heintz, Alexander (2017). Cheating at Digital Exams – Vulnerabilities and Countermeasures. Norwegian University of Science and Technology Department of Computer Science
Hildreth, Paul, & Kimble, Chris (2004). Knowledge Networks: Innovation Through Communities of Practice. London Hershey: Idea Group Inc.
Hoc, Jean-michel, Cacciabue, Pietro, & Hollnagel, Eric (2013). Expertise and Technology: Cognition & Human-computer Cooperation. Taylor & Francis.
Hubbard, Christopher., Gilbert, Susan., and Pidcock, John., 2006, Assessment processes in speaking tests: a pilot verbal protocol study., ESOL Research Notes, vol 24, pp 14–19
Journal of Law 2007 no. 188, Section 1374: Rozporządzenie Ministra Nauki i Szkolnictwa Wyższego z Dnia 25 Września 2007 r. w Sprawie Warunków Jakie Muszą Być Spełnione, aby Zajęcia Dydaktyczne na Studiach Mogły Być Prowadzone z Wykorzystaniem Metod i Technik Kształcenia na Odległość, dz. u. 2007 nr. 188, poz. 1374 z Późn. Zm.
Kintsch Walter (1974) The Representation of Meaning in Memory. Erlbaum.
Koh, Hiam Seng, & lee, sai Choo. (2008). Information Communication Technology in Education: Singapore’s ICT Masterplans, 1997–2008. World Scientific Publishing Company PTE Limited.
Krakowian, Przemysław. 2010. Modern Test Theory Explained. Warszawa: Oficyna Wydawnicza Scholar.
Krakowian, Przemysław. 2018. Classical and Modern Test Theory in Developing and Validating Language Tests. Wydawnictwo Naukowe PWSZ w Płocku
Leila, Barbara, and Scott, Mike eds. (1994) Reflections on Language Learning. Multilingual Matters
Li, li (2017). New Technologies and Language Learning. Macmillan Education UK.
Mcenery, Tony and Wilson, Andrew (2001). Corpus Linguistics: An Introduction. Edinburgh University Press
O’Neill, Brien, & Gillespie, Alex. (2014). Assistive Technology for Cognition: A Handbook for Clinicians and Developers. Taylor & Francis.
Orr, Michael., 2002, The FCE Speaking test: using rater reports to help interpret test scores., System, vol 30, no 2, pp 143–154
Pachler, Norbert, Ben Bachmair, John Cook, and Gunther Kress. 2009. Mobile Learning: Structures, Agency, Practices. Springer US.
Parsons, David. 2012. Refining Current Practices in Mobile and Blended Learning: new Applications: new Applications. Advances in Mobile and Distance Learnin.g IGI Global.
Saint-Onge, Hubert, & Wallace, Debra (2012). Leveraging Communities of Practice for Strategic Advantage. Taylor & Francis.
Seed, George., 2012, Perceptions of authenticity in academic test tasks., ESOL Research Notes, vol 49, pp 17–26
Seok, Shoonhwa, Meyen, Edward & Boaventura Dacosta (2010). Handbook of Research on Human Cognition and Assistive Technology: Design, Accessibility and Transdisciplinary Perspectives: Design, Accessibility and Transdisciplinary Perspectives. Medical Information Science Reference.
Snowdon David, Kemper Susan, Mortimer James, Greiner Lydia, Wekstein David, and Markesbery William (1996). Linguistic Ability in Early Life and Cognitive Function and Alzheimer's Disease in Late Life: Findings from the nun Study. JAMA 528–532.
Turner Althea & Greene Edith (1977). The Construction and use of a Propositional Text Base (Technical Report 63). University of Colorado, Institute for the Study of Intellectual Behavior, Boulder.
Tynan, Robert., 2015, Creating ePortfolios to facilitate and evidence progress using learning technologies., Cambridge Exams Research Notes, vol 61, pp 55–68
Wenger, Etienne (1999). Communities of Practice: Learning, Meaning, and Identity. Cambridge University Press.
Wenger, Etienne, Mcdermott, Richard, & Snyder, William (2002). Cultivating Communities of Practice: A Guide to Managing Knowledge. Harvard Business School Press.
Wenger, Etienne, White, Nancy, and Smith, John (2009). Digital Habitats: Stewarding Technology for Communities. CPSquare
Wilson, Mark., 2005, Constructing Measures: An Item Response Model Lawrence Erlbaum Associates
Wright, Benjamin., and Masters, Goeffrey., 1982, Rating Scale Analysis. MESA Press
Wright, Benjsamin., and Stone, Mark., 1979, Best Test Design. MESA Press
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2022 Studia Anglica Resoviensia
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
