ChatGPT: An ever-increasing encroachment of artificial intelligence in online assessment in distance education
Katharine Naidu 1 * ,
Kershnee Sevnarayan 2 More Detail
1 Department of Curriculum and Instructional Studies, University of South Africa, Pretoria, SOUTH AFRICA
2 Department of English Studies, University of South Africa, Pretoria, SOUTH AFRICA
* Corresponding Author
Online Journal of Communication and Media Technologies, Volume 13, Issue 3, Article No: e202336.
https://doi.org/10.30935/ojcmt/13291
OPEN ACCESS 1814 Views 3615 Downloads Published online: 19 May 2023
ABSTRACT
The use of artificial intelligence (AI) in education is becoming increasingly prevalent, and its encroachment and impact on online education and assessment is a topic of interest to researchers and lecturers. ChatGPT is one such AI model that has been trained on a large corpus of text data to generate human-like responses to questions and prompts. Using the theory of disruptive innovation as a foundation for our argument, this conceptual article explores the potential and possible disruption of ChatGPT in online assessment. This article also considers the ethical and pedagogical implications of using ChatGPT, particularly in relation to online assessment in distance education. While the use of AI in online assessment presents a myriad of limitations and possibilities, it is crucial to approach its use with caution and consider the ethical implications of academic integrity for online assessment. This article aims to contribute to the ongoing discussion and debate around the use of AI in online higher education and assessment, highlighting the need for continued research and critical evaluation of its impact.
CITATION
Naidu, K., & Sevnarayan, K. (2023). ChatGPT: An ever-increasing encroachment of artificial intelligence in online assessment in distance education.
Online Journal of Communication and Media Technologies, 13(3), e202336.
https://doi.org/10.30935/ojcmt/13291
REFERENCES
- Airasian, P. W. (2000). Assessment in the classroom: A concise approach. Wadsworth Publishing.
- Al-Maqbali, A. H., & Hussain, R. (2022). The impact of online assessment challenges on assessment principles during COVID-19 in Oman. Journal of University Teaching & Learning Practice, 19(2), 73-92. https://doi.org/10.53761/1.19.2.6
- Assaraf, N. (2022). OpenAI’s ChatGPT: Optimizing language models for dialogue–cloudHQ. https://blog.cloudhq.net/openais-chatgpt-optimizing-language-models-for-dialogue/
- Black, P., & William, D. (1998). Assessment and classroom learning. Assessment in Education: Principles, Policy & Practice, 5(1), 7-74. https://doi.org/10.1080/0969595980050102
- Buchholz, K. (2023). ChatGPT sprints to one million users. https://www.statista.com/chart/29174/time-to-one-million-users/
- Cascella, M., Montomoli, J., Bellini, V., & Bignami, E. (2023). Evaluating the feasibility of ChatGPT in healthcare: An analysis of multiple clinical and research scenarios. Journal of Medical Systems, 47(1), 1-5. https://doi.org/10.1007/s10916-023-01925-4
- Chen, C. M., Wang, C. H., & Liang, J. C. (2018). The effects of competitive gaming scenarios and personalized assistance strategies on English vocabulary learning. Educational Technology & Society, 21(3), 146-158.
- Christensen, C. M. (1997). The innovator’s dilemma: When new technologies cause great firms to fail. Harvard Business School Press.
- Christensen, C. M. (2006). The ongoing process of building a theory of disruption. Journal of Product Innovation Management, 23, 39-55. https://doi.org/10.1111/j.1540-5885.2005.00180.x
- Christensen, C. M., & Horn, M. B. (2008). Disrupting class: How disruptive innovation will change the way the world learns. McGraw-Hill Education.
- Christensen, C. M., Aaron, S., & Clark, W. (2003). Disruption in education. In M. Devlin, R. Larson, & J. Meyerson (Eds.), The Internet and the university: Forum, 2001 (pp. 19-44). EDUCAUSE.
- Christensen, C. M., Raynor, M., & McDonald, R. (2015). What is disruptive innovation? Harvard Business Review, 93, 44-53.
- de Winter, J. (2023). Can ChatGPT pass high school exams on English language comprehension? https://www.researchgate.net/publication/366659237_Can_ChatGPT_pass_high_school_exams_on_English_Language_Comprehension
- Deng, J., & Lin, Y. (2022). The benefits and challenges of ChatGPT: An overview. Frontiers in Computing and Intelligent Systems, 2(2), 81-83. https://doi.org/10.54097/fcis.v2i2.4465
- Elkins, K., & Chun, J. (2020). Can GPT-3 pass a writer’s Turing test? Journal of Cultural Analytics, 5(2). https://doi.org/10.22148/001c.17212
- Gikandi, J. W., Morrow, D., & Davis, N. E. (2011). Online formative assessment in higher education: A review of the literature. Computers & Education, 57(4), 2333-2351. https://doi.org/10.1016/j.compedu.2011.06.004
- Guangul, F. M., Suhail, A. H., Khalit, M. I., & Khidhir, B. A. (2020). Challenges of remote assessment in higher education in the context of COVID-19: A case study of Middle East College. Educational Assessment, Evaluation and Accountability, 32, 519-535. https://doi.org/10.1007/s11092-020-09340-w
- Guo, B., Zhang, X., Wang, Z., Jiang, M., Nie, J., Ding, Y., Yue, J., & Wu, Y. (2023). How close is ChatGPT to human experts? Comparison corpus, evaluation, and detection. arXiv. https://doi.org/10.48550/arXiv.2301.07597
- Jolly, J. (2023). What is ChatGPT? Everything to know about OpenAI’s free AI essay writer and how it works. https://www.usatoday.com/story/tech/2023/01/27/chatgpt-buzzfeed-ai/11129947002/
- Kapp, K. M. (2012). The gamification of learning and instruction: Game-based methods and strategies for training and education. John Wiley & Sons. https://doi.org/10.1145/2207270.2211316
- Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., Krusche, S., Kutyniok, G., Michaeli, T., Nerdel, C., Pfeffer, J., Poquet, O., Sailer, M., Schmidt, A., Seidel, T., … & Kasneci, G. (2023). ChatGPT for good? On opportunities and challenges of large language models for education. Learning and Individual Differences, 103, 102274. https://doi.org/10.1016/j.lindif.2023.102274
- Kerrigan, J., Cochran, G., Tabanli, S., Charnley, M., & Mulvey, S. (2022). Post-COVID changes to assessment practices: A case study of undergraduate STEM recitations. Journal of Educational Technology Systems, 51(2), 192-201. https://doi.org/10.1177/00472395221118392
- Kumar, A. H. (2023). Analysis of ChatGPT tool to assess the potential of its utility for academic writing in biomedical domain. Biology, Engineering, Medicine and Science Reports, 9(1), 24-30. https://doi.org/10.5530/bems.9.1.5
- Kumar, A. P., Pjuari, P., & Gupta, N. (2021). Artificial intelligence: Technology 4.0 as a solution for healthcare workers during COVID-19 pandemic. 24(1). Acta Universitatis Bohemiae Meridionalis [Journal of the University of South Bohemia], 24(1), 19-35. https://doi.org/10.32725/acta.2021.002
- Kung, H., Cheatham, M., ChatGPT, Medenilla, A., Sillos, C., De Leon, L., Elepaño, C., Madriaga, M., Aggabao, R., Diaz-Candido, G., Maningo, J., & Tseng, V. (2022). Performance of ChatGPT on USMLE: Potential for AI-assisted medical education using large language models. medRxiv. https://doi.org/10.1101/2022.12.19.22283643
- Lee, T., & Aslam, I. (2023). Policy review: Academic cheating in online examinations during the COVID-19 pandemic. Journal of Scientific Research and Reports, 29(1), 1-6. https://doi.org/10.9734/jsrr/2023/v29i11720
- Lee, V. W. Y., Lam, P. L. C., Lo, J. T. S., Lee, J. L. F., & Li, J. T. S. (2022). Rethinking online assessment from university students’ perspective in COVID-19 pandemic. Cogent Education, 9(1), 2082079. https://doi.org/10.1080/2331186X.2022.2082079
- Li, N., & Lalani, F. (2020). The COVID-19 pandemic has changed education forever. This is how. World Economic Forum. https://www.weforum.org/agenda/2020/04/coronavirus-education-global-covid19-online-digital-learning/
- Manocha, S., Pujari, P., & Naseeha, A. (2022). Disruptive technologies transforming lives with reference to COVID-19 online education: A review paper. Acta Universitatis Bohemiae Meridionalis [Journal of the University of South Bohemia], 25(2), 80-90. https://doi.org/10.32725/acta.2022.010
- McMurtrie, B. (2023). Teaching: Will ChatGPT change the way you teach? The Chronicle of Higher Education. https://www.chronicle.com/newsletter/ teaching/2023-01-05.
- Metz, C., & Weise, K. (2023). Microsoft bets big on the creator of ChatGPT in race to dominate A.I. The New York Times. https://www.nytimes.com/2023/01/12/ technology/microsoft-openai-chatgpt.html
- Mhlanga, D. (2023). Open AI in education, the responsible and ethical use of ChatGPT towards lifelong learning. SSRN. https://doi.org/10.2139/ssrn.4354422
- Mitchell, A. (2022). Professor catches student cheating with ChatGPT: ‘I feel abject terror’. https://nypost.com/2022/12/26/students-using-chatgpt-to-cheat-professor-warns
- Montti, R. (2022). What is ChatGPT and how can you use it?. https://www.searchenginejournal.com/what-is-chatgpt/473664/#close
- Nisar, S., & Aslam, M. S. (2023). Is ChatGPT a good tool for T&CM students in studying pharmacology? SSRN. https://doi.org/10.2139/ssrn.4324310
- Novick, P. A, Lee, J., Wei, S., Mundorff, E. C., Santangelo, J. C., & Timothy, M. (2022). Maximizing academic integrity while minimizing stress in the virtual classroom. Journal of Microbiology & Biology Education, 23(1). https://doi.org/10.1128/jmbe.00292-21
- Oravec, J. A. (2022). AI, biometric analysis, and emerging cheating detection systems: The engineering of academic integrity? Education Policy Analysis Archives, 30, 175. https://doi.org/10.14507/epaa.30.5765
- Osabutey, E. L. C., Senyo, P. K., & Bempong, B. F. (2022). Evaluating the potential impact of online assessment on students’ academic performance. Information Technology & People. https://doi.org/10.1108/ITP-05-2021-0377
- Qadir, J. (2022). Engineering education in the era of ChatGPT: Promise and pitfalls of generative AI for education. TechRxiv. https://doi.org/10.36227/techrxiv.21789434.v1
- Rudolph, J., Tan, S., & Tan, S. (2023). ChatGPT: Bullshit spewer or the end of traditional assessments in higher education? Journal of Applied Learning & Teaching, 6(1), 1-22. https://doi.org/10.37074/jalt.2023.6.1.9
- Sharples, M. (2022). Automated essay writing: An AIED opinion. International Journal of Artificial Intelligence in Education, 32(4), 1119-1126. https://doi.org/10.1007/s40593-022-00300-7
- Stevens, R., Silver, L., Richards, R., & Campbell, K. (2022). A comparison of faculty and student perspectives of academic integrity in an online environment: A pilot study. Journal of Business Administration Online, 16(2).
- Stokel-Walker, C. (2022). AI bot ChatGPT writes smart essays–should professors worry? Nature. https://doi.org/10.1038/d41586-022-04397-7
- Susnjak, T. (2022). ChatGPT: The end of online exam integrity? arXiv. https://doi.org/10.48550/arXiv.2212.09292
- Tack, A., & Piech, C. (2022). The AI teacher test: Measuring the pedagogical ability of blender and GPT-3 in educational dialogues. arXiv. https://doi.org/10.48550/arXiv.2205.07540
- Tamim, B. (2023). ChatGPT outpaces Instagram: 10 million daily users in just 40 days. https://interestingengineering.com/innovation/chatgpt-outpaces-instagram-10-million-users-40-days
- Terwiesch, C. (2023). Would Chat GPT3 get a Wharton MBA? A prediction based on its performance in the operations management course. Mack Institute for Innovation Management at the Wharton School, University of Pennsylvania. https://mackinstitute.wharton.upenn.edu/wp-content/uploads/2023/01/Christian-Terwiesch-Chat-GTP.pdf
- Timothy, M. (2022). 11 things you can do with ChatGPT. https://www.makeuseof.com/things-you-can-do-with-chatgpt/
- Tung, L. (2023). ChatGPT’s next big challenge: Helping Microsoft to challenge Google search. ZDNET. https://www.zdnet.com/article/chatgpts-next-bigchallenge-helping-microsoft-to-challenge-google-search/
- Urlaub, P., & Dessein, E. (2022). From disrupted classrooms to human-machine collaboration? The pocket calculator, Google translate, and the future of language education. L2 Journal, 14(1), 45-59. https://doi.org/10.5070/L214151790
- Visagie, B. (2023). Revolutionizing technology: The game-changing potential of ChatGPT and GPT-3. https://integrove.com/the-potential-of-chatgpt-and-gpt-3/.
- Zawacki-Richter, O., Marín, V. I., Bond, M., & Gouverneur, F. (2019). Systematic review of research on artificial intelligence applications in higher education–where are the educators? International Journal of Educational Technology in Higher Education, 16(1), 1-27. https://doi.org/10.1186/s41239-019-0171-0
- Zhai, X. (2022). ChatGPT user experience: Implications for education. SSRN. https://doi.org/10.2139/ssrn.4312418