Adoption of mobile instant messaging tools among higher education students: Scale development

Tatiana I. Ladykova 1, Lyudmila S. Chikileva 2, Svetlana A. Vorobiova 3 * , Kseniia M. Chugaeva 4, Elena P. Kalashnikova 5, Valentina V. Latysheva 6
More Detail
1 Lomonosov Moscow State University, Moscow, RUSSIA
2 Financial University under the Government of the Russian Federation, Moscow, RUSSIA
3 Sechenov First Moscow State Medical University, Moscow, RUSSIA
4 MIREA–Russian Technological University, Moscow, RUSSIA
5 Peoples’ Friendship University of Russia (RUDN University), Moscow, RUSSIA
6 Moscow Aviation Institute (National Research University), Moscow, RUSSIA
* Corresponding Author
Online Journal of Communication and Media Technologies, Volume 16, Issue 1, Article No: e202611. https://doi.org/10.30935/ojcmt/18084
OPEN ACCESS   41 Views   15 Downloads   Published online: 12 Mar 2026
Download Full Text (PDF)

ABSTRACT

This study aimed to develop a valid and reliable scale to measure higher education students’ adoption levels of mobile instant messaging (MIM) tools. Within the scope of the study, a comprehensive literature review was conducted, an item pool of 53 items was created and content validity was ensured by consulting expert opinions. A pilot study was conducted with 23 participants to evaluate the comprehensibility of the scale. Data were collected from 351 higher education students to evaluate the psychometric properties of the scale. As a result of the exploratory factor analysis, it was determined that the scale had a three-factor structure as “ease of use and usefulness,” “flexible learning and collaboration” and “concerns.” Confirmatory factor analysis supported this structure (CFI = 0.91, TLI = 0.902, SRMR = 0.049, RMSEA = 0.0734). The reliability coefficients of the scale were high (Cronbach’s α = 0.962, McDonald’s ω = 0.968). Latent profile analysis revealed that the students were divided into four different profiles: “passionate advocates,” “positive pragmatic users,” “balanced users,” and “abstaining adopters.” Analyses of demographic variables showed that younger students have a more positive view of MIM technologies and that women are more cautious about MIM use than men. The scale developed in this study is a valuable tool that can be used to evaluate the use of MIM technologies in higher education, identify different user profiles and plan the integration of MIM technologies into educational processes. Future studies are recommended to test the scale in different cultural contexts and examine the effects of MIM use on academic performance.
Keywords: mobile instant messaging, higher education, scale development, WhatsApp, Telegram, WeChat

CITATION

Ladykova, T. I., Chikileva, L. S., Vorobiova, S. A., Chugaeva, K. M., Kalashnikova, E. P., & Latysheva, V. V. (2026). Adoption of mobile instant messaging tools among higher education students: Scale development. Online Journal of Communication and Media Technologies, 16(1), e202611. https://doi.org/10.30935/ojcmt/18084

REFERENCES

  • Afful, B., & Akrong, R. (2020). WhatsApp and academic performance among undergraduate students in Ghana: Evidence from the University of Cape Coast. Journal of Education for Business, 95(5), 288-296. https://doi.org/10.1080/08832323.2019.1644276
  • Afzal, I., & Abdullah, N. A. (2022). Role of WhatsApp in teaching and learning process in schools in Pakistan. Journal of Educators Online, 19(3). https://doi.org/10.9743/JEO.2022.19.3.1
  • Aharony, N., & Zion, A. (2019). Effects of WhatsApp’s use on working memory performance among youth. Journal of Educational Computing Research, 57(1), 226-245. https://doi.org/10.1177/0735633117749431
  • Ahmad, N. S., Bahri, S., & Fauzi, A. (2023). Does mobile instant messaging (MIM) affect power redistribution? Evidence from a Malaysian school management organization. Social Sciences and Humanities Open, 7(1). https://doi.org/10.1016/j.ssaho.2023.100495
  • Al Omar, K. H., Al-Momani, M. A., Al Kayed, M. M., & Smadi, S. M. (2024). The impact of WhatsApp groups on improving Jordanian university students’ vocabulary learning. Theory and Practice in Language Studies, 14(10), 3306-3311. https://doi.org/10.17507/tpls.1410.34
  • Aladsani, H. K. (2021). University students’ use and perceptions of Telegram to promote effective educational interactions: A qualitative study. International Journal of Emerging Technologies in Learning, 16(9), 182-197. https://doi.org/10.3991/ijet.v16i09.19281
  • Alamer, A., Al Khateeb, A., & Jeno, L. M. (2023). Using WhatsApp increases language students’ self-motivation and achievement, and decreases learning anxiety: A self-determination theory approach. Journal of Computer Assisted Learning, 39(2), 417-431. https://doi.org/10.1111/jcal.12753
  • Aldalbahi, S. S., & Albesher, A. S. (2023). Young Saudis’ evaluations and perceptions of privacy in digital communities: The case of WhatsApp and Telegram. Sustainability, 15(14), Article 11286. https://doi.org/10.3390/su151411286
  • Al-Mothana Gasaymeh, B. M., & Gasaymeh, A.-M. M. (2017). University students’ use of WhatsApp and their perceptions regarding its possible integration into their education. Global Journal of Computer Science and Technology: G Interdisciplinary, 17(1).
  • Andujar, A. (2016). Benefits of mobile instant messaging to develop ESL writing. System, 62, 63-76. https://doi.org/10.1016/j.system.2016.07.004
  • Anitha, D., & Kavitha, D. (2023). Improving problem-solving skills through technology assisted collaborative learning in a first year engineering mathematics course. Interactive Technology and Smart Education, 20(4), 534-553. https://doi.org/10.1108/ITSE-03-2022-0030
  • Annamalai, N., Mangaleswaran, S., Ab Rashid, R., Harb Alqaryouti, M., & Sadeq, A. E. (2024). Learner experiences of community of inquiry mode (CoI) in WhatsApp for English language learning. SAGE Open, 14(2). https://doi.org/10.1177/21582440241251944
  • Awada, G. (2016). Effect of WhatsApp on critique writing proficiency and perceptions toward learning. Cogent Education, 3(1), Article 1264173. https://doi.org/10.1080/2331186X.2016.1264173
  • Baishya, D., & Maheshwari, S. (2019). WhatsApp groups in academic context: Exploring the academic uses of WhatsApp groups among the students. Contemporary Educational Technology, 11(1), 31-46. https://doi.org/10.30935/cet.641765
  • Brown, T. A. (2015). Confirmatory factor analysis for applied research. Guilford Publications.
  • Cao, C., & Jia, W. (2024). International students’ social use of WeChat and sociocultural adjustment: Coping self-efficacy as a longitudinal mediator. Education and Information Technologies, 29(5), 5189-5209. https://doi.org/10.1007/s10639-023-12044-5
  • Ceci, L. (2024). Mobile messenger and communication apps–Statistics & facts. Statista. https://www.statista.com/topics/1523/mobile-messenger-apps/
  • Cetinkaya, L. (2017). The impact of WhatsApp use on success in education process. International Review of Research in Open and Distributed Learning, 18(7), 59-74. https://doi.org/10.19173/irrodl.v18i7.3279
  • Cheng, E. C. K., & Wang, T. (2022). Institutional strategies for cybersecurity in higher education institutions. Information, 13(4), Article 192. https://doi.org/10.3390/info13040192
  • Chung, S. J., & Choi, L. J. (2023). The use of mobile instant messaging in English language teaching: The case of South Korea. Education Sciences, 13(2), Article 110. https://doi.org/10.3390/educsci13020110
  • Clark, L. A., & Watson, D. (1995). Constructing validity: Basic issues in objective scale development. Psychological Assessment, 7(3), 309-319. https://doi.org/10.1037/1040-3590.7.3.309
  • Costa-Sánchez, C., & Guerrero-Pico, M. (2020). What is WhatsApp for? Developing transmedia skills and informal learning strategies through the use of WhatsApp—A case study with teenagers from Spain. Social Media and Society, 6(3). https://doi.org/10.1177/2056305120942886
  • Criollo-C, S., Guerrero-Arias, A., Jaramillo-Alcázar, Á., & Luján-Mora, S. (2021). Mobile learning technologies for education: Benefits and pending issues. Applied Sciences, 11(9), Article 4111. https://doi.org/10.3390/app11094111
  • DeVellis, R. F., & Thorpe, C. T. (2021). Scale development: Theory and applications (5th Ed.). SAGE.
  • Dou, A., Xu, W., & Xu, L. (2025). Interactive learning environments. International Journal of E-Collaboration, 21(1), 1-16. https://doi.org/10.4018/IJeC.369815
  • Enakrire, R. T., & Kehinde, F. J. (2022). WhatsApp application for teaching and learning in higher education institutions. Library Hi Tech News. https://doi.org/10.1108/LHTN-07-2022-0088
  • Gudmundsson, E. (2009). Guidelines for translating and adapting psychological instruments. Nordic Psychology, 61(2), 29-45. https://doi.org/10.1027/1901-2276.61.2.29
  • Gul, H., Firat, S., Sertcelik, M., Gul, A., Gurel, Y., & Kilic, B. (2021). Problematic WhatsApp use among adolescents: Linking fear of missing out and psychiatric symptoms. Psychiatry and Behavioral Sciences, 11(2), Article 1. https://doi.org/10.5455/PBS.20210509093936
  • Hidayat, A., Jamaluddin, D., Fauziah, K., Biruni, A., Bumi, K., & Bandung, P. (2021). WhatsApp as a collaborative tool for enhancement of students’ critical thinking: An analysis of environmental pollution learning material at a junior high school. International Journal of Computational Intelligence in Control, 13(2), 97-106.
  • Hinkin, T. R. (1998). A brief tutorial on the development of measures for use in survey questionnaires. Organizational Research Methods, 1(1), 104-121. https://doi.org/10.1177/109442819800100106
  • Huang, H. H., & Lin, C. N. (2023). Influencing factors of mobile instant messaging applications between single- and multi-platform use cases. Computer Standards and Interfaces, 83. https://doi.org/10.1016/j.csi.2022.103658
  • Huang, L., Wang, K., Li, S., & Guo, J. (2023). Using WeChat as an educational tool in MOOC-based flipped classroom: What can we learn from students’ learning experience? Frontiers in Psychology, 13. https://doi.org/10.3389/fpsyg.2022.1098585
  • Igbafe, E. C., & Ngozi Anyanwu, C. (2018). WhatsApp at tertiary education institutions in Nigeria: The dichotomy of academic disruption or academic performance enhancer? Africology: The Journal of Pan African Studies, 12(2), 179-205.
  • Imamyartha, D., Widiati, U., & Miftah, M. Z. (2024). The merits of mobile instant messaging for EFL learners: Learning engagement, achievement, and authentic relationships. Mextesol Journal, 48(1), 1-15. https://doi.org/10.61871/mj.v48n1-14
  • Imanuela, E. C., Angelia, A., & Purba, D. (2023). The effect of interpersonal communication via whatsapp on students’ socialization ability. APLIKATIF: Journal of Research Trends in Social Sciences and Humanities, 2(1), 29-36. https://doi.org/10.59110/aplikatif.v2i1.122
  • Iqbal, S., & Bhatti, Z. A. (2020). A qualitative exploration of teachers’ perspective on smartphones usage in higher education in developing countries. International Journal of Educational Technology in Higher Education, 17, Article 29. https://doi.org/10.1186/s41239-020-00203-4
  • Jia, C., & Hew, K. F. T. (2022). Supporting lower-level processes in EFL listening: The effect on learners’ listening proficiency of a dictation program supported by a mobile instant messaging app. Computer Assisted Language Learning, 35(1-2), 141-168. https://doi.org/10.1080/09588221.2019.1671462
  • Kaliisa, R., Palmer, E., & Miller, J. (2019). Mobile learning in higher education: A comparative analysis of developed and developing country contexts. British Journal of Educational Technology, 50(2), 546-561. https://doi.org/10.1111/bjet.12583
  • Kaminske, A., Brown, A., Aylward, A., & Haller, M. (2022). Cell phone notifications harm attention: An exploration of the factors that contribute to distraction. European Journal of Educational Research, 11(3), 1487-1494. https://doi.org/10.12973/eu-jer.11.3.1487
  • Kaysi, F. (2023). Mobile instant messaging application habits among university students. Interactive Learning Environments, 31(5), 3211-3229. https://doi.org/10.1080/10494820.2021.1922460
  • Kim, M., Kim, I., & Lee, U. (2021). Beneficial neglect: Instant message notification handling behaviors and academic performance. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 5(1), 1-26. https://doi.org/10.1145/3448089
  • Kim, S. Y., Park, H., Kim, H., Kim, J., & Seo, K. (2022). Technostress causes cognitive overload in high-stress people: Eye tracking analysis in a virtual kiosk test. Information Processing and Management, 59(6), Article 103093. https://doi.org/10.1016/j.ipm.2022.103093
  • Klein, A. Z., Da Silva Freitas Junior, J. C., Da Silva, J. V. V. M. M., Barbosa, J. L. V., & Baldasso, L. (2018). The educational affordances of mobile instant messaging (MIM): Results of Whatsapp® used in higher education. International Journal of Distance Education Technologies, 16(2), 51-64. https://doi.org/10.4018/IJDET.2018040104
  • Knaflic, C. N. (2015). Storytelling with data: A data visualization guide for business professionals. John Wiley & Sons. https://doi.org/10.1002/9781119055259
  • le Roux, D. B., & Parry, D. A. (2022). An exploratory investigation of the use and effects of academic instant messaging groups among university students. Education and Information Technologies, 27(1), 1055-1080. https://doi.org/10.1007/s10639-021-10631-y
  • Lee, C. E., Chern, H. H., & Azmir, D. A. (2023). WhatsApp use in a higher education learning environment: Perspective of students of a Malaysian private university on academic performance and team effectiveness. Education Sciences, 13(3), Article 244. https://doi.org/10.3390/educsci13030244
  • Mabaso, N., Tiba, C., Condy, J., & Meda, L. (2023). WhatsApp as an educational tool: Perspectives of pre-service teachers. Technology, Pedagogy and Education, 32(4), 521-536. https://doi.org/10.1080/1475939X.2023.2230230
  • Maphosa, V., Dube, B., & Jita, T. (2020). A UTAUT evaluation of WhatsApp as a tool for lecture delivery during the COVID-19 lockdown at a Zimbabwean university. International Journal of Higher Education, 9(5), 84-93. https://doi.org/10.5430/ijhe.v9n5p84
  • Masalimova, A. R., Zheltukhina, M. R., Sergeeva, O. V., Sokolova, N. L., Sizova, Z. M., & Kochneva, L. V. (2025). Mobile instant messaging applications in STEAM education: Scoping review. Online Journal of Communication and Media Technologies, 15(4), Article e202534. https://doi.org/10.30935/ojcmt/17425
  • Mellinger, C. D., & Hanson, T. A. (2020). Methodological considerations for survey research: Validity, reliability, and quantitative analysis. Linguistica Antverpiensia, New Series: Themes in Translation Studies, 19(19), 172-190. https://doi.org/10.52034/lanstts.v19i0.549
  • Merelo, J. J., Castillo, P. A., Mora, A. M., Barranco, F., Abbas, N., Guillén, A., & Tsivitanidou, O. (2024). Chatbots and messaging platforms in the classroom: An analysis from the teacher’s perspective. Education and Information Technologies, 29(2), 1903-1938. https://doi.org/10.1007/s10639-023-11703-x
  • Molina, O. E. (2022). The effects of WhatsApp and Telegram on student engagement: An analysis from the mixed-methods approach. Education Research International. https://doi.org/10.1155/2022/2881404
  • Motlhaka, H. (2021). Use of WhatsApp in higher education for teaching and learning: Sociocultural perspective of learning. Turkish Online Journal of Qualitative Inquiry, 12(7), 7249-7257.
  • Naidoo, J., & Kopung, K. J. (2016). Exploring the use of WhatsApp in mathematics learning: A case study. Journal of Communication, 7(2), 266-273.
  • Nyamupangedengu, E., Kazeni, M., Mandikonza, C., Stephen, M., Mabenge, P., Tshesane, H., Ajayi, E., Abdulhamid, L., Makonye, J., & Moloi, M. (2023). Mathematics and science teacher educators’ experiences of using the WhatsApp platform as a tool for supporting teaching during the COVID-19 pandemic. Journal of Education (University of KwaZulu-Natal), 92, 115-135. https://doi.org/10.17159/2520-9868/i92a07
  • Nylund, K. L., Asparouhov, T., & Muthén, B. O. (2007). Deciding on the number of classes in latent class analysis and growth mixture modeling: A Monte Carlo simulation study. Structural Equation Modeling: A Multidisciplinary Journal, 14(4), 535-569. https://doi.org/10.1080/10705510701575396
  • Pacholek, K., Prostean, M., Burris, S., Cockburn, L., Nganji, J., Nadège, A. N., & Mbibeh, L. (2023). A WhatsApp community forum for improving critical thinking and practice skills of mental health providers in a conflict zone. Interactive Learning Environments, 31(4), 2471-2489. https://doi.org/10.1080/10494820.2021.1890622
  • Pimmer, C., Brühlmann, F., Odetola, T. D., Oluwasola, D. O., Dipeolu, O., & Ajuwon, A. J. (2019). Facilitating professional mobile learning communities with instant messaging. Computers and Education, 128, 102-112. https://doi.org/10.1016/j.compedu.2018.09.005
  • Polit, D. F., & Beck, C. T. (2006). The content validity index: Are you sure you know what’s being reported? Critique and recommendations. Research in Nursing and Health, 29(5), 489-497. https://doi.org/10.1002/nur.20147
  • Rabotapi, T., & Matope, S. (2024). WhatsApp as a tool to facilitate continued adjustment of first time entering students into university during COVID-19 lockdown restrictions. Electronic Journal of E-Learning, 22(8), 1-11. https://doi.org/10.34190/ejel.22.8.3405
  • Segal, R., & Biton, Y. (2024). Teaching and learning high-school mathematics via WhatsApp: Teachers’ perspectives. Learning Environments Research, 27, 863-891. https://doi.org/10.1007/s10984-024-09508-x
  • Shirkhani, S., & Poorhadian, F. (2024). The effects of massive open online courses and mobile instant messaging on EFL learners’ reading comprehension: A comparative study. Journal of Research in Techno-based Language Education, 4(2).
  • Snyder, H. (2019). Literature review as a research methodology: An overview and guidelines. Journal of Business Research, 104, 333-339. https://doi.org/10.1016/j.jbusres.2019.07.039
  • So, S. (2016). Mobile instant messaging support for teaching and learning in higher education. Internet and Higher Education, 31, 32-42. https://doi.org/10.1016/j.iheduc.2016.06.001
  • Soon, M. K. S., Martinengo, L., Lu, J., Car, L. T., & Chia, C. L. K. (2022). The use of Telegram in surgical education: Exploratory study. JMIR Medical Education, 8(3), Article e35983. https://doi.org/10.2196/35983
  • Suárez-Lantarón, B., Deocano-Ruíz, Y., García-Perales, N., & Castillo-Reche, I. S. (2022). The educational use of WhatsApp. Sustainability, 14(17), Article 10510. https://doi.org/10.3390/su141710510
  • Swartz, B. C., Valentine, L. Z., & Jaftha, D. V. (2022). Participatory parity through teaching with Telegram. Perspectives in Education, 40(1), 96-111. https://doi.org/10.18820/2519593X/PIE.V40.I1.6
  • Tang, Y., & Hew, K. F. (2017). Is mobile instant messaging (MIM) useful in education? Examining its technological, pedagogical, and social affordances. Educational Research Review, 21, 85-104. https://doi.org/10.1016/j.edurev.2017.05.001
  • Tang, Y., & Hew, K. F. (2020). Does mobile instant messaging facilitate social presence in online communication? A two-stage study of higher education students. International Journal of Educational Technology in Higher Education, 17, Article 15. https://doi.org/10.1186/s41239-020-00188-0
  • Tang, Y., & Hew, K. F. (2022). Effects of using mobile instant messaging on student behavioral, emotional, and cognitive engagement: A quasi-experimental study. International Journal of Educational Technology in Higher Education, 19, Article 3. https://doi.org/10.1186/s41239-021-00306-6
  • Tawiah, Y. S. (2014). Usage of WhatsApp and voice calls (phone call): Preference of polytechnic students in Ghana. Science Journal of Business and Management, 2(4), Article 103. https://doi.org/10.11648/j.sjbm.20140204.11
  • Upshaw, J. D., Stevens, C. E., Ganis, G., & Zabelina, D. L. (2022). The hidden cost of a smartphone: The effects of smartphone notifications on cognitive control from a behavioral and electrophysiological perspective. PLoS ONE, 17(11), Article e0277220. https://doi.org/10.1371/journal.pone.0277220
  • Van Teijlingen, E., & Hundley, V. (2001). The importance of pilot studies. Social Research Update, 35, 1-4.
  • Venturino, M., & Hsu, Y. C. (2022). Using WhatsApp to enhance international distance education at the University of South Africa. TechTrends, 66(3), 401-404. https://doi.org/10.1007/s11528-022-00718-9
  • Williams, B., Onsman, A., & Brown, T. (2010). Exploratory factor analysis: A five-step guide for novices. Australasian Journal of Paramedicine, 8, 1-13. https://doi.org/10.33151/ajp.8.3.93
  • Xia, L., Wang, L., & Huang, C. (2024). Implementing a social presence-based teaching strategy in online lecture learning. European Journal of Investigation in Health, Psychology and Education, 14(9), 2580-2597. https://doi.org/10.3390/ejihpe14090170
  • Xia, M., & Liu, J. (2023). Does WeChat use intensity influence Chinese college students’ mental health through social use of WeChat, entertainment use of WeChat, and bonding social capital? Frontiers in Public Health, 11. https://doi.org/10.3389/fpubh.2023.1167172
  • Yang, X. (2024). Mobile learning application characteristics and learners’ continuance intentions: The role of flow experience. Education and Information Technologies, 29(2), 2259-2275. https://doi.org/10.1007/s10639-023-11910-6
  • Yusoff, M. S. B. (2019). ABC of content validation and content validity index calculation. Education in Medicine Journal, 11(2), 49-54. https://doi.org/10.21315/eimj2019.11.2.6
  • Zahra, S., Babar, Z.-U.-D., & Ali, S. W. (2022). Learning goes digital: Impact of WhatsApp discussion groups on academic performance of university students in Lahore. Global Social Sciences Review, VII(I), 59-69. https://doi.org/10.31703/gssr.2022(vii-i).07
  • Zhao, Z., Wang, X., Ismail, S. M., Hasan, M. K., & Hashemifardnia, A. (2022). Social media and academic success: Impacts of using telegram on foreign language motivation, foreign language anxiety, and attitude toward learning among EFL learners. Frontiers in Psychology, 13. https://doi.org/10.3389/fpsyg.2022.996577