Psychometric properties of information and communication technology competencies scale: Latent profile analysis

Sergei P. Zhdanov 1, Lilia M. Sadrieva 2, Igor A. Astakhov 3, Natalia L. Sokolova 4, Elena E. Grishnova 5, Larisa I. Tararina 6 7 *
More Detail
1 Plekhanov Russian University of Economics, Moscow, RUSSIA
2 Almetyevsk State Oil Institute, Almetyevsk, RUSSIA
3 Department of Pedagogy, MGIMO University, Moscow, RUSSIA
4 Peoples’ Friendship University of Russia (RUDN University), Moscow, RUSSIA
5 Bauman Moscow State Technical University, Moscow, RUSSIA
6 Moscow Institute of Physics and Technology, Moscow, RUSSIA
7 Russian State Social University, Moscow, RUSSIA
* Corresponding Author
Online Journal of Communication and Media Technologies, Volume 13, Issue 4, Article No: e202345. https://doi.org/10.30935/ojcmt/13479
OPEN ACCESS   1046 Views   810 Downloads   Published online: 14 Jul 2023
Download Full Text (PDF)

ABSTRACT

Rapid expansion of information and communication technologies (ICT) underscores importance of ICT competency for success in modern society. In education, ICT facilitates knowledge acquisition, innovative teaching methods, and development of digital literacy skills. By measuring ICT competencies, teacher training programs can better equip educators for technology integration, leading to more effective teaching and learning processes. It is crucial for educational policies to emphasize integration of ICT and ensure teachers are prepared to utilize it effectively. The study aims to determine psychometric properties of “information and communication technology competency scale (ICTCS)” for pre-service teachers (PSTs) in the Russian setting and identify distinct proficiency levels among them. This study employed a mixed-methods approach to adapt a scale measuring PSTs’ ICT competencies. The research involved two different samples for exploratory factor analysis (EFA) (n=160) and confirmatory factor analysis (CFA) (n=326). To establish language validity, a translation, and cross-cultural adaptation process was followed. Data analysis included EFA, CFA, reliability estimation, and latent profile analysis, with satisfactory results obtained for scale’s psychometric properties. The study concludes that ICTCS, with two factors (ICTC-PU and ICTC-ID), is a valid and reliable measure of teachers’ attitudes and skills regarding ICT use. Four-class latent profile model reveals distinct competence levels, informing targeted professional development programs. Educational institutions and policymakers should prioritize these programs and use the scale for teacher evaluations. Future research should explore the efficacy of these programs, expand the sample size, incorporate objective measures, and employ longitudinal designs to better understand the impact on student outcomes.
Keywords: adaptation of ICTCS, latent profile analysis, pre-service teachers’ ICT competence

CITATION

Zhdanov, S. P., Sadrieva, L. M., Astakhov, I. A., Sokolova, N. L., Grishnova, E. E., & Tararina, L. I. (2023). Psychometric properties of information and communication technology competencies scale: Latent profile analysis. Online Journal of Communication and Media Technologies, 13(4), e202345. https://doi.org/10.30935/ojcmt/13479

REFERENCES

  • Abbasova, L. I., Zotova, I. V., & Mustafaeva, Z. I. (2021). The technology of formation of future teachers’ information culture. SHS Web of Conferences, 113, 00051. https://doi.org/10.1051/shsconf/202111300051
  • Adam, F., & Ray, G. (2020). The role of information and communication technology (ICT) in enhancing the innovative learning process. IAIC Transactions on Sustainable Digital Innovation, 2(1), 54-60. https://doi.org/10.34306/itsdi.v2i1.352
  • Aesaert, K., Van Nijlen, D., Vanderlinde, R., & Van Braak, J. (2014). Direct measures of digital information processing and communication skills in primary education: Using item response theory for the development and validation of an ICT competence scale. Computers and Education, 76, 168-181. https://doi.org/10.1016/j.compedu.2014.03.013
  • Agasisti, T., Gil-Izquierdo, M., & Han, S. W. (2020). ICT Use at home for school-related tasks: What is the effect on a student’s achievement? Empirical evidence from OECD PISA data. Education Economics, 28(6), 601-620. https://doi.org/10.1080/09645292.2020.1822787
  • Aliaga-Tovar, J., Ponce-Díaz, C., & Salas-Blas, E. (2018). Psychometric analysis of the self-efficacy inventory for multiple intelligences-revised (SIMI-R) in Peruvian high school students. Propósitos y Representaciones [Purposes and Representations], 6, 95-124. https://doi.org/10.20511/pyr2018.v6n2.249
  • Alkan, M. F., & Emmioglu Sarikaya, E. (2018). Adaptation of preservice teachers’ information and communication technology competencies scale into Turkish culture. Bartın Üniversitesi Eğitim Fakültesi Dergisi, 7(2), 665-691. https://doi.org/10.14686/buefad.375745
  • Arushanyan, Y., Ekener-Petersen, E., Moberg, Å., & C. Coroama, V. (2015). A framework for sustainability assessment of ICT futures. Scenarios and sustainability impacts of future ICT-societies. In Proceedings of EnviroInfo and ICT for Sustainability 2015 (pp. 1-9). https://doi.org/10.2991/ict4s-env-15.2015.1
  • Aslan, A., & Zhu, C. (2017). Investigating variables predicting Turkish pre-service teachers’ integration of ICT into teaching practices. British Journal of Educational Technology, 48(2), 552-570. https://doi.org/10.1111/bjet.12437
  • Baez Zarabanda, D. E. (2019). ICT and its purpose in the pedagogical practice. Research in Social Sciences and Technology, 4(2), 83-95. https://doi.org/10.46303/ressat.04.02.6
  • Bauer, J. (2022). A Primer to latent profile and latent class analysis. In M. Goller, E. Kyndt, S. Paloniemi, & C. Damşa (Eds.), Professional and practice-based learning (pp. 243-268). Springer. https://doi.org/10.1007/978-3-031-08518-5_11
  • Beaton, D. E., Bombardier, C., Guillemin, F., & Ferraz, M. B. (2000). Guidelines for the process of cross-cultural adaptation of self-report measures. Spine, 25(4), 3186-3191. https://doi.org/10.1097/00007632-200012150-00014
  • Braslauskienė, R., Šmitienė, G., & Vismantienė, R. (2017). Primary school teachers’ approach to advantages of ICT use in education. Society Integration Education. Proceedings of the International Scientific Conference, 3, 439. https://doi.org/10.17770/sie2017vol3.2241
  • Brown, T. A. (2015). Confirmatory factor analysis for applied research. Guilford Press.
  • Chen, F., Gorbunova, N. V., Masalimova, A. R., & Bírová, J. (2017). Formation of ICT-competence of future university schoolteachers. EURASIA Journal of Mathematics, Science and Technology Education, 13(8), 4765-4777. https://doi.org/10.12973/eurasia.2017.00963a
  • Churchill, N. (2020). Development of students’ digital literacy skills through digital storytelling with mobile devices. Educational Media International, 57(3), 271-284. https://doi.org/10.1080/09523987.2020.1833680
  • García-Martín, J., & García-Sánchez, J. N. (2017). Pre-service teachers’ perceptions of the competence dimensions of digital literacy and of psychological and educational measures. Computers and Education, 107, 54-67. https://doi.org/10.1016/j.compedu.2016.12.010
  • Gómez-Trigueros, I. M., Ruiz-Bañuls, M., & Ortega-Sánchez, D. (2019). Digital literacy of teachers in training: Moving from ICTS (information and communication technologies) to LKTS (learning and knowledge technologies). Education Sciences, 9(4), 274. https://doi.org/10.3390/educsci9040274
  • Guillén-Gámez, F. D., Lugones, A., Mayorga-Fernández, M. J., & Wang, S. (2019). ICT use by pre-service foreign languages teachers according to gender, age, and motivation. Cogent Education, 6(1), 1-17. https://doi.org/10.1080/2331186X.2019.1574693
  • Gulavani, U. T., & Joshi, M. (2012). ICT in higher education: Review of literature from the period 2004-2011. International Journal of Innovation, Management and Technology, 3(1), 20-23.
  • Gunduz, S. (2020). Investigation of the relationship between pre-service teachers’ perceptions of education and support for ICT and ICT competencies. Malaysian Online Journal of Educational Technology, 8(2), 28-42. https://doi.org/10.17220/mojet.2020.02.003
  • Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2010). Multivariate data analysis. Pearson.
  • Harrington, D. (2009). Confirmatory factor analysis (pocket guides to social work). Oxford University Press. https://doi.org/10.1093/acprof:oso/9780195339888.003.0004
  • Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1-55. https://doi.org/10.1080/10705519909540118
  • Huda, I., Yulisman, H., Evtia Nurina, C. I., Erni, F., & Abdullah, D. (2018). Investigating pre-service teachers about their competencies, experiences, and attitudes towards technology integration. Journal of Physics: Conference Series, 1114, 012033. https://doi.org/10.1088/1742-6596/1114/1/012033
  • Istenic Starcic, A., & Bagon, S. (2014). ICT-supported learning for inclusion of people with special needs: Review of seven educational technology journals, 1970-2011. British Journal of Educational Technology, 45(2), 202-230. https://doi.org/10.1111/bjet.12086
  • Jackson, D. L., Gillaspy, J. A., & Purc-Stephenson, R. (2009). Reporting practices in confirmatory factor analysis: An overview and some recommendations. Psychological Methods, 14(1), 6-23. https://doi.org/10.1037/a0014694
  • Jedrinović, S., Ferk Savec, V., & Rugelj, J. (2019). Innovative and flexible approaches to teaching and learning with ICT. In T. Väljataga, & M. Laanpere (Eds.), Digital turn in schools–Research, policy, practice (pp. 171-186). Springer. https://doi.org/10.1007/978-981-13-7361-9_12
  • Kline, R. B. (2016). Principles and practice of structural equation modeling. Canadian Graduate Journal of Sociology and Criminology, 1(1), 305. https://doi.org/10.15353/cgjsc-rcessc.v1i1.25
  • Mallidis-Malessas, P., Iatraki, G., & Mikropoulos, T. A. (2022). Teaching physics to students with intellectual disabilities using digital learning objects. Journal of Special Education Technology, 37(4), 510-522. https://doi.org/10.1177/01626434211054441
  • Matviyevskaya, E. G., Tavstukha, O. G., Galustyan, O. V., Ignatov, P. A., & Miroshnikova, D. V. (2019). Formation of information and communication competence of future teachers. International Journal of Emerging Technologies in Learning, 14(19), 65-76. https://doi.org/10.3991/ijet.v14i19.10990
  • McGarr, O., & McDonagh, A. (2021). Exploring the digital competence of pre-service teachers on entry onto an initial teacher education program in Ireland. Irish Educational Studies, 40(1), 115-128. https://doi.org/10.1080/03323315.2020.1800501
  • Melander Bowden, H., & Svahn, J. (2020). Collaborative work on an online platform in video-mediated homework support. Social Interaction. Video-Based Studies of Human Sociality, 3(3). https://doi.org/10.7146/si.v3i3.122600
  • Ocampo-Botello, F., Vera-Hernández, G., & De Luna-Caballero, R. (2019). Pedagogical considerations of the curricular incorporation of ICT. Journal of Teaching and Educational Research, 5(15), 32-39. https://doi.org/10.35429/JTER.2019.15.5.32.39
  • Peeraer, J., & van Petegem, P. (2012). Information and communication technology in teacher education in Vietnam: From policy to practice. Educational Research for Policy and Practice, 11(2), 89-103. https://doi.org/10.1007/s10671-011-9106-9
  • Pozas, M., & Letzel, V. (2021). “Do you think you have what it takes?”–Exploring predictors of pre-service teachers’ prospective ICT use. Technology, Knowledge and Learning, 28(2), 823-841. https://doi.org/10.1007/s10758-021-09551-0
  • Schumacker, R. E., & Lomax, R. G. (2004). A beginner´s guide to structural equation modeling. Lawrence Erlbaum Associates. https://doi.org/10.4324/9781410610904
  • Siddiqui, S., Alam, M., Azmi, J., Ahmad, M., Wiquar, R., & Aziz, A. (2021). Integration of ICT-learning environments: a paradigm shift from traditional teaching pattern. In Proceedings of the 2nd International Conference on ICT for Digital, Smart, and Sustainable Development. https://doi.org/10.4108/eai.27-2-2020.2303238
  • Stavroulia, K. E., Christofi, M., Baka, E., Michael-Grigoriou, D., Magnenat-Thalmann, N., & Lanitis, A. (2019). Assessing the emotional impact of virtual reality-based teacher training. International Journal of Information and Learning Technology, 36(3), 192-217. https://doi.org/10.1108/IJILT-11-2018-0127
  • Thompson, B. (2004). Exploratory and confirmatory factor analysis: Understanding concepts and applications. American Psychological Association. https://doi.org/10.1037/10694-000
  • Thurm, D. (2018). Teacher beliefs and practice when teaching with technology: A latent profile analysis. In L. Ball, P. Drijvers, S. Ladel, H. Siller, M. Tabach, & C. Vale (Eds.), Uses of technology in primary and secondary mathematics education (pp. 409-419). Springer. https://doi.org/10.1007/978-3-319-76575-4_25
  • Tondeur, J., Aesaert, K., Prestridge, S., & Consuegra, E. (2018). A multilevel analysis of what matters in the training of pre-service teacher’s ICT competencies. Computers and Education, 122, 32-42. https://doi.org/10.1016/j.compedu.2018.03.002
  • Tondeur, J., Aesaert, K., Pynoo, B., Braak, J., Fraeyman, N., & Erstad, O. (2017). Developing a validated instrument to measure preservice teachers’ ICT competencies: Meeting the demands of the 21st century. British Journal of Educational Technology, 48(2), 462-472. https://doi.org/10.1111/bjet.12380
  • Tondeur, J., Van Braak, J., Siddiq, F., & Scherer, R. (2016). Time for a new approach to prepare future teachers for educational technology use: Its meaning and measurement. Computers and Education, 94, 134-150. https://doi.org/10.1016/j.compedu.2015.11.009
  • Tran, T., Phan, H. A., Le, H. Van, & Nguyen, H. T. (2020). ICT integration in developing competence for pre-service mathematics teachers: A case study from six universities in Vietnam. International Journal of Emerging Technologies in Learning, 15(14), 19-34. https://doi.org/10.3991/ijet.v15i14.14015
  • Uzun, A. M. (2019). Psychometric properties of the perceived ICT literacy scale among Turkish university students. International Online Journal of Education and Teaching, 6(3), 644-656.
  • Vasyura, S. A., Kuzmina, O. V., Maletova, M. I. (2020). Internet communications: Time phenomenon in online activity. Education and Self Development, 15(4), 71-79. https://doi.org/10.26907/esd15.4.03
  • Vilppola, J., Lämsä, J., Vähäsantanen, K., & Hämäläinen, R. (2022). Teacher trainees’ experiences of the components of ICT competencies and key factors in ICT competence development in work-based vocational teacher training in Finland. International Journal for Research in Vocational Education and Training, 9(2), 146-166. https://doi.org/10.13152/IJRVET.9.2.1
  • Wang, Z., Pang, H., Zhou, J., Ma, Y., & Wang, Z. (2021). “What if … it never ends?”: Examining challenges in primary teachers’ experience during the wholly online teaching. Journal of Educational Research, 114(1), 89-103. https://doi.org/10.1080/00220671.2021.1884823
  • Wild, D., Grove, A., Martin, M., Eremenco, S., McElroy, S., Verjee-Lorenz, A., & Erikson, P. (2005). Principles of good practice for the translation and cultural adaptation process for patient-reported outcomes (PRO) measures: Report of the ISPOR task force for translation and cultural adaptation. Value in Health, 8(2), 94-104. https://doi.org/10.1111/j.1524-4733.2005.04054.x
  • Williams, B., Onsman, A., & Brown, T. (2010). Exploratory factor analysis: A five-step guide for novices. Journal of Emergency Primary Health Care, 8(3), 1-13. https://doi.org/10.33151/ajp.8.3.93
  • Yong, A. G., & Pearce, S. (2013). A beginner’s guide to factor analysis: focusing on exploratory factor analysis. Tutorials in Quantitative Methods for Psychology, 9(2), 79-94. https://doi.org/10.20982/tqmp.09.2.p079
  • Zhang, X., Shinozuka, M., Tanaka, Y., Kanamori, Y., & Masui, T. (2022). How ICT can contribute to realize a sustainable society in the future: A CGE approach. Environment, Development and Sustainability, 24(4), 5614-5640. https://doi.org/10.1007/s10668-021-01674-9
  • Zheltukhina, M.R., Klushina, N.I., Vasilkova, N.N., Ponomarenko, E.B., & Dzyubenko, A.I. (2017). Modern media influence: Mass culture–mass consciousness–mass communication. Xlinguae, 10(4), 96-105. https://doi.org/10.18355/XL.2017.10.04.09