Pen Academic Publishing
Journals • Publish with us • Publishing partnership • About Us • Türkçe
Research article | Open Access
Journal of Technology Applications in Education 2026, Vol 7(1) 1-25

Artificial Intelligence Mentorship Perception Scale for Preservice Teachers: Development and Preliminary Psychometric Evidence

İsmail Satmaz
Cite this article
Article Type
Research article
Publication Date
July 08, 2026
Pages
1-25
DOI
10.29329/jtae.2026.1432.5

Abstract

The integration of artificial intelligence (AI) into education has expanded mentoring practices toward technology-supported guidance systems. Although prior studies have examined AI acceptance, attitudes toward AI, and AI literacy, limited research has focused on AI-based mentorship as a perceived source of pedagogical and developmental support. This study aimed to develop the Artificial Intelligence Mentorship Perception Scale and provide initial psychometric evidence regarding its use with preservice teachers. A scale development design was employed. The process included construct definition, item pool generation, expert review, pilot testing, exploratory factor analysis (EFA), confirmatory factor analysis (CFA), item discrimination analysis, and reliability testing. The initial pool included 33 items based on mentoring, e-mentoring, AI-supported learning, and teacher education literature. Following expert evaluation and pilot testing, the form was reduced to 18 items. The EFA sample included 233 preservice teachers, and the CFA sample included 240 preservice teachers. EFA suggested a four-factor structure explaining 65.12% of the variance: Pedagogical Planning, Performance Evaluation, Academic Guidance, and Professional Development. During CFA, one item was removed, and the revised 17-item model showed acceptable but not optimal fit. Reliability coefficients ranged from .79 to .91 across subdimensions and .955 for the overall scale. The findings provide preliminary psychometric evidence for the scale within a Turkish preservice teacher sample.

Keywords: Artificial Intelligence AI-Based Mentorship Preservice Teachers Scale Development Psychometric Validation
Cite this article
Satmaz, İ. (2026). Artificial Intelligence Mentorship Perception Scale for Preservice Teachers: Development and Preliminary Psychometric Evidence. Journal of Technology Applications in Education, 7(1), 1-25. https://doi.org/10.29329/jtae.2026.1432.5

  • Allen, T. D., Eby, L. T., Poteet, M. L., Lentz, E., & Lima, L. (2004). Career benefits associated with mentoring for protégés: A meta-analysis. Journal of Applied Psychology, 89(1), 127–136. https://doi.org/10.1037/0021-9010.89.1.127 [Google Scholar] [Crossref] 
  • Bagai, R., & Mane, V. (2023). Designing an AI-powered mentorship platform for professional development: Opportunities and challenges. International Journal of Computer Trends and Technology, 71(4), 108-114. https://doi.org/10.14445/22312803/IJCTT-V71I4P114 [Google Scholar] [Crossref] 
  • Bandura, A. (1977). Social learning theory. Prentice Hall. [Google Scholar]
  • Barakat, M., Salim, N. A., & Sallam, M. (2025). University educators perspectives on ChatGPT: A Technology Acceptance Model-based study. Open Praxis, 17(1), 129–144. https://doi.org/10.55982/openpraxis.17.1.718 [Google Scholar] [Crossref] 
  • Boateng, G. O., Neilands, T. B., Frongillo, E. A., Melgar-Quiñonez, H. R., & Young, S. L. (2018). Best practices for developing and validating scales for health, social, and behavioral research: A primer. Frontiers in Public Health, 6, 149. https://doi.org/10.3389/fpubh.2018.00149 [Google Scholar] [Crossref] 
  • Büyüköztürk, Ş. (2020). Sosyal bilimler için veri analizi el kitabı [The data analysis handbook for social sciences] (28th ed.). Pegem Akademi. [Google Scholar]
  • Calp, R., Mukba, G., & Şata, M. (2025). Preservice teachers’ attitudes toward artificial intelligence: A scale development study. Journal of University Research, 8(4), 608–621. https://doi.org/10.32329/uad.1740270 [Google Scholar] [Crossref] 
  • Chen, Y., Watson, R., & Hilton, A. (2016). A review of mentorship measurement tools. Nurse Education Today, 40, 20-28. https://doi.org/10.1016/j.nedt.2016.01.020 [Google Scholar] [Crossref] 
  • Choudhary, P., Ali, I., Rehman, K., Sharma, K., Sharma, K., Borasi, M., & Bhargava, P. (2024). Enhancing mentorship through technology: A comprehensive review of current practices and future directions. International Journal of Multidisciplinary Research and Growth Evaluation, 5(6), 634-645. [Google Scholar]
  • Davis, F. D. (1989). Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly, 13(3), 319–340. https://doi.org/10.2307/249008 [Google Scholar] [Crossref] 
  • DeVellis, R. F. (2016). Scale development: Theory and applications (4th ed.). Sage Publications. [Google Scholar]
  • Eby, L. T., Allen, T. D., Evans, S. C., Ng, T., & DuBois, D. L. (2013). Does mentoring matter? A multidisciplinary meta-analysis comparing mentored and non-mentored individuals. Journal of Vocational Behavior, 72(2), 254–267. https://doi.org/10.1016/j.jvb.2007.04.005 [Google Scholar] [Crossref] 
  • Ensher, E. A., Heun, C., & Blanchard, A. (2003). Online mentoring and computer‐mediated communication: New directions in research. Journal of Vocational Behavior, 63(2), 264–288. https://doi.org/10.1016/S0001-8791(03)00044-7 [Google Scholar] [Crossref] 
  • Fornell, C., & Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39–50. https://doi.org/10.1177/002224378101800104 [Google Scholar] [Crossref] 
  • George, D., & Mallery, P. (2010). SPSS for Windows step by step: A simple guide and reference (10th ed.). Pearson. [Google Scholar]
  • Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2014). Multivariate data analysis (7th ed.). Pearson. [Google Scholar]
  • Holmes, W., Bialik, M., & Fadel, C. (2019). Artificial intelligence in education: Promises and implications for teaching and learning. Center for Curriculum Redesign. [Google Scholar]
  • Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1–55. https://doi.org/10.1080/10705519909540118 [Google Scholar] [Crossref] 
  • Kline, R. B. (2016). Principles and practice of structural equation modeling (4th ed.). Guilford Press. [Google Scholar]
  • Kram, K. E. (1983). Phases of the mentor relationship. Academy of Management Journal, 26(4), 608-625. [Google Scholar]
  • Laupichler, M. C., Aster, A., Haverkamp, N., & Raupach, T. (2023). Development of the “Scale for the assessment of non-experts’ AI literacy”–An exploratory factor analysis. Computers in Human Behavior Reports, 12, 100338. [Google Scholar]
  • Lawani, A. S. (2025). Assessing the efficacy of traditional mentoring in the era of artificial intelligence (AI) and technology. Unizik Journal of Educational Research and Policy Studies, 19(4), 327-341. [Google Scholar]
  • Lee, J., & Esposito, A. G. (2025). Evaluating generative AI as a mentor resource: Bias and implementation challenges. Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics, 126-132. [Google Scholar]
  • Ma, W., Adesope, O. O., Nesbit, J. C., & Liu, Q. (2014). Intelligent tutoring systems and learning outcomes: A meta-analysis. Journal of Educational Psychology, 106(4), 901–918. https://doi.org/10.1037/a0037123 [Google Scholar] [Crossref] 
  • Miao, F., & Holmes, W. (2023). Guidance for generative AI in education and research. UNESCO. [Google Scholar]
  • Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory (3rd ed.). McGraw-Hill. [Google Scholar]
  • Patel, K. M., Diddi, S. M., & Bogam, N. B. (2024). The next generation of learning: AI mentorship for a transformative educational experience. International Journal of Advanced Research in Science, Communication and Technology, 4(3), 464-467. https://doi.org/10.48175/IJARSCT-19969 [Google Scholar] [Crossref] 
  • Qadir, J., Attique, M. A., Shoaib, S., & Ghaznavi, S. I. (2024). Can AI chatbots provide coaching in engineering? Beyond information processing toward mastery. Proceedings of EDULEARN24, 8418-8428. [Google Scholar]
  • Russell, S., & Norvig, P. (2021). Artificial intelligence: A modern approach (4th ed.). Pearson. [Google Scholar]
  • Single, P. B., & Single, R. M. (2005). E-mentoring for social equity: Review of research to inform program development. Mentoring & Tutoring: Partnership in Learning, 13(2), 301-320. [Google Scholar]
  • Tenberga, I., & Daniela, L. (2024). Artificial intelligence literacy competencies for teachers through self-assessment tools. Sustainability, 16(23), 10386. https://doi.org/10.3390/su162310386 [Google Scholar] [Crossref]