Analisis Deskriptif Komparatif Pemanfaatan ChatGPT, Kualitas Pemahaman, dan Efisiensi Tugas Berdasarkan Status Kerja Mahasiswa


  • Jonathan Wijaya * Mail Universitas Universal, Batam, Indonesia
  • R Widya Henisaputri Universitas Universal, Batam, Indonesia
  • (*) Corresponding Author
Keywords: ChatGPT; Generative Artificial Intelligence; Quality Of Understanding; Task Efficiency; Student Employment Status

Abstract

The use of ChatGPT in academic activities may be perceived differently in relation to students’ understanding and task efficiency. Differences in academic demands between working and non-working students may also lead to different patterns of use. This study aimed to describe ChatGPT Utilization, Quality of Understanding, and Task Efficiency, compare the three constructs according to student employment status, and compare Quality of Understanding and Task Efficiency within the same respondents. A quantitative descriptive-comparative design was employed. Data were collected from 101 Universitas Universal students selected through purposive sampling using a four-point Likert-scale questionnaire. Instrument evaluation resulted in 26 final items across three constructs, with Cronbach’s Alpha values ranging from 0.787 to 0.913. The Mann–Whitney U test indicated no significant differences between working and non-working students in ChatGPT Utilization (p=0.923), Quality of Understanding (p=0.244), or Task Efficiency (p=0.079). The Wilcoxon Signed-Rank Test showed that the mean item score for Task Efficiency was higher than that for Quality of Understanding, at 3.260 and 3.000, respectively (Z=−5.779; p<0.001; r=0.593). Based on respondents’ perceptions, ChatGPT use was more prominent in supporting practical and efficient task completion than in the quality of understanding, while student employment status did not produce meaningful differences across the three constructs. This study contributes empirical evidence by distinguishing utilization, understanding, and efficiency as separate aspects and provides a practical basis for higher education institutions to guide ChatGPT use while maintaining information verification and students’ understanding processes.

Downloads

Download data is not yet available.

References

Eka Finanti Simamora, Imel Simanungkalit, Prihatin Ningsih Sagala, Nurcahaya Br Zandroto, Putri Br Tarigan, and Rival Ananda Gisty, “Efektivitas Peran ChatGPT Sebagai Alat Bantu Penyelesaian Tugas Akademik Mahasiswa,” Algoritma : Jurnal Matematika, Ilmu pengetahuan Alam, Kebumian dan Angkasa, vol. 3, no. 2, pp. 74–85, Mar. 2025, doi: 10.62383/algoritma.v3i2.445.

J. Li, K. Yin, Y. Wang, X. Jiang, and D. Chen, “Effectiveness of generative artificial intelligence-based teaching versus traditional teaching methods in medical education: a meta-analysis of randomized controlled trials,” BMC Med. Educ., vol. 25, no. 1, Dec. 2025, doi: 10.1186/s12909-025-07750-2.

M. Hakiki et al., “Exploring the impact of using Chat-GPT on student learning outcomes in technology learning: The comprehensive experiment,” Advances in Mobile Learning Educational Research, vol. 3, no. 2, pp. 859–872, Oct. 2023, doi: 10.25082/amler.2023.02.013.

R. Deng, M. Jiang, X. Yu, Y. Lu, and S. Liu, “Does ChatGPT enhance student learning? A systematic review and meta-analysis of experimental studies,” Comput. Educ., vol. 227, Apr. 2025, doi: 10.1016/j.compedu.2024.105224.

K. Angelina Tompunu et al., “ChatGPT Sebagai Alat Bantu Pencarian Referensi: Analisis Penggunaan oleh Mahasiswa Sistem Informasi UNSRI dalam Menyusun Tugas Akhir,” 2025. doi: 10.36040/jati.v9i4.14062.

A. Azizi, R. Joko Musridho, S. Wiruddin, and E. Dwi Mustika, “Pengaruh Penggunaan ChatGPT Terhadap Efektivitas Pembelajaran Mahasiswa Teknik Informatika di Universitas Pahlawan Tuanku Tambusai,” Journal on Pustaka Cendekia Informatika, vol. 2, no. 1, pp. 22–27, 2024, doi: 10.70292/pctif.v2i1.61.

Muhammad Tarmizi and Y. Yahfizham, “Perspektif Mahasiswa Terhadap Penggunaan Kecerdasan Buatan ChatGPT dalam Penyusunan Tugas Akhir,” Indiktika : Jurnal Inovasi Pendidikan Matematika, vol. 6, no. 2, pp. 151–161, Jun. 2024, doi: 10.31851/indiktika.v6i2.15425.

P. Kusumaningtyas, A. P. Arrumi, and dan S. Keren Tiurma Eunike, “Efektivitas Pemanfaatan ChatGPT dalam Tugas Esai Mahasiswa Ilmu Komunikasi Universitas Negeri Surabaya,” Prosiding Seminar Nasional Ilmu-Ilmu Sosial (SNIIS), vol. 2, pp. 158–165, 2023, Accessed: Jun. 19, 2026. [Online]. Available: https://proceeding.unesa.ac.id/index.php/sniis/article/view/794/266

I. M. Castillo-Martínez, D. Flores-Bueno, S. M. Gómez-Puente, and V. O. Vite-León, “AI in higher education: a systematic literature review,” 2024, Frontiers in Education. doi: 10.3389/feduc.2024.1391485.

S. Bećirović, E. Polz, and I. Tinkel, “Exploring students’ AI literacy and its effects on their AI output quality, self-efficacy, and academic performance,” Smart Learning Environments, vol. 12, no. 1, Dec. 2025, doi: 10.1186/s40561-025-00384-3.

A. B. Bakker and K. Mostert, “Study Demands–Resources Theory: Understanding Student Well-Being in Higher Education,” Sep. 01, 2024, Springer. doi: 10.1007/s10648-024-09940-8.

L. Eastgate, P. A. Creed, M. Hood, and A. Bialocerkowski, “It Takes Work: How University Students Manage Role Boundaries when the Future is Calling,” Res. High. Educ., vol. 64, no. 7, pp. 1071–1088, Nov. 2023, doi: 10.1007/s11162-023-09736-9.

E. E. Pérez-Guerrero et al., “Methodological and Statistical Considerations for Cross-Sectional, Case–Control, and Cohort Studies,” Jul. 01, 2024, Multidisciplinary Digital Publishing Institute (MDPI). doi: 10.3390/jcm13144005.

D. Rutkowski, L. Rutkowski, G. Thompson, and Y. Canbolat, “The limits of inference: reassessing causality in international assessments,” Large. Scale. Assess. Educ., vol. 12, no. 1, Dec. 2024, doi: 10.1186/s40536-024-00197-9.

L. Widiarti, Sahiruddin, and M. A. Kasri, “Efektivitas ChatGPT sebagai Asisten Virtual untuk Mendukung Produktivitas Akademik Mahasiswa Pendidikan Teknologi Informasi,” Decode: Jurnal Pendidikan Teknologi Informasi, vol. 5, no. 3, pp. 1218–1224, Nov. 2025, doi: 10.51454/decode.v5i3.1464.

C. Andrade, “The Inconvenient Truth About Convenience and Purposive Samples,” Indian J. Psychol. Med., vol. 43, no. 1, pp. 86–88, Jan. 2021, doi: 10.1177/0253717620977000.

A. A. Syanzani, N. Azrina, and V. Fitriani, “Analisis Keefektifan ChatGPT dalam Membantu Proses Belajar pada Mahasiswa STMIK Antar Bangsa,” 2024, doi: 10.51998/jti.v10i2.580.

M. Kankaraš and S. Capecchi, “Neither agree nor disagree: use and misuse of the neutral response category in Likert-type scales,” Metron, vol. 83, no. 1, pp. 111–140, Apr. 2025, doi: 10.1007/s40300-024-00276-5.

C. P. Klapproth, F. Fischer, and M. Rose, “Scale agreement, ceiling and floor effects, construct validity, and relative efficiency of the PROPr and EQ-5D-3L in low back pain patients,” Health Qual. Life Outcomes, vol. 21, no. 1, Dec. 2023, doi: 10.1186/s12955-023-02188-w.

D. Goretzko and M. Bühner, “Robustness of factor solutions in exploratory factor analysis,” Behaviormetrika, vol. 49, no. 1, pp. 131–148, Jan. 2022, doi: 10.1007/s41237-021-00152-w.

Z. Zeng, G. Xie, Y. He, and S. Zhou, “Exploring psychological pathways between workplace violence and burnout among nurses in Chinese Tertiary Hospitals,” Sci. Rep., vol. 15, no. 1, Dec. 2025, doi: 10.1038/s41598-025-19671-7.

B. Struminskaya and T. Gummer, “Risk of Nonresponse Bias and the Length of the Field Period in a Mixed-Mode General Population Panel,” J. Surv. Stat. Methodol., vol. 10, no. 1, pp. 161–182, Feb. 2022, doi: 10.1093/jssam/smab011.

G. W. Cheung, H. D. Cooper-Thomas, R. S. Lau, and L. C. Wang, “Reporting reliability, convergent and discriminant validity with structural equation modeling: A review and best-practice recommendations,” Asia Pacific Journal of Management, vol. 41, no. 2, pp. 745–783, Jun. 2024, doi: 10.1007/s10490-023-09871-y.

F. Fiel Peres, “Effect sizes for nonparametric tests,” Feb. 15, 2026. doi: 10.11613/BM.2026.010101.

K. Nurumov, D. Hernández-Torrano, A. Ait Si Mhamed, and U. Ospanova, “Measuring Social Desirability in Collectivist Countries: A Psychometric Study in a Representative Sample From Kazakhstan,” Front. Psychol., vol. 13, Apr. 2022, doi: 10.3389/fpsyg.2022.822931.


Bila bermanfaat silahkan share artikel ini

Berikan Komentar Anda terhadap artikel Analisis Deskriptif Komparatif Pemanfaatan ChatGPT, Kualitas Pemahaman, dan Efisiensi Tugas Berdasarkan Status Kerja Mahasiswa

Dimensions Badge
Article History
Submitted: 2026-06-10
Published: 2026-07-05
Abstract View: 0 times
How to Cite
Wijaya, J., & Henisaputri, R. (2026). Analisis Deskriptif Komparatif Pemanfaatan ChatGPT, Kualitas Pemahaman, dan Efisiensi Tugas Berdasarkan Status Kerja Mahasiswa. Journal of Information System Research (JOSH), 7(4). https://doi.org/10.47065/josh.v7i4.10241
Section
Articles