Kritik Prompt dan Validasi Output dalam Pelatihan Internal AI Generatif: Evaluasi Deskriptif bagi Pendidik SMA

Saefurrohman Saefurrohman(1), Jeffri Alfa Razaq(2*), Purwatiningtyas Purwatiningtyas(3), Felix Andreas Sutanto(4), Sulastri Sulastri(5),


(1) Universitas Stikubank (UNISBANK), Semarang, Indonesia
(2) Universitas Stikubank (UNISBANK), Semarang, Indonesia
(3) Universitas Stikubank (UNISBANK), Semarang, Indonesia
(4) Universitas Stikubank (UNISBANK), Semarang, Indonesia
(5) Universitas Stikubank (UNISBANK), Semarang, Indonesia
(*) Corresponding Author

Abstract


Pemanfaatan AI generatif oleh pendidik dan tenaga kependidikan belum selalu diikuti kemampuan menyusun instruksi terstruktur dan memeriksa keluaran sebelum digunakan. Kegiatan pengabdian ini mendeskripsikan in-house training bagi PTK SMA Negeri 1 Kota Mungkid yang menerapkan siklus Tulis-Kritisi-Revisi-Eksekusi-Validasi menggunakan ChatGPT akun gratis. Evaluasi program menggunakan kuesioner pascapelatihan, kategorisasi deskriptif respons terbuka, dokumentasi kegiatan, dan analisis ilustratif transformasi prompt pada praktik terbimbing. Analisis mencakup 38 respons dengan data lengkap pada 14 butir numerik dan persetujuan pelaporan anonim. Rerata butir berada pada rentang 4,368-4,684 dari skala 1-5; 97,4% responden memberi skor 4-5 pada kebutuhan memeriksa ulang keluaran AI dan perlindungan data, sedangkan 92,1% memberi skor 4-5 pada pemahaman struktur prompt. Kebutuhan penguatan tetap terlihat karena 22 responden belum terbiasa menyusun prompt, 18 mengkhawatirkan keamanan data, dan 11 mengkhawatirkan akurasi keluaran. Hasil ini merepresentasikan evaluasi pascapelatihan dan pemahaman yang dirasakan, bukan bukti peningkatan kompetensi objektif atau efek kausal pelatihan secara langsung.

Keywords


AI literacy; generative AI; output validation; prompt engineering; teacher professional development

Full Text:

PDF

References


Alfarwan, A. (2025). Generative AI use in K-12 education: A systematic review. Frontiers in Education, 10, 1647573. doi:10.3389/feduc.2025.1647573

Ariati, N., Astuti, L. W., Dhamayanti, D., Antony, F., & Di Kesuma, H. (2026). Pelatihan prompt engineering dalam penyusunan RPP berbasis Project-Based Learning bagi guru SMK. Reswara: Jurnal Pengabdian Kepada Masyarakat, 7(1), 281-289. doi:10.46576/rjpkm.v7i1.7811

Bai, S., Gonda, D. E., & Hew, K. F. (2024). Write-Curate-Verify: A case study of leveraging generative AI for scenario writing in scenario-based learning. IEEE Transactions on Learning Technologies, 17, 1313-1324. doi:10.1109/TLT.2024.3378306

Basuki, S., Faiqurrahman, M., Marthasari, G. I., Indrabayu, R., Zachra, F., & Effendy, N. A. (2024). Assistance in preparing engineering prompts for Muhammadiyah school teachers to optimize the use of ChatGPT in the world of education. Dinamisia: Jurnal Pengabdian Kepada Masyarakat, 8(3), 721-729. doi:10.31849/dinamisia.v8i3.19522

Cain, W. (2024). Prompting change: Exploring prompt engineering in large language model AI and its potential to transform education. TechTrends, 68(1), 47-57. doi:10.1007/s11528-023-00896-0

Gouseti, A., James, F., Fallin, L., & Burden, K. (2025). The ethics of using AI in K-12 education: A systematic literature review. Technology, Pedagogy and Education, 34(2), 161-182. doi:10.1080/1475939X.2024.2428601

Kasneci, E., Sessler, K., Kuechemann, S., Bannert, M., Dementieva, D., Fischer, F., ... Kasneci, G. (2023). ChatGPT for good? On opportunities and challenges of large language models for education. Learning and Individual Differences, 103, 102274. doi:10.1016/j.lindif.2023.102274

Lee, D., & Palmer, E. (2025). Prompt engineering in higher education: A systematic review to help inform curricula. International Journal of Educational Technology in Higher Education, 22, 7. doi:10.1186/s41239-025-00503-7

Lo, C. K. (2023). What is the impact of ChatGPT on education? A rapid review of the literature. Education Sciences, 13(4), 410. doi:10.3390/educsci13040410

Madaan, A., Tandon, N., Gupta, P., Hallinan, S., Gao, L., Wiegreffe, S., ... Clark, P. (2023). Self-Refine: Iterative refinement with self-feedback. Advances in Neural Information Processing Systems, 36, 46534-46594. doi:10.52202/075280-2019

Miao, F., & Cukurova, M. (2024). AI competency framework for teachers. UNESCO. doi:10.54675/ZJTE2084

Moorhouse, B. L., Wan, Y., Wu, C., Kohnke, L., Ho, T. Y., & Kwong, T. (2024). Developing language teachers' professional generative AI competence: An intervention study in an initial language teacher education course. System, 125, 103399. doi:10.1016/j.system.2024.103399

Ng, D. T. K., Wu, W., Leung, J. K. L., Chiu, T. K. F., & Chu, S. K. W. (2024). Design and validation of the AI literacy questionnaire: The affective, behavioural, cognitive and ethical approach. British Journal of Educational Technology, 55(3), 1082-1104. doi:10.1111/bjet.13411

Parwati, H., Pane, C. F., Nur, A., Agustin, G. U., Riziq, H., Silpyana, P., ... Nissa, I. I. (2026). Pelatihan teknologi Artificial Intelligence dan prompt untuk peningkatan keterampilan siswa Desain Komunikasi Visual di SMKS Mulia Hati Insani. Jurnal Pengabdian Masyarakat Terapan, 3(1), 44-54. doi:10.20884/1.jupiter.3.1.106

Qian, Y. (2025). Prompt engineering in education: A systematic review of approaches and educational applications. Journal of Educational Computing Research, 63(7-8), 1782-1818. doi:10.1177/07356331251365189

Shenoy, P., & Saarela, M. (2026). A critical review and actionable framework for integrating generative AI into teacher professional development. Discover Education, 5, 570. doi:10.1007/s44217-026-01579-7

Tyen, G., Mansoor, H., Carbune, V., Chen, P., & Mak, T. (2024). LLMs cannot find reasoning errors, but can correct them given the error location. In Findings of the Association for Computational Linguistics: ACL 2024 (pp. 13894-13908). Association for Computational Linguistics. doi:10.18653/v1/2024.findings-acl.826

Walter, Y. (2024). Embracing the future of Artificial Intelligence in the classroom: The relevance of AI literacy, prompt engineering, and critical thinking in modern education. International Journal of Educational Technology in Higher Education, 21, 15. doi:10.1186/s41239-024-00448-3

Woo, D. J., Wang, D., Yung, T., & Guo, K. (2026). Effects of a prompt engineering intervention on undergraduate students' AI self-efficacy, AI knowledge and prompt engineering ability: A mixed methods study. British Educational Research Journal, 52(2), 1442-1469. doi:10.1002/berj.70087

Ye, Q., Ahmed, M., Pryzant, R., & Khani, F. (2024). Prompt engineering a prompt engineer. In Findings of the Association for Computational Linguistics: ACL 2024 (pp. 355-385). Association for Computational Linguistics. doi:10.18653/v1/2024.findings-acl.21

Zhu, H., Sun, Y., & Yang, J. (2025). Towards responsible artificial intelligence in education: A systematic review on identifying and mitigating ethical risks. Humanities and Social Sciences Communications, 12, 1111. doi:10.1057/s41599-025-05252-6




DOI: 10.70095/dimasejati.v8i2.25655

Article Metrics

Abstract view : 0 times
PDF - 0 times

Refbacks

  • There are currently no refbacks.


Copyright (c) 2026 Saefurrohman Saefurrohman

Mailing Address:

LP2M UIN Siber Syekh Nurjati Cirebon

Jl. Perjuangan By Pass Sunyaragi Kesambi Kota Cirebon
E-Mail: dimasejat@uinssc.ac.id

View on Google Maps

CC BY

DIMASEJATI: Jurnal Pengabdian Kepada Masyarakat is licensed under a Creative Commons Attribution 4.0 International License