An Attempt to Create an Automatic Scoring Tool of Short Text Answer in Bahasa Indonesia

Husni Thamrin, Jan Wantoro


Closed questions offer poor information on student's ability to manage and apply knowledge. On the other hand, open questions have advantages because it may be used to grasp students' conceptual maturity and ability of communication. However, scoring open question answer is not trivial and time-consuming so an automatic scoring tool becomes necessary. An attempt was made to create a scoring tool for open and short text question answer in Bahasa Indonesia that resembles the way school teachers do scoring. Automatic scoring of a student answer was based on the similarity between the answer and predefined key answers. The proposed automatic scoring tool has a form of correlation with human scoring so that the model may be used to predict teacher scoring.


automatic scoring; short text; bahasa Indonesia


Mohler, M., & Mihalcea, R.: Text-to-text semantic similarity for automatic short answer grading, Proceedings of the 12th Conference of the European Chapter of the Association for Computational Linguistics, ( 2009) 567-575.

Cole, J.: Using Moodle. Moodle. using_moodle/ ch5_quizzes.pdf (2006)

Gonzalez-Barbone, V., Llamas-Nistal , M.: eAssessment of Open Questions: an Educator's Perspective , 38th ASEE/IEEE Frontiers in Education Conference (2008) F2B1-F2B6

Jona, K.: Rethinking the Design of Online Courses, in Proc. ASCILITE 2000, New South Wales, Coffs Harbour, (2000)

Sargeant, J., McGee Wood, M., Anderson, S. M.: A Human Computer Collaborative Approach to the Marking of Free Text Answers, Proceedings of the 8th CAA Conference, Loughborough University (2004)

Winarsono, D., Siahaan D.D., Yuhana, U.: Sistem Penilaian Otomatis Kemiripan Kalimat Menggunakan Syntactic-Semantic Similarity pada Sistem E-Learning, Kursor vol. 5 no. 2 (2009) 75-82.

Talla, F.: A study of stemming effects on information retrieval in Bahasa Indonesia, (2003)

Adriani, M., Asian, J., Nazief, B., Tahaghoghi, S. M. M., & Williams, H. E.: Stemming Indonesian: A confix-stripping approach, ACM Transactions on Asian Language Information Processing (TALIP), vol. 6, no. 4, (2007) 1-33.

Hamzah, A., Soesianto, F., Susanto, A., Istiyanto, J.E.: Studi Kinerja Fungsi-Fungsi Jarak dan Similaritas dalam Clustering Dokumen Teks Berbahasa Indonesia, Prosiding Seminar Nasional Informatika 2008, Yogyakarta (2008)

Asy'arie, A. D., & Pribadi, A. W.: Automatic news articles classification in indonesian language by using naive bayes classifier method, Proceedings of the 11th International Conference on Information Integration and Web-based Applications & Services, (2009) 658-662.

Hamzah, A.: Temu Kembali Informasi Berbasis Kluster untuk Sistem Temu Kembali Informasi Teks Bahasa Indonesia, Jurnal Teknologi, vol.2, no.1, (2009) 1-7.

Hamzah, A.: Aplikasi N-Gram Untuk Deteksi Plagiat Pada Dokumen Teks, Prosiding Seminar Nasional Teknoin (2011).

Resnik, P.: Using information content to evaluate semantic similarity, Proceedings of the 14th International Joint Confer-ence on Artificial Intelligence, (1995)

Wu, Z., and Palmer, M.: Verb semantics and lexical selection, Proceedings of the Annual Meeting of the Association for Computational Linguistics., (1994)

Full Text: PDF


  • There are currently no refbacks.