Analisis Efektivitas Pembobotan TF-IDF dan Metode Cosine Similarity Untuk Deteksi Plagiarisme


  • Rido Anugrah * Mail Universitas Pamulang, Banten, Indonesia
  • Atang Susila Universitas Pamulang, Banten, Indonesia
  • (*) Corresponding Author
Keywords: Cosine Similarity; TF-IDF; Plagiarism Detection; PAN Corpus; Binary Classification

Abstract

Plagiarism in academic documents undermines scientific integrity and significantly degrades the quality of education. This study aims to analyze the effectiveness of combining Term Frequency-Inverse Document Frequency (TF-IDF) statistical weighting with the Cosine Similarity distance metric for detecting the degree of global semantic similarity at the document level. The computational experiments were conducted using the Python programming language, supported by the Natural Language Toolkit (NLTK) and Scikit-Learn libraries. The test dataset consists of an internationally standardized secondary dataset from the PAN at CLEF 2011 corpus (a subset of the PAN-PC-2011 corpus), comprising 500 pairs of suspected (query) documents and their corresponding source documents. As the test dataset contains only positive pairs (instances of plagiarism) and no negative pairs (non-plagiarized instances), the binary classification evaluation focuses on True Positives (TP), False Negatives (FN), positive-class accuracy, and recall. The primary contribution of this research is the provision of empirical evidence regarding an optimal threshold (2%) and a comprehensive analysis of the impact of "vector dilution" in full-length documents. The highest recall achieved in the tested scenarios was 94% (470 TP out of 500 pairs) at a 2% threshold. Recall decreased as the threshold increased, reaching 0% at thresholds of 80% and 90%. These results indicate that the threshold significantly influences detection sensitivity for positive instances; however, it does not yet reflect the system's ability to correctly reject non-plagiarized documents. Consequently, this method is best positioned as an initial screening tool that requires further evaluation using both positive and negative pairs.

Downloads

Download data is not yet available.

References

Abdelaal, A., Elsaadany, A., Ahmed Medhat, A., Al Shamsi, A., & Gamal ElDin Saad Ali, N. (2025). Plagiarism detection across languages: a comprehensive study of Arabic and English-to-Arabic long documents. https://doi.org/10.7717/peerj

Abisheka, P., Deisy, C., & Sharmila, P. (2024). T-SRE: Transformer-based semantic Relation extraction for contextual paraphrased plagiarism detection. Journal of King Saud University - Computer and Information Sciences, 36(10). https://doi.org/10.1016/j.jksuci.2024.102257

Amirzhanov, A., Turan, C., & Makhmutova, A. (2025). Plagiarism types and detection methods: a systematic survey of algorithms in text analysis. In Frontiers in Computer Science (Vol. 7). Frontiers Media SA. https://doi.org/10.3389/fcomp.2025.1504725

Granger, B. E., & Perez, F. (2021). Jupyter: Thinking and Storytelling with Code and Data. Computing in Science and Engineering, 23(2), 7–14. https://doi.org/10.1109/MCSE.2021.3059263

Halim, J., & Lasut, D. (2024). Document Plagiarism Detection Application Using Web-Based TF-IDF and Cosine Similarity Methods. Bit-Tech, 7(2), 202–213. https://doi.org/10.32877/bt.v7i2.1697

Khaled, F., & Al-Tamimi, M. S. H. (2021). Plagiarism Detection Methods and Tools: An Overview. Iraqi Journal of Science, 62(8), 2771–2783. https://doi.org/10.24996/ijs.2021.62.8.30

Lumbansiantar, S., Dwiasnati, S., & Fatonah, N. S. (2023). Penerapan Metode Cosine Similarity dalam Mendeteksi Plagiarisme pada Jurnal. In Jurnal Format (Vol. 12). https://doi.org/10.22441/format.2023.v12.i2.007

Maulidya Prastita Syah, Ajeng Puspa Wardani, Mohammad Idhom, & Trimono. (2025). Perbandingan Representasi Teks Tf-Idf Dan Bert Terhadap Akurasi Cosine Similarity Dalam Penilaian Otomatis Jawaban Berbasis Teks. Data Sciences Indonesia (DSI), 5(1), 47–59. https://doi.org/10.47709/dsi.v5i1.6021

Nennuri, R., Geetha Yadav, M., Samhitha, M., Sandeep Kumar, S., & Roshini, G. (2021). Plagiarism Detection through Data Mining Techniques. Journal of Physics: Conference Series, 1979(1). https://doi.org/10.1088/1742-6596/1979/1/012070

Pandikumar, S., Menaka, C., T, K., & Paul Antony, T. J. (2024). Evolution and Analysis of Modern Plagiarism Detection Methods: A Systematic Review. In Innovations and Trends in Modern Computer Science Technology – Overview, Challenges and Applications (pp. 131–140). QTanalytics India. https://doi.org/10.48001/978-81-980647-5-2-10

Pardede, J., & Yudistira, A. (2025). Comparison of Cosine Similarity, Rabin-Karp, and Levenshtein Distance Algorithms for Plagiarism Detection in Document. Ultimatics : Jurnal Teknik Informatika, 17(1), 63. https://doi.org/10.31937/ti.v17i1.3867

Pratiwi, M. A., & Aisya, N. (2021). Fenomena plagiarisme akademik di era digital. Publishing Letters, 1, 16–33. https://doi.org/10.48078/publetters.v1i2.23

Prismadana, T. A. (2023). Aplikasi Ruang Tugas Dengan Deteksi Kemiripan Teks Pada Dokumen Tugas Menggunakan Cosine Similarity. JURNAL INFORMATIKA & MULTIMEDIA, 15(1). https://doi.org/10.33795/jtim.v15i1.4405

Resta, O. A., Aditya, A., & Purwiantono, F. E. (2021). Plagiarism Detection in Students’ Theses Using The Cosine Similarity Method. SinkrOn, 5(2), 305–313. https://doi.org/10.33395/sinkron.v5i2.10909

Sari, L. P. (2023). Cosine Similarity-based Plagiarism Detection on Electronic Documents A R T I C L E I N F O. Journal of Computer Science Application And Engineering, 1(2), 44–48. https://journal.lenterailmu.com/index.php/josapen

Sarica, S., & Luo, J. (2021). Stopwords in technical language processing. PLoS ONE, 16(8 August). https://doi.org/10.1371/journal.pone.0254937

Victoria Lumbangaol, L., Eka Zuwanda, M., Yohanni Tumanggor, H., Surbakti, I., Legahati Siregar, N., Studi Manajemen Sumber Daya Manusia Sektor Publik, P., & Manajemen Informatika, A. (2025). Jutisal-Jurnal Teknik Informatika UNIVERSAL. https://jurnal.universal.ac.id/index.php/teknikinformatika

Widianto, A., & Pebriyanto, E. (2024). Document Similarity using Term Frequency-Inverse Document Frequency Representation and Cosine Similarity. Journal of Dinda Data Science, Information Technology, and Data Analytics, 4(2), 149–153. http://journal.ittelkom-pwt.ac.id/index.php/dinda

Zimba, O., & Gasparyan, A. Y. (2021). Plagiarism detection and prevention: A primer for researchers. Reumatologia, 59(3), 132–137. https://doi.org/10.5114/reum.2021.105974


Bila bermanfaat silahkan share artikel ini

Berikan Komentar Anda terhadap artikel Analisis Efektivitas Pembobotan TF-IDF dan Metode Cosine Similarity Untuk Deteksi Plagiarisme

Dimensions Badge
Article History
Published: 2026-10-31
Abstract View: 0 times
Section
Articles