Analisis Efektifitas Algoritma FAST Menggunakan Metrik Average Percentage Fault Detection dan Waktu Eksekusi Pada Test Case Prioritization
-
Asri Maspupah
*
Politeknik Negeri Bandung, Bandung,
Indonesia
- Mumuh Kustino Muharram Politeknik Negeri Bandung, Bandung, Indonesia
- Sophia Gianina Daeli Politeknik Negeri Bandung, Bandung, Indonesia (*) Corresponding Author
Abstract
It uses regression testing to validate the modification results so as not to cause new errors in features that are already functioning correctly. The implementation of regression testing is generally done by re-executing the test suite used in the previous test. One of the crucial issues in regression testing is determining a strategic approach to reuse existing test suites. Testing with retesting all test cases will result in a long and expensive test. Thus, it is necessary to use a test case selection approach. The research study focuses on analyzing the effectiveness of the FAST algorithm, namely the FAST-pw and FAST-all algorithms, for executing test cases based on priority. The research method uses experiments through running algorithms on test cases that have been implanted with faults in the software with a test case size of 10,000 to 20,000 lines of the program. The effectiveness parameter uses the test case execution time and the percentage of fault detection using the average percentage fault detection (APFD) metric. The results showed that the FAST algorithm, namely the FAST-pw and FAST-all algorithms, had good effectiveness values when applied to TCP testing with small to medium-sized SUTs, namely test cases that tested 1,000 – 20,000 program lines.
Downloads
References
S. Al-Saqqa, S. Sawalha, and H. Abdelnabi, “Agile Software Development: Methodologies and Trends,” International Journal of Interactive Mobile Technologies, vol. 14, no. 11, pp. 246–270, 2020, doi: 10.3991/ijim.v14i11.13269.
A. Ansari, A. Khan, A. Khan, and K. Mukadam, “Optimized Regression Test Using Test Case Prioritization,” in Procedia Computer Science, 2016, vol. 79, pp. 152–160. doi: 10.1016/j.procs.2016.03.020.
A. Maspupah and A. Bakhrun, “PERBANDINGAN KEMAMPUAN REGRESSION TESTING TOOL PADA REGRESSION TEST SELECTION: STARTS DAN EKSTAZI,” Jurnal Teknologi Terapan) |, vol. 7, no. 1, pp. 59–67, 2021, [Online]. Available: https://github.comTestingResearchIllinois/starts.
A. Ngah, M. Munro, and M. Abdallah, “An Overview of Regression Testing,” Journal of Telecommunication, Electronic and Computer Engineering, vol. 9, no. 3, pp. 45–49, 2017, [Online]. Available: https://www.researchgate.net/publication/321243328
I. Ghani, W. M. N. Wan-Kadir, A. F. Arbain, and N. Ibrahim, “Improved Test Case Selection Algorithm to Reduce Time in Regression Testing,” Computers, Materials and Continua, vol. 72, no. 1, pp. 635–650, 2022, doi: 10.32604/cmc.2022.025027.
S. P. Dongoor, “Selecting an Appropriate Requirements Based Test Case Prioritization Technique,” Sweden, Mar. 2019. [Online]. Available: www.bth.se
D. Suleiman, M. Alian, and Prof. A. Hudaib, “A Survey on Prioritization Regression Testing Test Case,” in 8th International Conference on Information Technology (ICIT), 2017, pp. 854–862.
R. H. Rosero, O. S. Gómez, and G. Rodríguez, “15 Years of Software Regression Testing Techniques - A Survey,” International Journal of Software Engineering and Knowledge Engineering, vol. 26, no. 5. World Scientific Publishing Co. Pte Ltd, pp. 675–689, Jun. 01, 2016. doi: 10.1142/S0218194016300013.
M. H. Alkawaz and A. Silvarajoo, “A Survey on Test Case Prioritization and Optimization Techniques in Software Regression Testing,” in IEEE 7th Conference on Systems, Process and Control, 2019, pp. 59–64.
S. Singhal, N. Jatana, B. Suri, S. Misra, and L. Fernandez-Sanz, “Systematic Literature Review On Test Case Selection and Prioritization: A Tertiary Study,” Applied Sciences (Switzerland), vol. 11, no. 24, pp. 1–34, Dec. 2021, doi: 10.3390/app112412121.
H. Spieker, A. Gotlieb, D. Marijan, and M. Mossige, “Reinforcement Learning for Automatic Test Case Prioritization and Selection in Continuous Integration,” in ISSTA 2017 - Proceedings of the 26th ACM SIGSOFT International Symposium on Software Testing and Analysis, Jul. 2017, pp. 12–22. doi: 10.1145/3092703.3092709.
S. Nayak, C. Kumar, S. Tripathi, and L. Jena, “Efficiency Enhancement in Regression Test Case Prioritization Technique,” International Journal of Innovative Technology and Exploring Engineering, vol. 8, no. 12, pp. 5445–5451, Oct. 2019, doi: 10.35940/ijitee.K1595.1081219.
M. Azizi and H. Do, “A collaborative filtering recommender system for test case prioritization in web applications,” in Proceedings of the ACM Symposium on Applied Computing, Apr. 2018, pp. 1560–1567. doi: 10.1145/3167132.3167299.
D. K. Yadav and S. Dutta, “Regression test case prioritization technique using genetic algorithm,” in Advances in Intelligent Systems and Computing, 2017, vol. 509, pp. 133–140. doi: 10.1007/978-981-10-2525-9_13.
B. Miranda, E. Cruciani, R. Verdecchia, and A. Bertolino, “FAST approaches to scalable similarity-based test case prioritization,” in Proceedings - International Conference on Software Engineering, 2018, vol. 2018-January. doi: 10.1145/3180155.3180210.
B. Miranda, “FAST Approaches to Scalable Similarity-based Test Case Prioritization,” FAST, 2018. https://github.com/icse18-FAST/FAST (accessed Nov. 08, 2020).
National Science Foundation, “Software-artifact Infrastructure Repository,” SIR, 2006. https://sir.csc.ncsu.edu/portal/index.php (accessed Nov. 12, 2020).
René Just, “Defects4J -- version 2.0.0,” Defects4J, 2016. https://github.com/rjust/defects4j (accessed Nov. 20, 2020).
Bila bermanfaat silahkan share artikel ini
Berikan Komentar Anda terhadap artikel Analisis Efektifitas Algoritma FAST Menggunakan Metrik Average Percentage Fault Detection dan Waktu Eksekusi Pada Test Case Prioritization
Pages: 451-457
Copyright (c) 2023 Asri Maspupah, Mumuh Kustino Muharram, Sophia Gianina Daeli
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under Creative Commons Attribution 4.0 International License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (Refer to The Effect of Open Access).
