Autors: Angelov A., Lazarova, M. K.
Title: Hybrid Artificial Bee Colony Algorithm for Test Case Generation and Optimization
Keywords: artificial bee colony, boundary value analysis, equivalence partitioning, hybrid algorithm, metaheuristic optimization, pairwise testing, software testing, test case generation

Abstract: The generation of high-quality test cases remains challenging due to combinatorial explosion and difficulty balancing exploration-exploitation in complex parameter spaces. This paper presents a novel Hybrid Artificial Bee Colony (ABC) algorithm that uniquely combines ABC optimization with Simulated Annealing temperature control and adaptive scout mechanisms for automated test case generation. The approach employs a four-tier categorical fitness function discriminating between boundary-valid, valid, boundary-invalid, and invalid values, with first-occurrence bonuses ensuring systematic exploration. Through comprehensive empirical validation involving 970 test suite generations across 97 parameter configurations, the hybrid algorithm demonstrates 68.3% improvement in fitness scores over pairwise testing (975.9 ± 10.6 vs. 580.0 ± 0.0, p < 0.001, d = 42.61). Statistical analysis identified three critical parameters with large effect sizes: MutationRate (d = 106.61), FinalPopulationSelectionRatio (d = 42.61), and TotalGenerations (d = 19.81). The value discrimination system proved essential, uniform weight configurations degraded performance by 7.25% (p < 0.001), while all discriminating configurations achieved statistically equivalent results, validating the architectural design over specific weight calibration.

References

  1. Dobslaw F. Feldt R. Gomes de Oliveira Neto F.G. Automated Black-Box Boundary Value Detection PeerJ Comput. Sci. 2023 9 e1625 10.7717/peerj-cs.1625
  2. NUnit Available online: https://nunit.org/ (accessed on 19 October 2025)
  3. Microsoft Unit Testing with MSTest in.NET Core Available online: https://learn.microsoft.com/en-us/dotnet/core/testing/unit-testing-with-mstest (accessed on 19 October 2025)
  4. xUnit.net Available online: https://xunit.net/ (accessed on 19 October 2025)
  5. Chavez B. Bogus—C# Port of faker.js. GitHub Available online: https://github.com/bchavez/Bogus (accessed on 19 October 2025)
  6. AutoFixture Available online: https://github.com/AutoFixture/AutoFixture (accessed on 19 October 2025)
  7. Microsoft PICT—Pairwise Independent Combinatorial Testing. GitHub Available online: https://github.com/microsoft/pict (accessed on 19 October 2025)
  8. EvoSuite Automatic Unit Test Generation for Java Available online: https://www.evosuite.org/ (accessed on 19 October 2025)
  9. FsCheck Available online: https://fscheck.github.io/FsCheck/ (accessed on 19 October 2025)
  10. Bach J. Schroeder P. Pairwise Testing: A Best Practice That Isn’t Proceedings of the 22nd Pacific Northwest Software Quality Conference Portland, OR, USA 11–13 October 2004 180 196
  11. Jorgensen P.C. Boundary Value Testing Software Testing: A Craftsman’s Approach 4th ed. CRC Press Boca Raton, FL, USA 2014 Chapter 5 79 94 978-1-4665-6069-7
  12. Scott A. MADLab: Masking and Multiple Bug Diagnosis Ph.D. Thesis University of Edinburgh Edinburgh, UK 1994
  13. Mala D.J. Mohan V. ABC Tester-Artificial Bee Colony Based Software Test Suite Optimization Approach Int. J. Softw. Eng. 2009 2 15 43
  14. Kirkpatrick S. Gelatt C.D. Vecchi M.P. Optimization by Simulated Annealing Science 1983 220 671 680 10.1126/science.220.4598.671
  15. He D. Liu D. Li L. Evolutionary Test Case Generation with Improved Genetic Algorithm Intell. Decis. Technol. 2025 19 2310 2323 10.1177/18724981251332529
  16. Ahmad M.Z.Z. Othman R.R. Ali M.S.A.R. Ramli N. Self-Adapting Ant Colony Optimization Algorithm Using Fuzzy Logic (ACOF) for Combinatorial Test Suite Generation IOP Conf. Ser. Mater. Sci. Eng. 2020 767 012017 10.1088/1757-899X/767/1/012017
  17. Nasser A.B. Abdul-Qawy A.S.H. Abdullah N. Hujainah F. Zamli K.Z. Ghanem W.A.H.M. Latin Hypercube Sampling Jaya Algorithm based Strategy for T-way Test Suite Generation Proceedings of the 2020 9th International Conference on Software and Computer Applications (ICSCA ‘20) Langkawi, Malaysia 18–21 February 2020 105 109 10.1145/3384544.3384608
  18. Xia C. Zhang Y. Hui Z. Test Suite Reduction via Evolutionary Clustering IEEE Access. 2021 9 28111 28121 10.1109/ACCESS.2021.3058301
  19. Broide L. Stern R. EvoGPT: Enhancing Test Suite Robustness via LLM-Based Generation and Genetic Optimization arXiv 2025 2505.12424
  20. Felding E. Strandberg P.E. Quttineh N.H. Afzal W. Resource Constrained Test Case Prioritization with Simulated Annealing in an Industrial Context Proceedings of the 39th ACM/SIGAPP Symposium on Applied Computing (SAC ‘24) Avila, Spain 8–12 April 2024 1694 1701 10.1145/3605098.3635971
  21. Mgbemena S.O. Khatibsyarbini M. Isa A.M. An Enhancement of Coverage-based Test Case Prioritization Technique Using Hybrid Genetic Algorithm Int. J. Innov. Comput. 2025 15 109 117
  22. Wang H. Du P. Xu X. Su M. Wen S. Yue W. Zhang S. Adaptive Group Collaborative Artificial Bee Colony Algorithm arXiv 2021 10.48550/arXiv.2112.01215 2112.01215
  23. Alabbas M. Abdulkareem A.H. Hybrid Artificial Bee Colony Algorithm with Multi-Using of Simulated Annealing Algorithm and Its Application in Attacking of Stream Cipher Systems J. Theor. Appl. Inf. Technol. 2019 97 23 33
  24. Kumar S. Sharma V.K. Kumari R. A Novel Hybrid Crossover based Artificial Bee Colony Algorithm for Optimization Problem arXiv 2014 1407.5574 10.5120/14136-2266
  25. Zhang S. Liu X. Trik M. Energy Efficient Multi Hop Clustering Using Artificial Bee Colony Metaheuristic in WSN Sci. Rep. 2025 15 26803 10.1038/s41598-025-12321-y 40702073
  26. Ge J. Zhou B. Liu N. Hybrid Artificial Bee Colony and Bat Algorithm for Efficient Resource Allocation in Edge-Cloud Systems Int. J. Adv. Comput. Sci. Appl. 2025 16 1024 1031 10.14569/ijacsa.2025.01602101
  27. Yahaya M.S. Hashim A.S.B. Balogun A.O. Muazu A.A. Usman F.S. Aliyu D.A. Muhammad A.U. Exploration and Exploitation Mechanism in Pairwise Test Case Generation: A Systematic Literature Review IEEE Access 2025 13 82342 82371 10.1109/ACCESS.2025.3566163
  28. Chandrasekhara Reddy T. Srivani V. Mallikarjuna Reddy A. Vishnu Murthy G. Test Case Optimization and Prioritization Using Improved Cuckoo Search and Particle Swarm Optimization Algorithm Int. J. Eng. Technol. 2018 7 275 278 10.14419/ijet.v7i4.6.20489
  29. Tsang E. Voudouris C. Fast Local Search and Guided Local Search and Their Application to British Telecom’s Workforce Scheduling Problem Oper. Res. Lett. 1997 20 119 127 10.1016/S0167-6377(96)00042-9
  30. Vats R. Kumar A. Artificial Bee Colony Based Prioritization Algorithm for Test Case Prioritization Problem Int. J. Adv. Trends Comput. Sci. Eng. 2020 9 8347 8354 10.30534/ijatcse/2020/207952020
  31. Srikanth A. Kulkarni N.J. Naveen K.V. Singh P. Srivastava P.R. Test Case Optimization Using Artificial Bee Colony Algorithm Commun. Comput. Inf. Sci. 2011 192 570 579
  32. Rani S. Suri B. Goyal R. On the Effectiveness of Using Elitist Genetic Algorithm in Mutation Testing Symmetry 2019 11 1145 10.3390/sym11091145
  33. Durgut R. Improved Binary Artificial Bee Colony Algorithm Front. Inf. Technol. Electron. Eng. 2021 22 1080 1091 10.1631/FITEE.2000239
  34. Glover F. Tabu Search—Part I ORSA J. Comput. 1989 1 190 206 10.1287/ijoc.1.3.190
  35. Angelov A. Testimize: Hybrid ABC Test Case Generation Framework. GitHub Repository. Licensed under Apache 2.0 Available online: https://github.com/AutomateThePlanet/Testimize (accessed on 19 October 2025)
  36. Wambua A.W. Wambugu G.M. A Comparative Analysis of Bat and Genetic Algorithms for Test Case Prioritization in Regression Testing Int. J. Intell. Syst. Appl. 2023 15 13 21 10.5815/ijisa.2023.01.02

Issue

Algorithms, vol. 18, 2025, Albania, https://doi.org/10.3390/a18100668

Вид: статия в списание, публикация в издание с импакт фактор, публикация в реферирано издание, индексирана в Scopus и Web of Science