Abstract
Background: With the rapid development of computer and Internet technologies, the measurement of software reliability has become a key point. Software reliability modeling is an important way to measure software reliability. However, there are many disadvantages in the classic model. Therefore, this paper reviews current researches in software reliability and discusses ways to improve the model from a new perspective.
Objective: This paper reviews the current researches on software reliability, analyzes the existing patented technology, and points out some future directions to improve the current models to provide a more accurate and efficient way for software reliability measurement.
Methods: This study introduces the general methods of software reliability evaluation, analyzes the disadvantages of these methods in practical application, draws lessons from the patent, and puts forward some new ideas to solve the problems.
Results: Disadvantages of current researches are identified based on literature review. In addition, two suggestions are given to improve the current models.
Conclusion: Although the software reliability has made great progress, there are still many things to be studied in the future. The problems of software reliability in real life should be gradually solved.
Keywords: Software quality, software reliability, software reliability metrics, software reliability assessment, software reliability model, software reliability evaluation.
Graphical Abstract
[1]
J. Che, and L. Zhou, "Research and development of software reliability model", Comput. Digital Eng., vol. 46, no. 12, pp. 2430-2441, 2018.
[2]
"Unapproved Draft IEEE Recommended Practice on Software Reliability", IEEE Unapproved Draft Std P1633/D14, 2007.
[3]
J. Mc Call, W. Randell, and J. Dunham, "Software reliability measurement and testing guidebook", Technical Report RL-TR-92-52, Rome Laboratory USAF, 1992.
[5]
S.E. Abraham, "“Software patents in the United States: A balanced approach”. Computer Law and Security Review", Int. J. Technol. Pract., vol. 25, no. 6, 2009.
[6]
S. Chatterjee, and A. Shukla, "A unified approach of testing coverage‐based software reliability growth modelling with fault detection probability, imperfect debugging, and change point", J. Softw.: Evol. Proc, vol. 31, no. 3, 2019.
[7]
P. Kumar, L.K. Singh, and C. Kumar, "Suitability analysis of software reliability models for its applicability on NPP systems", Qual. Reliab. Eng. Int., vol. 34, no. 8, 2018.
[http://dx.doi.org/10.1002/qre.2315]
[http://dx.doi.org/10.1002/qre.2315]
[8]
S. Yamada, Software reliability modeling: fundamentals and applications., Springer: Tokyo, 2014.
[http://dx.doi.org/10.1007/978-4-431-54565-1]
[http://dx.doi.org/10.1007/978-4-431-54565-1]
[9]
J.Y. Wang, Z.B. Wu, and Y.J. Shu, "Software reliability model for irregular change of fault detection rate", J. Softw., vol. 26, no. 10, 2015.
[11]
T. Pham, and H. Pham, "A generalized software reliability model with stochastic fault-detection rate", Ann. Oper. Res., pp. 1-11, 2017.
[12]
P. B. Moranda, and Z. Jelinski, "Final report on software reliability study", Mc Donnell Douglas Astronautics Company, MADC Report, 1972.
[13]
B. Littlewood, and J.L. Verrall, "A Bayesian reliability growth model for computer software", Appl. Stat., pp. 332-346, 1973.
[http://dx.doi.org/10.2307/2346781]
[http://dx.doi.org/10.2307/2346781]
[14]
J.D. Musa, "A theory of software reliability and its application", IEEE Trans. Softw. Eng., no. 3, pp. 312-327, 1975.
[http://dx.doi.org/10.1109/TSE.1975.6312856]
[http://dx.doi.org/10.1109/TSE.1975.6312856]
[15]
J.D. Musa, and K. Okumoto, "A logarithmic Poisson execution time model for software reliability measurement", In: Proceedings of the 7th international conference on Software engineering. IEEE Pres, Madrid, Spain, 1984, pp. 230-238.
[16]
A.L. Goel, and K. Okumoto, "Time-dependent error-detection rate model for software reliability and other performance measures", IEEE Trans. Reliab., vol. 28, no. 3, pp. 206-211, 1979.
[http://dx.doi.org/10.1109/TR.1979.5220566]
[http://dx.doi.org/10.1109/TR.1979.5220566]
[17]
R.Z. Xu, J. Zhang, and L.J. Liu, "Singularity problem and parameter estimation method of empirical model in software reliability expert system", Chin. J. Comput., vol. 21, no. 2, pp. 145-159, 1998.
[18]
J.A. Whittaker, and M.G. Thomason, "A Markov chain model for statistical software testing", IEEE Trans. Softw. Eng., vol. 20, no. 10, pp. 812-824, 1994.
[http://dx.doi.org/10.1109/32.328991]
[http://dx.doi.org/10.1109/32.328991]
[19]
K. I, J. El‐ Far, and Whittaker. A, “Model‐ Based software testing., Encyclopedia Softw. Eng., 2001.
[20]
D.M. Lavery, P.P. Chang, and S.A. Mahlke, "The importance of prepass code scheduling for superscalar and super pipelined processors", IEEE Trans. Comput., vol. 44, no. 3, pp. 353-370, 1995.
[http://dx.doi.org/10.1109/12.372029]
[http://dx.doi.org/10.1109/12.372029]
[21]
S. Abid, A. Fatima, and S. Naheed, "Double exponential forecasting model for dates production in Pakistan", Pak. J. Agric. Res., vol. 29, no. 3, 2016.
[22]
Q. You, Y. Zhao, and G.P. Hu, "Reliability evaluation of accelerated degradation data based on time series model", Syst. Eng. Theory Prac., vol. 31, no. 2, pp. 328-332, 2011.
[23]
K. Yuan, and X.G. Li, "“Bayesian evaluation of reliability growth of success or failure systems [J]”, J", Beihang Uni., vol. 9, pp. 1312-1316, 2014.
[24]
Y.Y. Zhou, L. Qian, and J.M. Li, "Parameter estimation method of software reliability model based on harmony search algorithm", J.Shandong Uni. Technol.: Natural Sci. Ed., vol. 31, no. 2, pp. 44-48, 2017.
[25]
P.C. Li, H.J. Yuan, and J. Lan, "Dynamic fault tree analysis based on ordered binary decision diagrams", J. Beihang Univ., vol. 43, no. 1, pp. 167-175, 2017.
[26]
J.W. Wu, Research on reliability evaluation methods for complex software systems., Hefei University of Technology, 2018.
[27]
Y.A. Gerber, M.N. Danilov, and V.G. Sebeshev, "Probabilistic analysis and reliability evaluation of the harmonically loaded rod systems with dynamic vibration dampers, based on the use of modern software complexes", IOP Conf. Series Mater. Sci. Eng., vol. 456, no. 1, 2018.
[http://dx.doi.org/10.1088/1757-899X/456/1/012042]
[http://dx.doi.org/10.1088/1757-899X/456/1/012042]
[28]
K.W. Li, L. Liu, J.N. Zhai, T.M. Kosgoftaar, M.W. Shao, and W.Y. Liu, "Reliability evaluation model of component‐based software based on complex network theory", Qual. Reliab. Eng. Int., vol. 33, no. 3, 2017.
[http://dx.doi.org/10.1002/qre.2033]
[http://dx.doi.org/10.1002/qre.2033]
[29]
J.W. Shang, P. Chen, and X.J. Han, "Research on comprehensive application modeling technology of software reliability engineering", Inform. Secur. Res., vol. 4, no. 11, pp. 1002-1010, 2018.
[30]
M.R. Lyu, and A. Nikora, "A heuristic approach for software reliability prediction the equally-weighted linear combination model", International Symposium on software reliability Engineering, Tx, USA, 1991, pp. 172-181
[http://dx.doi.org/10.1109/ISSRE.1991.145376]
[http://dx.doi.org/10.1109/ISSRE.1991.145376]
[31]
F. Gong, K. Li, and K. Zhao, "A combined model for software reliability prediction based on neural network", Int. J. Appl. Math. Stat., vol. 45, no. 15, pp. 174-181, 2013.
[32]
B.M.G. Kibria, and S. Nadarajah, "Reliability modeling: linear combination and ratio of exponential and rayleigh", IEEE Trans. Reliab., vol. 56, no. 1, pp. 102-105, 2007.
[http://dx.doi.org/10.1109/TR.2006.884591]
[http://dx.doi.org/10.1109/TR.2006.884591]
[33]
X. Gui, and J.H. Gao, "Ecnu. “Combined prediction model based on GMDH neuro network", Appl. Therm. Eng., vol. 12, no. 2, pp. 117-125, 2016.
[34]
J. Chi, K. Honda, and H. Washizaki, "Defect analysis and prediction by applying the multistage software reliability growth model", International Workshop on Empirical Software Engineering in Practice IEEE, Tokyo, Japan, 2017pp. 7-13
[http://dx.doi.org/10.1109/IWESEP.2017.16]
[http://dx.doi.org/10.1109/IWESEP.2017.16]
[35]
Y. Li, "Discussion on the unreliability of computer software technology", Chin. Rural Educat., vol. 12, p. 40, 2019.
[36]
Z. Ma, W. Wu, J. Wang, and F. Liu, "Review of software reliability verification test research methods", J. Ordnan. Equip. Eng., pp. 1-7, 2019.
[37]
A. Puig-Diví, C. Escalona-Marfil, J.M. Padullés-Riu, A. Busquets, X. Padullés-Chando, and D. Marcos-Ruiz, "Validity and reliability of the Kinovea program in obtaining angles and distances using coordinates in 4 perspectives", PLoS One, vol. 14, no. 6, 2019.e0216448
[http://dx.doi.org/10.1371/journal.pone.0216448 PMID: 31166989]
[http://dx.doi.org/10.1371/journal.pone.0216448 PMID: 31166989]
[38]
P. Rani, and G.S. Mahapatra, "Neural network for software reliability analysis of dynamically weighted NHPP growth models with imperfect debugging", Softw. Test. Verif. Reliab., vol. 28, no. 5, 2018.
[http://dx.doi.org/10.1002/stvr.1663]
[http://dx.doi.org/10.1002/stvr.1663]
[39]
C.G. Ding, "Research and implementation of software reliability evaluation module", Sci. Technol. Vis., vol. 33, pp. 90-92, 2014.
[40]
Q. Fei, and C.Y. Liu, "Research and application of general reliability model based on NHPP software reliability", Comput. Sci., vol. 41, no. S2, pp. 379-381, 2014.
[41]
J. Wang, C. Zhang, X. Mi, X. Guo, and J. Li, "A software reliability growth model for introducing faults in Weibull distribution", J. Softw., vol. 30, no. 6, pp. 1759-1777, 2019.
[42]
J.Y. Wang, Z.B. Wu, Y.J. Shu, and Z. Zhang, "An optimized method for software reliability model based on nonhomogeneous Poisson process", Appl. Math. Model., vol. 40, no. 13-14, 2016.
[http://dx.doi.org/10.1016/j.apm.2016.01.016]
[http://dx.doi.org/10.1016/j.apm.2016.01.016]
[43]
M.P. Cristescu, E.A. Stoica, and L.V. Ciovică, "The comparison of software reliability assessment models", Procedia Econ. Finance, p. 27, 2015.
[http://dx.doi.org/10.1016/S2212-5671(15)01047-3]
[http://dx.doi.org/10.1016/S2212-5671(15)01047-3]
[44]
H. Okamura, T. Dohi, and S. Osaki, "Software reliability growth models with normal failure time distributions", Reliab. Eng. Syst. Saf., p. 116, 2013.
[http://dx.doi.org/10.1016/j.ress.2012.02.002]
[http://dx.doi.org/10.1016/j.ress.2012.02.002]
[45]
C. Zhang, and F.C. Meng, "Summary of software reliability growth model research", J. Softw., vol. 28, no. 9, pp. 2402-2430, 2017.
[46]
S. Tyagi, D. Kumar, and S. Kumar, "Reliability based solution to the decision making dilemma in a software environment", J. Stat. Manag. Syst, vol. 22, no. 4, 2019.
[http://dx.doi.org/10.1080/09720510.2019.1611226]
[http://dx.doi.org/10.1080/09720510.2019.1611226]
[47]
S. Yamada, Software reliability modeling: fundamentals and applications., Springer: Tokyo, 2014.
[http://dx.doi.org/10.1007/978-4-431-54565-1]
[http://dx.doi.org/10.1007/978-4-431-54565-1]
[48]
J.G. Lou, Research on software reliability modeling in small sample cases., Tongji University, 2010.
[49]
Q. Li, and H. Pham, "NHPP software reliability model considering the uncertainty of operating environments with imperfect debugging and testing coverage", Appl. Math. Model., vol. 51, pp. 68-85, 2017.
[http://dx.doi.org/10.1016/j.apm.2017.06.034]
[http://dx.doi.org/10.1016/j.apm.2017.06.034]
[50]
C. Zhang, and F.C. Meng, "Review of software reliability growth model research", J. Softw., vol. 28, no. 09, pp. 2402-2430, 2017.
[51]
R. Peng, Y.F. Li, and L.Y. , Software fault detection and correction: modeling and applications.. Springer Briefs in Computer Science,, 2018.
[http://dx.doi.org/10.1007/978-981-13-1162-8]
[http://dx.doi.org/10.1007/978-981-13-1162-8]
[52]
Y.Z. Liu, X. Luo, and J.X. Ao, "An improved J-M software reliability growth model", Appl. Mech. Mater., vol. 241-244, pp. 2741-2750, 2013.
[http://dx.doi.org/10.4028/www.scientific.net/AMM.241-244.2741]
[http://dx.doi.org/10.4028/www.scientific.net/AMM.241-244.2741]
[53]
T.T. Zhang, D.P. Zhang, and G.Q. Liu, "Hidden Markov software reliability model based on EM method", Comput. Sci., vol. 43, no. 8, pp. 159-164, 2016.
[54]
X.J. Ma, Y.L. Tian, and S.Q. Li, "Software reliability growth model based on work efficiency measurement", Comput. Eng. Des., vol. 38, no. 3, pp. 687-692, 2017.
[55]
X.H. Wang, S.P. Zhang, and X.G. Li, "Accelerated testing of equipment based on the Duane model", J. Appl. Sci. (Faisalabad), vol. 13, no. 22, pp. 5265-5269, 2013.
[http://dx.doi.org/10.3923/jas.2013.5265.5269]
[http://dx.doi.org/10.3923/jas.2013.5265.5269]
[56]
B. Littlewood, "Stochastic. “Reliability growth: A model for fault removal in computer programs and hardware designs", IEEE Trans. Reliab., vol. 30, no. 4, pp. 313-320P, 1981.
[http://dx.doi.org/10.1109/TR.1981.5221099]
[http://dx.doi.org/10.1109/TR.1981.5221099]
[57]
J. Shang, P. Chen, and X. Han, "Study on integrated application modeling technology of software reliability engineering", Info. Secur. Res., vol. 4, no. 11, pp. 1002-1010, 2018.
[58]
X. Lv, Research on software reliability model based on NHPP., Harbin Engineering University, 2017.
[59]
G.T. Ding, Research on software reliability model based on random walks., Jiangxi Normal University, 2018.
[60]
J. Li, Research on the prediction and evaluation system of software reliability model., Liaoning University of Engineering and Technology, 2017.
[61]
A. Amin, L. Grunske, and A. Colman, "An approach to software reliability prediction based on time series modeling", Syst. Softw., vol. 86, pp. 1923-1932, 2013.
[http://dx.doi.org/10.1016/j.jss.2013.03.045]
[http://dx.doi.org/10.1016/j.jss.2013.03.045]
[62]
N. Raj Kiran, and V. Ravi, "Software reliability prediction by soft computing techniques", Syst. Softw., vol. 81, pp. 576-583, 2008.
[http://dx.doi.org/10.1016/j.jss.2007.05.005]
[http://dx.doi.org/10.1016/j.jss.2007.05.005]
[63]
S. Tyagi, D Kumar, and S. Kumar, "Reliability based solution to the decision making dilemma in a software environment", J. Stat. Manag. Sys, vol. 22, no. 4, 2019.
[http://dx.doi.org/10.1080/09720510.2019.1611226]
[http://dx.doi.org/10.1080/09720510.2019.1611226]
[64]
K. Sharma, and R. Garg, "K. C., and R.K. Garg. Nagpal., ““Selection of optimal software reliability growth models using a distance based approach", IEEE Trans. Reliab., vol. 59, pp. 266-276, 2010.
[http://dx.doi.org/10.1109/TR.2010.2048657]
[http://dx.doi.org/10.1109/TR.2010.2048657]
[65]
Z.H. Zhao, Software reliability growth model selection based on multiple evaluation criteria., Xinjiang University, 2005.
[66]
H. Wang, C. Liu, and M.Z. Jin, "Selection of software reliability model based on clustering thought", Comput. Eng. Appl., vol. 21, pp. 21-24+99, 2002.
[67]
K. Zhao, Research on software reliability combination forecasting method based on multi-neural network., China University of Petroleum, 2013.
[68]
K. Li, and H. Liu, "A new method of software reliability model combination based on time series data", J. Comput. Appl., vol. 34, no. S2, pp. 208-210;249, 2014.
[69]
E. Wang, F. Hou, and S. Zheng, "A software reliability comprehensive prediction method based on membership degree", Microcomput. & Appl., vol. 30, no. 15, pp. 4-7, 2011.
[70]
Y.S. Su, and C.Y. Huang, "Neural-network-based approaches for software reliability estimation using dynamic weighted combinational models", J. Syst. Softw., vol. 80, no. 4, pp. 606-615, 2007.
[http://dx.doi.org/10.1016/j.jss.2006.06.017]
[http://dx.doi.org/10.1016/j.jss.2006.06.017]
[71]
P. Zhang, "Patent protection of business method software: practice in the United States and its enlightenment", Forensic Res., vol. 04, pp. 138-145, 2005.
[72]
S.J. Jiang, "Reflection and Transcendence of Intellectual Property Protection of Computer Software", Comput. Knowl. Technol., vol. 22, no. 03, pp. 98-99, 2015.
[73]
Y.H. Zhang, Alice’s judgment of the US supreme court. Electronic Intellectual Property, 2015, p. 01.
[74]
D. Dirnberger, "The use of mindmapping software for patent search and management", World Pat. Inf., vol. 47, pp. 12-20, 2016.
[http://dx.doi.org/10.1016/j.wpi.2016.08.004]
[http://dx.doi.org/10.1016/j.wpi.2016.08.004]
[75]
P. Masiakowski, and S. Wang, "Integration of software tools in patent analysis", World Pat. Inf., vol. 35, no. 2, 2013.
[http://dx.doi.org/10.1016/j.wpi.2012.12.010]
[http://dx.doi.org/10.1016/j.wpi.2012.12.010]
[76]
H. Bronwyn, and H.M. MacGarvie, "The private value of software patents", Res. Policy, vol. 39, no. 7, 2010.
[78]
N. Li, Z.H. Fu, H.P. Mu, W.J. Zhai, and Y. Liu, "The theoretical basis and practice of patent value evaluation softwareization", Chin. invent. patents, vol. 4, pp. 30-33, 2014.
[79]
C. Maracke, "Free and open source software and FRAND‐based patent licenses", J. World Intellect. Prop., vol. 22, no. 3-4, 2019.
[http://dx.doi.org/10.1111/jwip.12114]
[http://dx.doi.org/10.1111/jwip.12114]
[80]
K.S. Yang, J.Q. Zhang, D.Q. Li, D. Lu, O.Y. Lin, F. Tao, and Z.K. She, "A method for evaluating software system reliability based on complex network theory", Chinese Patent: CN108255733A.
[81]
N.E. Fenton, M. Neil, and W. Marsh, "On the effectiveness of early life cycle defect prediction with Bayesian nets", Empir. Softw. Eng., vol. 13, no. 5, pp. 499-537, 2008.
[http://dx.doi.org/10.1007/s10664-008-9072-x]
[http://dx.doi.org/10.1007/s10664-008-9072-x]
Related Books
Mechanical Engineering Technologies and Applications
Mechanical Engineering Technologies and Applications
Facets of a Smart City: Computational and Experimental Techniques for Sustainable Urban Development
Soft Robotics
Voltammetry for Sensing Applications
Advances in Manufacturing Technologies and Production Engineering
Advances in Additive Manufacturing Processes
Lean Management Solutions for Contemporary Manufacturing Operations
Mechanical Engineering Technologies and Applications
Global Emerging Innovation Summit (GEIS-2021)
Article Metrics
3
1