Weibull分布引进故障的软件可靠性增长模型

软件调试是复杂过程,可能会受到很多种因素的影响,例如调试资源分配、调试工具的使用情况、调试技巧等.在软件调试过程中,当检测到的故障被去除时,新的故障可能会被引进.因此,研究故障引进的现象对建立高质量的软件可靠性增长模型具有重要意义.但是到目前为止,模拟故障引进过程仍是一个复杂和困难的问题.虽然有许多研究者开发了一些不完美调试的软件可靠性增长模型,但是一般都是假设故障内容（总数）函数为线性、指数分布或者是与故障去除的数量成正比.这个假设与实际的软件调试过程中故障引进情况并不完全一致.提出一种基于Weibull分布引进故障的软件可靠性增长模型,考虑故障内容（总数）函数服从Weibull分布,并用相关的实验验证了提出的模型的拟合和预测性能.在用两个故障数据集进行的模拟实验中,实验结果指出：提出的模型和其他模型相比,有更好的拟合和预测性能以及更好的鲁棒性.     

一个基于响铃形故障检测率函数的软件可靠性增长模型

非齐次泊松过程类软件可靠性增长模型是评价软件产品可靠性指标的有效工具．影响软件可靠性增长模型评估和预测准确性的最重要的两个因素是软件中隐藏的初始故障数和故障检测率．一些非齐次泊松过程类模型假设故障检测率是不随测试时间变化的常量,有些模型假设故障检测率是增函数或减函数．这些假设或忽略了测试者的学习过程,或忽略了越迟被检测到的故障的概率就可能越低的特点．该文将测试者的学习过程和软件固有故障检测率的变化特征相结合,提出了一个铃形的故障检测率函数,建立了一个非齐次泊松过程类软件可靠性增长模型——Bbell—SRGM．在一组失效数据上的实验分析表明：对这组失效数据,Bbell—SRGM模型比G-O模型等的拟合效果更好．     

Considering the fault dependency concept with debugging time lag in software reliability growth modeling using a power function of testing time

Since the early 1970s tremendous growth has been seen in the research of software reliability growth modeling.In general, software reliability growth models (SRGMs) are applicable to the late stages of testing in software development and they can provide useful information about how to improve the reliability of software products.A number of SRGMs have been proposed in the literature to represent time-dependent fault identification/removal phenomenon;still new models are being proposed that could fit a greater number of reliability growth curves.Often,it is assumed that detected faults axe immediately corrected when mathematical models are developed.This assumption may not be realistic in practice because the time to remove a detected fault depends on the complexity of the fault,the skill and experience of the personnel,the size of the debugging team,the technique,and so on.Thus,the detected fault need not be immediately removed,and it may lag the fault detection process by a delay effect factor.In this paper,we first review how different software reliability growth models have been developed,where fault detection process is dependent not only on the number of residual fault content but also on the testing time,and see how these models can be reinterpreted as the delayed fault detection model by using a delay effect factor.Based on the power function of the testing time concept,we propose four new SRGMs that assume the presence of two types of faults in the software:leading and dependent faults.Leading faults are those that can be removed upon a failure being observed.However,dependent faults are masked by leading faults and can only be removed after the corresponding leading fault has been removed with a debugging time lag.These models have been tested on real software error data to show its goodness of fit,predictive validity and applicability.     

考虑不完美排错情况的NHPP 类软件可靠性增长模型

针对现有NHPP类软件可靠性增长模型对故障排错过程中不完美排错情况考虑不完全的现状,提出了一种新的软件可靠性增长模型.该模型全面考虑了不完美排错的两种情况:既考虑了排错过程中引入新错误的可能性,又考虑了不完全排错的情况,并且引入了一种故障排除率随时间变化的故障排除率函数,使模型更符合实际情况.利用公开发表的两组不同的软件失效数据对该模型进行验证的结果表明,与现有的对不完美排错情况考虑不完全的模型相比,该模型能够取得更好的拟合结果和预测效果.     

考虑不完美排错情况的NHPP 类软件可靠性增长模型

针对现有NHPP 类软件可靠性增长模型对故障排错过程中不完美排错情况考虑不完全的现状,提出了一 种新的软件可靠性增长模型.该模型全面考虑了不完美排错的两种情况:既考虑了排错过程中引入新错误的可能性, 又考虑了不完全排错的情况,并且引入了一种故障排除率随时间变化的故障排除率函数,使模型更符合实际情况.利 用公开发表的两组不同的软件失效数据对该模型进行验证的结果表明,与现有的对不完美排错情况考虑不完全的 模型相比,该模型能够取得更好的拟合结果和预测效果.     

一个NHPP类软件可靠性增长模型框架

NHPP类软件可靠性增长模型已经成为软件可靠性工程实践中非常成功的工具,从某些模型的一些共同特征出发,研究了NHPP类软件可靠性增长模型的有限通用框架,提出了一 个既考虑软件测试的不完美性、故障检测率随时间的变化,又考虑了故障改正效率随时间变化的NHPP类软件可靠性增长模型框架。一些已经存在的NHPP类软件可靠性增长模型型是这个框架的特例。     

考虑测试工作量与覆盖率的软件可靠性模型

为了进一步提升现有非齐次泊松过程类软件可靠性增长模型的拟合与预计精度,首先,提出一个同时考虑测试工作量与测试覆盖率的NHPP类软件可靠性建模框架.在此基础上,将变形S型测试工作量函数(IS-TEF)以及Logistic测试覆盖率函数(LO-TCF)带入该建模框架,建立了一个新的软件可靠性增长模型,即IS-LO-SRGM.同时,还对利用该框架进行建模过程中的两个重要问题进行了描述与分析,即如何确定具体的TEF和TCF以及模型参数估计.然后,在两组真实的失效数据集上,利用该建模框架建立了最为合适的增长模型,即IS-LO-SRGM,并将该模型与8种经典NHPP模型进行对比.实例验证结果表明,所提出的IS-LO-SRGM模型具有最为优秀的拟合与预计性能,从而证明新建模框架的有效性和实用性.最后,对不完美排错情况进行了初步的讨论与建模分析.     

不完美排错软件可靠性增长模型效用量化研究

为了进一步提升现有非齐次泊松过程类软件可靠性增长模型的拟合和预测性能,首先从故障总数增长趋势角度对不完美排错模型进行深入研究,提出两个一般性不完美排错框架模型,分别考虑了总故障数量函数与累计检测故障函数间的线性关系与微分关系,并求得累计检测的故障数量与软件中总故障数量函数表达式;其次,在六组真实的失效数据集上对比了提出的两种一般性不完美排错模型和六种不完美排错模型拟合预测性能表现。实例验证结果表明,提出的一般性不完美排错框架模型在大多数失效数据集上都具有优秀的拟合和预测性能,证明了新建模型的有效性和实用性;通过对提出的模型与其他不完美排错模型在数据集上的性能的深入分析,为实际应用中不完美排错模型的选择提出了建议。     

具有错误修复的非齐次马尔可夫模型

软件可靠性工程是对软件的质量进行管理和控制的实用性学科,而软件可靠性模型又是软件可靠性工程的基础之一,为了保证靠性模型的估测精度,好的软件可靠性模型应该包括对测试覆盖的说明,并且能够反映的错误修复过程。本文在基于测试覆盖的ＮＨＰＰ模型的基础上,讨论了一有反映软件错误修复过程的非齐次马尔可夫模型。     

考虑测试环境和实际运行环境的软件可靠性增长模型

软件可靠性增长模型中测试阶段和操作运行阶段环境的不同导致了两个阶段故障检测率的不同.非齐次泊松过程类软件可靠性增长模型是评价软件产品可靠性指标的有效工具.在一些非齐次泊松过程类模型中,有些学者提出了常量的环境因子,用来描述测试环境和运行环境的差别.实际上,环境因子应该是随时间变化的变量.考虑了运行阶段和测试阶段环境的不同,根据实测数据得到了变化的环境因子,并且根据测试阶段的故障检测率和变化的环境因子,转化得到了操作运行阶段的故障检测率.考虑到故障的排除效率和故障引入率,从而建立了一个既考虑运行环境和测试环境差别,又考虑故障排除效率和故障引入率的非齐次泊松过程类软件可靠性增长模型（PTEO-SRGM）.在两组失效数据上的实验分析表明,对这组失效数据,PTEO-SRGM模型比G-O模型等模型的拟合效果和预测能力更好.     

Imperfect debugging models with fault introduction rate for software reliability assessment

In general it is considered to be unrealistic in software reliability modelling to assume that the faults detected by software testing are perfectly removed without introducing new faults. In this paper we propose two software reliability assessment models with imperfect debugging by assuming that new faults are sometimes introduced when the faults originally latent in a software system are corrected and removed during the testing phase. It is assumed that the fault detection rate is proportional to the sum of the numbers of faults remaining originally in the system and faults introduced by imperfect debugging. These two models are described by a nonhomogeneous Poisson process. Several quantitative measures for reliability assessment are derived, and the maximum likelihood estimations of unknown model parameters are presented. Finally, numerical examples of software reliability analysis based on these two models are shown.     

可靠性模型中故障检测率研究述评

故障检测率FDR（Fault Detection Rate）是可靠性研究的关键要素,对于测试环境构建、故障检测效率提升、可靠性建模和可靠性增长具有重要作用,对于提高系统可靠性与确定发布时间具有重要现实意义.首先,对基于NHPP（Non-Homogeneous Poisson Process,非齐次泊松过程）类的软件可靠性增长模型SRGM（Software Reliability Growth Mode）进行概述,给出了建模本质、功用与流程.基于此,引出可靠性建模与研究中的关键参数——FDR,给出定义,对测试环境描述能力进行分析,展示不同模型的差异.着重剖析了FDR与失效强度、冒险率（风险率）的区别,得出三者之间的关联性表述.全面梳理了FDR的大类模型,分别从测试覆盖函数视角、直接设定角度、测试工作量函数参与构成方式三个方面进行剖析,继而提出统一的FDR相关的可靠性模型.考虑到对真实测试环境描述能力需要,建立不完美排错框架模型,衍生出不完美排错下多个不同FDR参与的可靠性增长模型.进一步,在12个真实描述应用场景与公开发表的失效数据集上进行实验,验证不同FDR模型相关的可靠性模型效用,对差异性进行分析与讨论.结果表明,FDR模型自身的性能可以支撑可靠性模型性能的提升.最后,指出了未来研究趋势和需要解决的问题.     

Robust feedforward and recurrent neural network based dynamic weighted combination models for software reliability prediction

Traditional parametric software reliability growth models (SRGMs) are based on some assumptions or distributions and none such single model can produce accurate prediction results in all circumstances. Non-parametric models like the artificial neural network (ANN) based models can predict software reliability based on only fault history data without any assumptions. In this paper, initially we propose a robust feedforward neural network (FFNN) based dynamic weighted combination model (PFFNNDWCM) for software reliability prediction. Four well-known traditional SRGMs are combined based on the dynamically evaluated weights determined by the learning algorithm of the proposed FFNN. Based on this proposed FFNN architecture, we also propose a robust recurrent neural network (RNN) based dynamic weighted combination model (PRNNDWCM) to predict the software reliability more justifiably. A real-coded genetic algorithm (GA) is proposed to train the ANNs. Predictability of the proposed models are compared with the existing ANN based software reliability models through three real software failure data sets. We also compare the performances of the proposed models with the models that can be developed by combining three or two of the four SRGMs. Comparative studies demonstrate that the PFFNNDWCM and PRNNDWCM present fairly accurate fitting and predictive capability than the other existing ANN based models. Numerical and graphical explanations show that PRNNDWCM is promising for software reliability prediction since its fitting and prediction error is much less relative to the PFFNNDWCM.     

考虑故障相关的软件可靠性增长模型研究

软件可靠性增长模型是用来评估和预测软件可靠性的重要工具.目前,绝大多数的软件可靠性增长模型并没有考虑故障之间的相关性,也没有考虑测试环境和运行环境的区别.文中提出了一种随机过程类非齐次泊松过程(NHPP)中的考虑故障相关性、测试环境和运行环境差别的模型.在两组失效数据上的实验分析表明:对这两组失效数据,文中提出的模型比其他一些非齐次泊松过程类模型的拟合效果和预测效果更好.     

Mathematical modeling of software reliability testing with imperfect debugging

Software reliability testing is concerned with the quantitative relationship between software testing and software reliability. Our previous work develops a mathematically rigorous modeling framework for software reliability testing. However the modeling framework is confined to the case of perfect debugging, where detected defects are removed without introducing new defects. In this paper the modeling framework is extended to the case of imperfect debugging and two models are proposed. In the first model it is assumed that debugging is imperfect and may make the number of remaining defects reduce by one, remain intact, or increase by one. In the second model it is assumed that when the number of remaining defects reaches the upper bound, the probability that the number of remaining defects is increased by one by debugging is zero. The expected behaviors of the cumulative number of observed failures and the number of remaining defects in the first model show that the software testing process may induce a linear or nonlinear dynamic system, depending on the relationship between the probability of debugging introducing a new defect and that of debugging removing a detected defect. The second-order behaviors of the first model also show that in the case of imperfect debugging, although there may be unbiased estimator for the initial number of defects remaining in the software under test, the cumulative number of observed failures and the current number of remaining defects are not sufficient for precisely estimating the initial number of remaining defects. This is because the variance of the unbiased estimator approaches a non-zero constant as the software testing process proceeds. This may be treated as an intrinsic principle of uncertainty for software testing. The expected behaviors of the cumulative number of observed failures and the number of remaining defects in the second model show that the software testing process may induce a nonlinear dynamic system. However theoretical analysis and simulation results show that, if defects are more often removed from than introduced into the software under test, the expected behaviors of the two models tend to coincide with each other as the upper bound of the number of remaining defects approaches infinity.     

SRGM下失效数据集效用与验证分析

针对软件可靠性增长模型SRGM研究中的参数拟合与性能评测对失效数据集FDS的依赖,对FDS在SRGM中的效用以及其对SRGM的影响进行深入研究,并给出FDS的不足与发布建议。首先给出了基于FDS的SRGM性能评测流程,提出一般化的不完美排错框架模型,对收集到的FDS进行结构化描述与归类分析。对7个典型的不完美排错相关的SRGM在公开发表的9个真实计算机工程系统FDSs上进行实验,从拟合与预测角度分析FDS与SRGM的关系及影响。从发布方与科研人员视角对当前FDS的不足进行分析,并据此给出了FDS的发布建议。研究结果表明,科研人员尚需要充分挖掘、分析FDS中待发布的更多测试信息,用以建立更为准确的SRGM。最后指出,描述新型软件结构以及含有更多数据量的FDS的缺乏已成为制约SRGM发展的主要客观事实。     

A study of the effect of imperfect debugging on software development cost

It is widely recognized that the debugging processes are usually imperfect. Software faults are not completely removed because of the difficulty in locating them or because new faults might be introduced. Hence, it is of great importance to investigate the effect of the imperfect debugging on software development cost, which, in turn, might affect the optimal software release time or operational budget. In this paper, a commonly used cost model is extended to the case of imperfect debugging. Based on this, the effect of imperfect debugging is studied. As the probability of perfect debugging, termed testing level here, is expensive to be increased, but manageable to a certain extent with additional resources, a model incorporating this situation is presented. Moreover, the problem of determining the optimal testing level is considered. This is useful when the decisions regarding the test team composition, testing strategy, etc., are to be made for more effective testing.     

Nonparametric dynamically weighted combination model to determine when to stop testing

Software manufacturers need to minimize the number of their software failures in their production environments. So, software reliability becomes a critical factor for these manufacturers to focus on. Software Reliability Growth Models (SRGMs) are used as indicators of the number of failures that may be faced after the shipping of the software and thus are indicators of the readiness of the software for shipping. SRGMs to handle varying operational profiles have been proposed by researchers earlier. However, as it is difficult to predict the nature of the project in advance, the reliability engineer has to try out each model one at a time before zeroing in on the model to be used in the project. We have derived a combination model, called dynamically weighted infinite NHPP combination, using the existing models for determining the release time. The nonparametric dynamically weighted combination model that we propose was validated and was found to be effective.