Copula density estimation by total variation penalized likelihood with linear equality constraints

A copula density is the joint probability density function (PDF) of a random vector with uniform marginals. An approach to bivariate copula density estimation is introduced that is based on maximum penalized likelihood estimation (MPLE) with a total variation (TV) penalty term. The marginal unity and symmetry constraints for copula density are enforced by linear equality constraints. The TV-MPLE subject to linear equality constraints is solved by an augmented Lagrangian and operator-splitting algorithm. It offers an order of magnitude improvement in computational efficiency over another TV-MPLE method without constraints solved by the log-barrier method for the second order cone program. A data-driven selection of the regularization parameter is through K-fold cross-validation (CV). Simulation and real data application show the effectiveness of the proposed approach. The MATLAB code implementing the methodology is available online.     

Computing the volume of a high-dimensional semi-unsupervised hierarchical copula

We propose an algorithm for the computation of the volume of a multivariate copula function (and the probability distribution of the counting variable linked to this multidimensional copula function), which is very complex for large dimensions. As is common practice for large dimensional problem, we restrict ourselves to positive orthant dependence and we construct a Hierarchical copula which describes the joint distribution of random variables accounting for dependence among them. This approach approximates a multivariate distribution function of heterogenous variables with a distribution of a fixed number of homogenous clusters, organized through a semi-unsupervised clustering method. These clusters, representing the second-level sectors of hierarchical copula function, are characterized by an into-sector dependence parameter determined by a method which is very similar to the Diversity Score method. The algorithm, implemented in MatLab^? code, is particularly efficient allowing us to treat cases with a large number of variables, as can be seen in our scalability analysis. As an application, we study the problem of valuing the risk exposure of an insurance company, given the marginals i.e. the risks of each policy.     

Conditional copulas, association measures and their applications

One way to model a dependence structure is through the copula function which is a mean to capture the dependence structure in the joint distribution of variables. Association measures such as Kendall’s tau or Spearman’s rho can be expressed as functionals of the copula. The dependence structure between two variables can be highly influenced by a covariate, and it is of real interest to know how this dependence structure changes with the value taken by the covariate. This motivates the need for introducing conditional copulas, and the associated conditional Kendall’s tau and Spearman’s rho association measures. After the introduction and motivation of these concepts, two nonparametric estimators for a conditional copula are proposed and discussed. Then nonparametric estimates for the conditional association measures are derived. A key issue is that these measures are now looked at as functions in the covariate. The performances of all estimators are investigated via a simulation study which also includes a data-driven algorithm for choosing the smoothing parameters. The usefulness of the methods is illustrated on two real data examples.     

Semiparametric bivariate Archimedean copulas

While parametric copulas often lack expressive capacity to capture the complex dependencies that are usually found in empirical data, non-parametric copulas can have poor generalization performance because of overfitting. A semiparametric copula method based on the family of bivariate Archimedean copulas is introduced as an intermediate approach that aims to provide both accurate and robust fits. The Archimedean copula is expressed in terms of a latent function that can be readily represented using a basis of natural cubic splines. The model parameters are determined by maximizing the sum of the log-likelihood and a term that penalizes non-smooth solutions. The performance of the semiparametric estimator is analyzed in experiments with simulated and real-world data, and compared to other methods for copula estimation: three parametric copula models, two semiparametric estimators of Archimedean copulas previously introduced in the literature, two flexible copula methods based on Gaussian kernels and mixtures of Gaussians and finally, standard parametric Archimedean copulas. The good overall performance of the proposed semiparametric Archimedean approach confirms the capacity of this method to capture complex dependencies in the data while avoiding overfitting.     

Quantile curves and dependence structure for bivariate distributions

Within the context of a general bivariate distribution an intuitive method is presented in order to study the dependence structure of the two distributions. A set of points—level curve—which accumulate the same probability for a fixed quadrant is considered. This procedure provides four level curves which can be considered as the boundary of a generalization of the real interquantile interval. It is shown that the accumulated probability among the level curves depends on the dependence structure of the distribution function where the dependence structure is given by the notion of copula. Furthermore, the case when the marginal distributions are independent is investigated. This result is used to find out positive or negative dependence properties for the variables. Finally, a nonparametric test for independence with a local dependence meaning is performed and applied to different data sets.     

Copula model evaluation based on parametric bootstrap

Copulas are used to model multivariate data as they account for the dependence structure and provide a flexible representation of the multivariate distribution. A great number of copulas has been proposed with various dependence aspects. One important issue is the choice of an appropriate copula from a large set of candidate families to model the data at hand. A large number of copulas are compared via likelihood principle, showing that it is hard to recognize the true underlying copula from real data since copulas with similar dependence properties are very close together. A goodness of fit test based on Mahalanobis squared distance between original and simulated log-likelihoods through parametric bootstrap techniques is also proposed. The advantage of this approach is that it is applicable to all families of copulas.     

Analyzing dependent proportions in cluster randomized trials: Modeling inter-cluster correlation via copula function

When two interventions are randomized to multiple sub-clusters within a whole cluster, accounting for the within sub-cluster (intra-cluster) and between sub-clusters (inter-cluster) correlations is needed to produce valid analyses of the effect of interventions. With the growing interest in copulas and their applications in statistical research, we demonstrate, through applications, how copula functions may be used to account for the correlation among responses across sub-clusters. Copulas having asymmetric dependence property may prove useful for modeling the relationship between random functions especially in clinical, health and environmental sciences where response data are in general skewed. These functions can in general be used to study scale-free measures of dependence, and they can be used as a starting point for constructing families of bivariate distributions, with a view to simulations. The core contribution of this paper is to provide an alternative approach for estimating the inter-cluster correlation using copula to accurately estimate the treatment effect when the outcome variable is measured on the dichotomous scale. Two data sets are used to illustrate the proposed methodology.     

Multivariate distributions with proportional reversed hazard marginals

Several univariate proportional reversed hazard models have been proposed in the literature. Recently, Kundu and Gupta (2010) proposed a class of bivariate models with proportional reversed hazard marginals. It is observed that the proposed bivariate proportional reversed hazard models have a singular component. In this paper we introduce the multivariate proportional reversed hazard models along the same manner. Moreover, it is observed that the proposed multivariate proportional reversed hazard model can be obtained from the Marshall–Olkin copula. The multivariate proportional reversed hazard models also have a singular component, and their marginals have proportional reversed hazard distributions. The multivariate ageing and the dependence properties are discussed in details. We further provide some dependence measure specifically for the bivariate case. The maximum likelihood estimators of the unknown parameters cannot be expressed in explicit forms. We propose to use the EM algorithm to compute the maximum likelihood estimators. One trivariate data set has been analysed for illustrative purposes.     

A Bayesian semi-parametric bivariate failure time model

In this paper we introduce a Bayesian semiparametric model for bivariate and multivariate survival data. The marginal densities are well-known nonparametric survival models and the joint density is constructed via a mixture. Our construction also defines a copula and the properties of this new copula are studied. We also consider the model in the presence of covariates and, in particular, we find a simple generalisation of the widely used frailty model, which is based on a new bivariate gamma distribution.     

A Bayesian semi-parametric bivariate failure time model

In this paper we introduce a Bayesian semiparametric model for bivariate and multivariate survival data. The marginal densities are well-known nonparametric survival models and the joint density is constructed via a mixture. Our construction also defines a copula and the properties of this new copula are studied. We also consider the model in the presence of covariates and, in particular, we find a simple generalisation of the widely used frailty model, which is based on a new bivariate gamma distribution.     

Adaptive-sparse polynomial chaos expansion for reliability analysis and design of complex engineering systems

This paper presents an adaptive-sparse polynomial chaos expansion (adaptive-sparse PCE) method for performing engineering reliability analysis and design. The proposed method combines three ideas: (i) an adaptive-sparse scheme to build sparse PCE with the minimum number of bivariate basis functions, (ii) a new projection method using dimension reduction techniques to effectively compute the expansion coefficients of system responses, and (iii) an integration of copula to handle nonlinear correlation of input random variables. The proposed method thus has three positive features for reliability analysis and design: (a) there is no need for response sensitivity analysis, (b) it is highly efficient and accurate for reliability analysis and its sensitivity analysis, and (c) it is capable of handling a nonlinear correlation. In addition to the features, an error decomposition scheme for the proposed method is presented to help analyze error sources in probability analysis. Several engineering problems are used to demonstrate the three positive features of the adaptive-sparse PCE method.     

Bivariate Beta–Inverse Weibull Distribution: Theory and Applications

Probability distributions have been in use for modeling of random phenomenon in various areas of life. Generalization of probability distributions has been the area of interest of several authors in the recent years. Several situations arise where joint modeling of two random phenomenon is required. In such cases the bivariate distributions are needed. Development of the bivariate distributions necessitates certain conditions, in a field where few work has been performed. This paper deals with a bivariate beta-inverse Weibull distribution. The marginal and conditional distributions from the proposed distribution have been obtained. Expansions for the joint and conditional density functions for the proposed distribution have been obtained. The properties, including product, marginal and conditional moments, joint moment generating function and joint hazard rate function of the proposed bivariate distribution have been studied. Numerical study for the dependence function has been implemented to see the effect of various parameters on the dependence of variables. Estimation of the parameters of the proposed bivariate distribution has been done by using the maximum likelihood method of estimation. Simulation and real data application of the distribution are presented.     

Testing the bivariate distribution of daily equity returns using copulas. An application to the Spanish stock market

The problem of the identification of dependencies between time series of equity returns is analyzed. Marginal distribution functions are assumed to be known, and a bivariate chi-square test of fit is applied in a fully parametric copula approach. Several marginal models and families of copulas are fitted and compared with Spanish stock market data. The results show the difficulty in adjusting the bivariate distribution of raw returns, and highlight the effect of a GARCH filtering in the selection of the best fitting copula.     

Modeling spot price dependence in Australian electricity markets with applications to risk management

We examine the dependence structure of electricity spot prices across regional markets in Australia. One of the major objectives in establishing a national electricity market was to provide a nationally integrated and efficient electricity market, limiting market power of generators in the separate regional markets. Our analysis is based on a GARCH approach to model the marginal price series in the considered regions in combination with copulae to capture the dependence structure between the marginals. We apply different copula models including Archimedean, elliptical and copula mixture models. We find a positive dependence structure between the prices for all considered markets, while the strongest dependence is exhibited between markets that are connected via interconnector transmission lines. Regarding the nature of dependence, the Student-t copula provides a good fit to the data, while the overall best results are obtained using copula mixture models due to their ability to also capture asymmetric dependence in the tails of the distribution. Interestingly, our results also suggest that for the four major markets, NSW, QLD, SA and VIC, the degree of dependence has decreased starting from the year 2008 towards the end of the sample period in 2010. Examining the Value-at-Risk of stylized portfolios constructed from electricity spot contracts in different markets, we find that the Student-t and mixture copula models outperform the Gaussian copula in a backtesting study. Our results are important for risk management and hedging decisions of market participants, in particular for those operating in several regional markets simultaneously.     

一种基于CDC的适用于高维数据的因果推断算法

一对观测变量之间的因果关系的推断是科学中的基本问题,基于观测数据分析提出因果关系的方法对于产生假设和加速科学发现具有实用价值。利用传统的因果推断算法从高维数据中学习因果网络结构和提高学习准确率是目前研究的难点。在引入耦合相关系数(copula dependence coefficient,CDC)的基础上,提出了一种适用于高维数据的两步骤因果推断算法。首先该算法利用优于最大信息系数的CDC对变量间的关联度进行检测,寻找目标节点的父子节点集;然后使用非线性最小二乘独立回归算法,为图中的目标节点与其父子节点之间标注因果方向;最后迭代所有的节点完成完整的因果网络结构。实验结果表明,该算法提高了高维数据下因果网络结构学习的准确率。同时在大样本数据集中,该算法的时间复杂度优于传统算法,对异常值具有鲁棒性。     

Smooth semiparametric and nonparametric Bayesian estimation of bivariate densities from bivariate histogram data

Penalized B-splines combined with the composite link model are used to estimate a bivariate density from a histogram with wide bins. The goals are multiple: they include the visualization of the dependence between the two variates, but also the estimation of derived quantities like Kendall’s tau, conditional moments and quantiles. Two strategies are proposed: the first one is semiparametric with flexible margins modeled using B-splines and a parametric copula for the dependence structure; the second one is nonparametric and is based on Kronecker products of the marginal B-spline bases. Frequentist and Bayesian estimations are described. A large simulation study quantifies the performances of the two methods under different dependence structures and for varying strengths of dependence, sample sizes and amounts of grouping. It suggests that Schwarz’s BIC is a good tool for classifying the competing models. The density estimates are used to evaluate conditional quantiles in two applications in social and in medical sciences.     

并发程序切片原型系统的设计与实现

并发程序切片是并发程序分析的一种重要手段。针对多线程共享变量通信机制,在通过程序分析工具CodeSurfer获取程序基本信息的基础上构造程序可达图,生成以程序状态和语句二元组为节点的并发程序依赖图,实现了基于程序可达图的并发程序切片原型系统。初步实验结果表明,与传统的切片方法相比,采用基于程序可达图的并发程序切片方法,可有效地解决依赖关系不可传递问题,获得高精度的并发程序切片。     

Efficient estimation of a semiparametric dynamic copula model

A new semiparametric dynamic copula model is proposed where the marginals are specified as parametric GARCH-type processes, and the dependence parameter of the copula is allowed to change over time in a nonparametric way. A straightforward two-stage estimation method is given by local maximum likelihood for the dependence parameter, conditional on consistent first stage estimates of the marginals. First, the properties of the estimator are characterized in terms of bias and variance and the bandwidth selection problem is discussed. The proposed estimator attains the semiparametric efficiency bound and its superiority is demonstrated through simulations. Finally, the wide applicability of the model in financial time series is illustrated, and it is compared with traditional models based on conditional correlations.     

A new algorithm based on copulas for VaR valuation with empirical calculations

This paper concerns the application of copula functions in VaR valuation. The copula function is used to model the dependence structure of multivariate assets. After the introduction of the traditional Monte Carlo simulation method and the pure copula method we present a new algorithm based on mixture copula functions and the dependence measure, Spearman’s rho. This new method is used to simulate daily returns of two stock market indices in China, Shanghai Stock Composite Index and Shenzhen Stock Composite Index, and then empirically calculate six risk measures including VaR and conditional VaR. The results are compared with those derived from the traditional Monte Carlo method and the pure copula method. From the comparison we show that the dependence structure between asset returns plays a more important role in valuating risk measures comparing with the form of marginal distributions.