Vine copulas for mixed data : multi-view clustering for mixed data beyond meta-Gaussian dependencies

Copulas enable flexible parameterization of multivariate distributions in terms of constituent marginals and dependence families. Vine copulas, hierarchical collections of bivariate copulas, can model a wide variety of dependencies in multivariate data including asymmetric and tail dependencies which the more widely used Gaussian copulas, used in Meta-Gaussian distributions, cannot. However, current inference algorithms for vines cannot fit data with mixed—a combination of continuous, binary and ordinal—features that are common in many domains. We design a new inference algorithm to fit vines on mixed data thereby extending their use to several applications. We illustrate our algorithm by developing a dependency-seeking multi-view clustering model based on Dirichlet Process mixture of vines that generalizes previous models to arbitrary dependencies as well as to mixed marginals. Empirical results on synthetic and real datasets demonstrate the performance on clustering single-view and multi-view data with asymmetric and tail dependencies and with mixed marginals.     

Archimedean copula estimation using Bayesian splines smoothing techniques

Copulas enable to specify multivariate distributions with given marginals. Various parametric proposals were made in the literature for these quantities, mainly in the bivariate case. They can be systematically derived from multivariate distributions with known marginals, yielding e.g. the normal and the Student copulas. Alternatively, one can restrict his/her interest to a sub-family of copulas named Archimedean. They are characterized by a strictly decreasing convex function on (0,1) which tends to +∞ at 0 (when strict) and which is 0 at 1. A ratio approximation of the generator and of its first derivative using B-splines is proposed and the associated parameters estimated using Markov chains Monte Carlo methods. The estimation is reasonably quick. The fitted generator is smooth and parametric. The generated chain(s) can be used to build “credible envelopes” for the above ratio function and derived quantities such as Kendall's tau, posterior predictive probabilities, etc. Parameters associated to parametric models for the marginals can be estimated jointly with the copula parameters. This is an interesting alternative to the popular two-step procedure which assumes that the regression parameters are fixed known quantities when it comes to copula parameter(s) estimation. A simulation study is performed to evaluate the approach. The practical utility of the method is illustrated by a basic analysis of the dependence structure underlying the diastolic and the systolic blood pressures in male subjects.     

The bivariate generalized linear failure rate distribution and its multivariate extension

The two-parameter linear failure rate distribution has been used quite successfully to analyze lifetime data. Recently, a new three-parameter distribution, known as the generalized linear failure rate distribution, has been introduced by exponentiating the linear failure rate distribution. The generalized linear failure rate distribution is a very flexible lifetime distribution, and the probability density function of the generalized linear failure rate distribution can take different shapes. Its hazard function also can be increasing, decreasing and bathtub shaped. The main aim of this paper is to introduce a bivariate generalized linear failure rate distribution, whose marginals are generalized linear failure rate distributions. It is obtained using the same approach as was adopted to obtain the Marshall-Olkin bivariate exponential distribution. Different properties of this new distribution are established. The bivariate generalized linear failure rate distribution has five parameters and the maximum likelihood estimators are obtained using the EM algorithm. A data set is analyzed for illustrative purposes. Finally, some generalizations to the multivariate case are proposed.     

Multivariate distributions with proportional reversed hazard marginals

Several univariate proportional reversed hazard models have been proposed in the literature. Recently, Kundu and Gupta (2010) proposed a class of bivariate models with proportional reversed hazard marginals. It is observed that the proposed bivariate proportional reversed hazard models have a singular component. In this paper we introduce the multivariate proportional reversed hazard models along the same manner. Moreover, it is observed that the proposed multivariate proportional reversed hazard model can be obtained from the Marshall–Olkin copula. The multivariate proportional reversed hazard models also have a singular component, and their marginals have proportional reversed hazard distributions. The multivariate ageing and the dependence properties are discussed in details. We further provide some dependence measure specifically for the bivariate case. The maximum likelihood estimators of the unknown parameters cannot be expressed in explicit forms. We propose to use the EM algorithm to compute the maximum likelihood estimators. One trivariate data set has been analysed for illustrative purposes.     

Optimal dynamic hedging via copula-threshold-GARCH models

The contribution of this paper is twofold. First, we exploit copula methodology, with two threshold GARCH models as marginals, to construct a bivariate copula-threshold-GARCH model, simultaneously capturing asymmetric nonlinear behaviour in univariate stock returns of spot and futures markets and bivariate dependency, in a flexible manner. Two elliptical copulas (Gaussian and Student's-t) and three Archimedean copulas (Clayton, Gumbel and the Mixture of Clayton and Gumbel) are utilized. Second, we employ the presenting models to investigate the hedging performance for five East Asian spot and futures stock markets: Hong Kong, Japan, Korea, Singapore and Taiwan. Compared with conventional hedging strategies, including Engle's dynamic conditional correlation GARCH model, the results show that hedge ratios constructed by a Gaussian or Mixture copula are the best-performed in variance reduction for all markets except Japan and Singapore, and provide close to the best returns on a hedging portfolio over the sample period.     

Estimating the parameters of the Marshall-Olkin bivariate Weibull distribution by EM algorithm

In this paper we consider the Marshall-Olkin bivariate Weibull distribution. The Marshall-Olkin bivariate Weibull distribution is a singular distribution, whose both the marginals are univariate Weibull distributions. This is a generalization of the Marshall-Olkin bivariate exponential distribution. The cumulative joint distribution of the Marshall-Olkin bivariate Weibull distribution is a mixture of an absolute continuous distribution function and a singular distribution function. This distribution has four unknown parameters and it is observed that the maximum likelihood estimators of the unknown parameters cannot be obtained in explicit forms. In this paper we discuss about the computation of the maximum likelihood estimators of the unknown parameters using EM algorithm. We perform some simulations to see the performances of the EM algorithm and re-analyze one data set for illustrative purpose.     

Quantile curves and dependence structure for bivariate distributions

Within the context of a general bivariate distribution an intuitive method is presented in order to study the dependence structure of the two distributions. A set of points—level curve—which accumulate the same probability for a fixed quadrant is considered. This procedure provides four level curves which can be considered as the boundary of a generalization of the real interquantile interval. It is shown that the accumulated probability among the level curves depends on the dependence structure of the distribution function where the dependence structure is given by the notion of copula. Furthermore, the case when the marginal distributions are independent is investigated. This result is used to find out positive or negative dependence properties for the variables. Finally, a nonparametric test for independence with a local dependence meaning is performed and applied to different data sets.     

Comorbidity of chronic diseases in the elderly: Patterns identified by a copula design for mixed responses

Joint modeling of multiple health related random variables is essential to develop an understanding for the public health consequences of an aging population. This is particularly true for patients suffering from multiple chronic diseases. The contribution is to introduce a novel model for multivariate data where some response variables are discrete and some are continuous. It is based on pair copula constructions (PCCs) and has two major advantages over existing methodology. First, expressing the joint dependence structure in terms of bivariate copulas leads to a computationally advantageous expression for the likelihood function. This makes maximum likelihood estimation feasible for large multidimensional data sets. Second, different and possibly asymmetric bivariate (conditional) marginal distributions are allowed which is necessary to accurately describe the limiting behavior of conditional distributions for mixed discrete and continuous responses. The advantages and the favorable predictive performance of the model are demonstrated using data from the Second Longitudinal Study of Aging (LSOA II).     

Efficient simulation of a bivariate exponential conditionals distribution

The bivariate distribution with exponential conditionals (BEC) is introduced by Arnold and Strauss [1988. Bivariate distributions with exponential conditionals, J. Amer. Statist. Assoc. 83, 522-527]. This work presents a simple and fast algorithm for simulating random variates from this density.     

DALASS: Variable selection in discriminant analysis via the LASSO

The objective of DALASS is to simplify the interpretation of Fisher's discriminant function coefficients. The DALASS problem—discriminant analysis (DA) modified so that the canonical variates satisfy the LASSO constraint—is formulated as a dynamical system on the unit sphere. Both standard and orthogonal canonical variates are considered. The globally convergent continuous-time algorithms are illustrated numerically and applied to some well-known data sets.     

Impact of the shape of demand distribution in decision models for operations management

Decision support tools are increasingly used in operations where key decision inputs such as demand, quality, or costs are uncertain. Often such uncertainties are modeled with probability distributions, but very little attention is given to the shape of the distributions. For example, state-of-the-art planning systems have weak, if any, capabilities to account for the distribution shape. We consider demand uncertainties of different shapes and show that the shape can considerably change the optimal decision recommendations of decision models. Inspired by discussions with a leading consumer electronics manufacturer, we analyze how four plausible demand distributions affect three representative decision models that can be employed in support of inventory management, supply contract selection and capacity planning decisions. It is found, for example, that in supply contracts flexibility is much more appreciated if demand is negatively skewed, i.e., has downside potential, compared to positively skewed demand. We then analyze the value of distributional information in the light of these models to find out how the scope of improvement actions that aim to decrease demand uncertainty vary depending on the decision to be made. Based on the results, we present guidelines for effective utilization of probability distributions in decision models for operations management.     

Sklar's Theorem in Finite Settings

This paper deals with the well-known Sklar's theorem, which shows how joint distribution functions are related to their marginals by means of copulas. The main goal is to prove a discrete version of this theorem involving copula-like operators defined on a finite chain, that will be called discrete copulas. First, the idea of subcopulas in this finite setting is introduced and the problem of extending a subcopula to a copula is solved. This is precisely the key point which allows to state and prove the discrete version of Sklar's theorem.     

Semiparametric bivariate Archimedean copulas

While parametric copulas often lack expressive capacity to capture the complex dependencies that are usually found in empirical data, non-parametric copulas can have poor generalization performance because of overfitting. A semiparametric copula method based on the family of bivariate Archimedean copulas is introduced as an intermediate approach that aims to provide both accurate and robust fits. The Archimedean copula is expressed in terms of a latent function that can be readily represented using a basis of natural cubic splines. The model parameters are determined by maximizing the sum of the log-likelihood and a term that penalizes non-smooth solutions. The performance of the semiparametric estimator is analyzed in experiments with simulated and real-world data, and compared to other methods for copula estimation: three parametric copula models, two semiparametric estimators of Archimedean copulas previously introduced in the literature, two flexible copula methods based on Gaussian kernels and mixtures of Gaussians and finally, standard parametric Archimedean copulas. The good overall performance of the proposed semiparametric Archimedean approach confirms the capacity of this method to capture complex dependencies in the data while avoiding overfitting.     

Plugging the holes in host-based authentication

Many of the most popular computer and network authentication schemes commonly in use today are surprisingly weak. Some progress has been made in recent years, though stronger schemes have yet to be widely adopted. The problems are partly technical — a variety of mechanisms have been invented; partly political — the not invented here syndrome; and partly Political — government attitudes towards cryptographic technology.In this paper, the vulnerabilities in commonly used authentication schemes are discussed. An overview of the emerging technologies and some of the problems they solve — and cause! — is also presented.     

Copula-Like Operations on Finite Settings

This paper deals with discrete copulas considered as a class of binary aggregation operators on a finite chain. A representation theorem by means of permutation matrices is given. From this characterization, we study the structure of associative discrete copulas and a theorem of decomposition of any discrete copula in terms of associative discrete copulas is obtained. Finally, some aspects concerning their extension to copulas are dealt with.     

Sampling algorithms for generating joint uniform distributions using the vine-copula method

An n-dimensional joint uniform distribution is defined as a distribution whose one-dimensional marginals are uniform on some interval I. This interval is taken to be [0,1] or, when more convenient . The specification of joint uniform distributions in a way which captures intuitive dependence structures and also enables sampling routines is considered. The question whether every n-dimensional correlation matrix can be realized by a joint uniform distribution remains open. It is known, however, that the rank correlation matrices realized by the joint normal family are sparse in the set of correlation matrices. A joint uniform distribution is obtained by specifying conditional rank correlations on a regular vine and a copula is chosen to realize the conditional bivariate distributions corresponding to the edges of the vine. In this way a distribution is sampled which corresponds exactly to the specification. The relation between conditional rank correlations on a vine and correlation matrix of corresponding distribution is complex, and depends on the copula used. Some results for the elliptical copulae are given.     

The effects of misspecified marginals and copulas on computing the value at risk: A Monte Carlo study

The effect on the estimation of the Value at Risk when dealing with multivariate portfolios when there is a misspecification both in the marginals and in the copulas is investigated. It is first shown that, when there is skewness in the data and symmetric marginals are used, the estimated elliptical (normal or t) copula correlations are negatively biased, reaching values as high as 70% of the true values. Besides, the bias almost doubles if negative correlations are considered, compared to positive correlations. As for the t copula degrees of freedom parameter, the use of wrong marginals delivers large positive biases, instead. If the dependence structure is represented by a copula which is not elliptical, e.g. the Clayton copula, the effects of marginal misspecifications on the copula parameter estimation can be rather different, depending on the sign of marginal skewness. Extensive Monte Carlo studies then show that the misspecifications in the marginal volatility equation more than offset the biases in copula parameters when VaR forecasting is of concern, small samples are considered and the data are leptokurtic. The biases in the volatility parameters are much smaller, whereas those ones in the copula parameters remain almost unchanged or even increase when the sample dimension increases. In this case, copula misspecifications do play a role for VaR estimation. However, these effects depend heavily on the sign of the dependence.     

A goodness-of-fit test for normality based on polynomial regression

Statistical models are often based on normal distributions and procedures for testing such distributional assumption are needed. Many goodness-of-fit tests are available. However, most of them are quite insensitive in detecting non-normality when the alternative distribution is symmetric. On the other hand all the procedures are quite powerful against skewed alternatives. A new test for normality based on a polynomial regression is presented. It is very effective in detecting non-normality when the alternative distribution is symmetric. A comparison between well known tests and this new procedure is performed by simulation study. Other properties are also investigated.     

Testing the bivariate distribution of daily equity returns using copulas. An application to the Spanish stock market

The problem of the identification of dependencies between time series of equity returns is analyzed. Marginal distribution functions are assumed to be known, and a bivariate chi-square test of fit is applied in a fully parametric copula approach. Several marginal models and families of copulas are fitted and compared with Spanish stock market data. The results show the difficulty in adjusting the bivariate distribution of raw returns, and highlight the effect of a GARCH filtering in the selection of the best fitting copula.