Hybridizing mixtures of experts with support vector machines: Investigation into nonlinear dynamic systems identification

Mixture of experts (ME) models comprise a family of modular neural network architectures aiming at distilling complex problems into simple subtasks. This is done by deploying a separate gating module for softly dividing the input space into overlapping regions to be each assigned to one or more expert networks. Conversely, support vector machines (SVMs) refer to kernel-based methods, neural-network-alike models that constitute an approximate implementation of the structural risk minimization principle. Such learning machines follow the simple, but powerful idea of nonlinearly mapping input data into high-dimensional feature spaces wherein a linear decision surface discriminating different regions is properly designed. In this work, we formally characterize and empirically evaluate a novel approach, named as Mixture of Support Vector Machine Experts (MSVME), whose main purpose is to combine the complementary properties of both SVM and ME models. In the formal characterization, an algorithm based on a maximum likelihood criterion is considered for the MSVME training, and we demonstrate that it is possible to train each expert based on an SVM perspective. Regarding the empirical evaluation, simulation results involving nonlinear dynamic system identification problems are reported, contrasting the performance shown by the MSVME approach with that exhibited by conventional SVM and ME models.     

Recurrent neuro-controller design for an inverted pendulum using evolution strategy

Using block-pulse functions, a new method of identifying a single-input single-output dynamic system is presented. The input-output record is expressed in a block-pulse series which transforms the differential equation of the dynamic system into a computationally convenient algebraic form. Compared with the Walsh function approach, the proposed method is simpler to compute, is more suitable for computer programming and provides the same accuracy.     

Trans-situated use of integrated information systems

Practice-based perspectives have established the situated nature of how technology is appropriated, enacted, and improvised in organisations. Empirical studies demonstrate how the same technology produces different results in different contexts of use. However, practice-based research has, to date, less to offer in terms of accounting for the relationship between instances of situated use (i.e., work practices) that are separated in space and/or time. The term trans-situated use is intended to highlight this blind spot. We focus on one type of relationship, viz., significant degrees of similarities between technologically mediated, geographically dispersed work practices. This degree of similarity is achieved through a process of commensurability consisting of (i) standardisation (addressing interdependencies between multiple instances of the ‘same’ work practice at geographically dispersed sites); and (ii) heterogeneity (addressing the entanglement of one work practice with apparently unrelated work practices and modules). Empirically, we report on a longitudinal, interpretative case study (1998–2004) of a company strategically targeting an integrated information system as a principal vehicle to establish similar services globally.     

BAIS: A Bayesian Artificial Immune System for the effective handling of building blocks

Significant progress has been made in theory and design of Artificial Immune Systems (AISs) for solving hard problems accurately. However, an aspect not yet widely addressed by the research reported in the literature is the lack of ability of the AISs to deal effectively with building blocks (partial high-quality solutions coded in the antibody). The available AISs present mechanisms for evolving the population that do not take into account the relationship among the variables of the problem, potentially causing the disruption of high-quality partial solutions. This paper proposes a novel AIS with abilities to identify and properly manipulate building blocks in optimization problems. Instead of using cloning and mutation to generate new individuals, our algorithm builds a probabilistic model representing the joint probability distribution of the promising solutions and, subsequently, uses this model for sampling new solutions. The probabilistic model used is a Bayesian network due to its capability of properly capturing the most relevant interactions among the variables. Therefore, our algorithm, called Bayesian Artificial Immune System (BAIS), represents a significant attempt to improve the performance of immune-inspired algorithms when dealing with building blocks, and hence to solve efficiently hard optimization problems with complex interactions among the variables. The performance of BAIS compares favorably with that produced by contenders such as state-of-the-art Estimation of Distribution Algorithms.     

Pattern classification with mixtures of weighted least-squares support vector machine experts

Support Vector Machine (SVM) classifiers are high-performance classification models devised to comply with the structural risk minimization principle and to properly exploit the kernel artifice of nonlinearly mapping input data into high-dimensional feature spaces toward the automatic construction of better discriminating linear decision boundaries. Among several SVM variants, Least-Squares SVMs (LS-SVMs) have gained increased attention recently due mainly to their computationally attractive properties coming as the direct result of applying a modified formulation that makes use of a sum-squared-error cost function jointly with equality, instead of inequality, constraints. In this work, we present a flexible hybrid approach aimed at augmenting the proficiency of LS-SVM classifiers with regard to accuracy/generalization as well as to hyperparameter calibration issues. Such approach, named as Mixtures of Weighted Least-Squares Support Vector Machine Experts, centers around the fusion of the weighted variant of LS-SVMs with Mixtures of Experts models. After the formal characterization of the novel learning framework, simulation results obtained with respect to both binary and multiclass pattern classification problems are reported, ratifying the suitability of the novel hybrid approach in improving the performance issues considered.     

Muscular capabilities and workload of flight attendants for pushing and pulling trolleys aboard aircraft

Increasingly in the recent years, passengers’ services are extended into the ascent and descent flight phases on short distance flights. Trolleys containing the required meal and beverage items are used for these service operations and pushed or pulled along the aisles of the aircraft. Flight attendants reported about increased musculo-skeletal disorders and had been complaining about high physical workload from handling trolleys. In order to ensure acceptable load levels for pushing or pulling operations of trolleys, the physical capabilities of the collective “flight attendants” had been investigated by means of force measurements at maximum voluntary contraction (MVC) level and associated relevant anthropometrical and biometrical data. CEN and ISO standards as well as international and national German methods were used to derive recommended force limits for pushing/pulling operations with respect to the physical capabilities of the target group “flight attendants”. Comparing these recommended limits with the force requirements per shift under various conditions of trolley handlings (inclination of the floor, type and weight of trolley, mode of handling, frequency of operation) showed that especially for higher floor inclinations and trolley weights, flight attendants work (substantially) above recommended limits. It became also apparent that the handling of half-size trolleys is unexpectedly high demanding due to high vertical force components, caused by the unfavorable location of their center of gravity.

Relevance to industry

On short-distance flights, passengers’ services are performed by means of trolleys from the ascent to the descent flight phases. Flight attendants had been complaining about high physical workload. This study offers recommendations on maximum force limits for the handling of trolleys with respect to the muscular capacities and work situations of flight attendants on short-distance flights.     

A new approach to inversion-based feedforward control design for nonlinear systems

The finite-time transition between stationary setpoints of nonlinear SISO systems is considered as a scenario for the presentation of a new design approach for inversion-based feedforward control. Design techniques which are based on a stable system inversion result in input trajectories with pre- and/or post-actuation intervals. The presented approach treats the considered transition task as a two-point boundary value problem (BVP) and yields causal feedforward trajectories, which are constant outside the transition interval. The main idea of this approach is to provide free parameters in the desired output trajectory to solve the BVP of the internal dynamics. Thereby, a standard MATLAB function can be used for the numerical solution of the BVP. Feedforward control design techniques are illustrated by simulation results for a simple example.     

Microstructure and properties of a composite system for dental applications composed of glass-ceramics in the SiO2–Li2O–ZrO2–P2O5 system and ZrO2-ceramic (TZP)

The objective of the study was to develop a biocompatible composite system which was composed of TZP-ceramic (tetragonal zirconia polycrystals, ZrO₂ stabilized with 3 mol% Y₂O₃) and two glass-ceramics of the SiO₂–Li₂O–ZrO₂–P₂O₅ type. The metal-free composite system would satisfy the translucency, the biocompatibility and the strength requirements of dentistry. The two glass-ceramics of the SiO₂–Li₂O–ZrO₂–P₂O₅ type with a content of 15 and 20 wt% ZrO₂ respectively, were chemically and physically adapted to TZP-ceramic. The glass-ceramics were used as a dentin buildup material. The TZP-ceramic had the function of a root post. The shape of the post was cylindrical with a conical tip. The composite system was easy to process through viscous flow of the glass-ceramic at 900 and 1000°C, respectively. The microstructure and the mechanical properties of two glass-ceramics of the SiO₂–Li₂O–ZrO₂–P₂O₅ type were examined therefore.     

Texture and residual strain in two SiC/Ti-6-2-4-2 titanium composites

Residual strain and texture variations were measured in two titanium matrix composites reinforced with silicon carbide fibers (Ti/SiC) of similar composition but fabricated by different processing routes. Each composite comprised a Ti-6242 α/β matrix alloy containing vol 35 pct continuous SiC fibers. In one, the matrix was produced by a plasma sprayed (PS) route, and in the other by a wiredrawn (WD) process. The PS and WD composites were reinforced with SCS-6 (SiC) and Trimarc (SiC) fibers, respectively. The texture in the titanium matrices differed significantly. The titanium matrix for the PS material exhibited random texture pre and post fabrication of the composite. For the WD material, the starting texture of the monolithic titanium matrix was ≈17 times random, but after consolidation into composite form, it was ≈6 times random. No significant differences were noted in the fiber-induced matrix residual strains between the composites prepared by the two procedures. However, the Trimarc (WD) fibers recorded higher (≈1.3 times) compressive strains than the SCS-6 (PS) fibers. Stresses and stress balance results are reported. Plane-specific elastic moduli, measured in load tests on the unreinforced matrices, showed little difference. This article is based on a presentation made in the Symposium “Mechanisms and Mechanics of Composites Fracture” held October 11–15, 1998, at the TMS Fall Meeting in Rosemont, Illinois, under the auspices of the TMS-SMD/ASM-MSCTS Composite Materials Committee.     

Faster to Sound Parts by Advanced Forming Process Simulation ‐ Advanced Forming Process Model Including the Elastic Effects of the Forming Press and Tool

This article addresses process, stamping, and manufacturing engineers, as well as tool designers (prototype and series production tools), and press shop planners in the range of metal forming. The paper deals with methods of modelling and simulating the metal forming process and their application in product design, production, and forming process planning. In models usually applied major effects on the forming process are neglected. For instance, the elastic behaviour of presses and die tools is not considered in process and tool planning. Thus, reworking of tools is a consequence of this model oversimplification. The paper illustrates how interactions between forming press, die tool and metal forming processes can be modelled by enhancing conventional FE models. Several examples demonstrate the information value of the Advanced Forming Process Model (AFPM).