Ergonomic postural assessment using a new open-source human pose estimation technology (OpenPose)

Observational ergonomic postural assessment methods have been commonly used to evaluate the risks of musculoskeletal disorders. Researchers have proposed semi-automatic methods using Kinect, known for limitations with body occlusions and non-frontal tracking. Meanwhile, new human pose estimation methods have been actively developed, and a popular open-source technology is OpenPose. This study aims to propose the OpenPose-based system for computing joint angles and RULA/REBA scores and validate against the reference motion capture system, and compare its performance to the Kinect-based system. Recordings of 10 participants performing 12 experimental tasks under different conditions: with/without body occlusions and tracked from frontal/non-frontal views were analyzed. OpenPose showed good performance under all task conditions, whereas Kinect performed significantly worse than OpenPose especially at cases with body occlusions or non-frontal tracking. The findings suggested that OpenPose could be a promising technology to measure joint angles and conduct semi-automatic ergonomic postural assessments in the real workspace where the conditions are often non-ideal.     

Visual inspection with augmented reality head-mounted display: An Australian usability case study

Augmented reality (AR) is an Industry 4.0 technology. For more than a decade, advancements in AR technology and their applications have been expected to revolutionise the manufacturing industry and deliver quality and productivity gains. However, due to factors such as equipment costs, skills shortages and technological limitations of AR devices, operational deployment beyond prototypes has been constrained. Real-world, usability studies can explore barriers to implementation and improve system design. This paper details a mixed method usability case study of an AR head-mounted display (HMD) to perform a short, simple visual inspection task. Twenty-two participants from South Australian manufacturing businesses inspected a pump and pipe skid while working at height. Overall, workload demands for the task were considered acceptable and just below the “low” workload threshold (NASA Task Load Index, mean = 29.3) and the system usability was rated “average” (system usability scale, mean = 68.5). The results suggest the task did not place too high a burden on users and was an appropriate initial exposure to AR HMDs, but further refinement to the interface would be desirable before implementation to minimise frustration and promote learning. Users were enthusiastic and open-minded about the AR HMD although results indicate that even with recent advancements in AR HMD technology, interactions between the task, technology and environment continue to cause human and technical challenges—some of which are relatively straightforward to address but others are dependent on larger-scale efforts.     

Novel thoraco-lumbo-sacral corset design increases Biering-Sorensen back endurance and alters knee and ankle angles during a box lifting task

Research investigating lumbosacral corset designs and their effects are limited and conflicting. The objective was to compare thoraco-lumbo-sacral support corsets (polyester/nylon: TLSSC-poly and neoprene: TLSSC-neo) with a traditional model (TRAD) and Control. Twenty male, university-aged, healthy, recreationally active, participants performed Biering-Sorensen back endurance (BS) test and box lifting tasks (BL:30 repetitions using 20% body mass). Lower and upper erector spinae and hamstrings electromyography (EMG); trunk-hip, knee, and ankle kinematics as well as endurance time were monitored. With BL, the TLSSC-poly (121.4°±17.9) exhibited 1.9% (p = 0.01), 2.7% (p = 0.003), and 3.7% (p = 0.0003) greater knee flexion than TRAD (119.1°±17.5), TLSSC-neo (116.8°±17.4) and Control (120.1°±17.6) respectively. The TLSSC-poly (101.9°± 8.9) demonstrated significant 3.5% (p = 0.005), 2.2% (p = 0.002) and 1.4% (p = 0.01) greater dorsiflexion than TRAD (103.4°±8.7), TLSSC-neo (104.2°±9.8) and Control (105.7°±7.2) respectively. With BS, TLSSC-poly (137.4-s±31.2, 9.7%, p = 0.018) and TLSSC-neo (133.8-s±32.3, 9.2%, p = 0.006) exhibited significantly longer durations than Control (124.8-s±29.8). Relevance to industry: The TLSSC increased BS endurance and TLSSC-poly increased BL knee and ankle angles, possibly providing benefits for workers, with repeated actions over a full work day.     

Visually deficient working conditions and reduced work performance in office workers: Is it mediated by visual discomfort?

IntroductionThe main purpose of this cross-sectional study was to investigate whether visual discomfort acts as a mediating factor between perceived visual ergonomic working conditions and self-rated visual performance among office workers who carry out administrative tasks and computer-based work at the Swedish Tax Agency.MethodsA questionnaire was sent to 94 office workers addressing: 1) perceived visual quality of the visual display units; 2) prevalence of eye symptoms; and 3) self-rated visual performance. Eighty-six persons (54 women (63%), 31 men (36%), and 1 of unspecified sex) answered the questionnaire. Multiple regression analysis investigated the association between visual ergonomic working conditions and visual performance, both with and without visual discomfort as a mediator.ResultsThe group mean of the Indexed survey questions indicated a reasonably good quality of visual ergonomic working conditions, a relative absence of eye symptoms, and acceptable self-rated visual performance. Results from multiple regression analysis showed a significant association between perceived visual ergonomic working conditions and self-rated visual performance (r² = 0.30, β = 0.327, p < 0.01). When visual discomfort was used as a mediator, the association between perceived visual ergonomic working conditions and self-rated visual performance remained the same (r² = 0.32, β = 0.315, p < 0.01).DiscussionIt was remarkable to discover that self-rated visual performance was independent of visual discomfort. Possible explanations include exposure factors not included in the current study, such as dry air and sensory irritation in the eyes, psychosocial stress, time spent performing near work activities, or time exposed to visually deficient working conditions.Relevance to industryThe strong connection between satisfaction with visual ergonomic working conditions and productivity in this study has implications for workplace profitability and staff satisfaction. If productivity is enhanced by better visual ergonomic working conditions, then managers of workplaces may be able to improve work outcomes by optimizing the physical work environment.     

A review of digital twin in product design and development

In the era of digitalization, there are many emerging technologies, such as the Internet of Things (IoT), Digital Twin (DT), Cloud Computing and Artificial Intelligence (AI), which are quickly developped and used in product design and development. Among those technologies, DT is one promising technology which has been widely used in different industries, especially manufacturing, to monitor the performance, optimize the progresses, simulate the results and predict the potential errors. DT also plays various roles within the whole product lifecycle from design, manufacturing, delivery, use and end-of-life. With the growing demands of individualized products and implementation of Industry 4.0, DT can provide an effective solution for future product design, development and innovation. This paper aims to figure out the current states of DT research focusing on product design and development through summarizing typical industrial cases. Challenges and potential applications of DT in product design and development are also discussed to inspire future studies.     

A cooperative game theory based user-centered medical device design decision approach under uncertainty

The medical device conceptual design decision-making is a process of coordinating pertinent stakeholders, which will significantly affect the quality of follow-up market competitiveness. However, as the most challenging parts of user-centered design, traditional methods are mainly focusing on determining the priorities of the evaluation criteria and forming the comprehensive value (utility) of the conceptual scheme, may not fully deal with the interaction and interdependent between the conflicts of interest among stakeholders and weigh the ambiguous influence on the overall design expectations, which results in the unstable decision-making results. To overcome this drawback, this paper proposes a cooperative game theory based decision model for device conceptual scheme under uncertainty. The proposed approach consists of three parts: first part is to collect and classify needs of end users and professional users based on predefined evaluation criteria; second part is using rough set theory technique to create criteria correlation diagram and scheme value matrix from users; and third part is developing the fuzzy coalition utility model to maximize the overall desirability through the criteria correlation diagram with the conflict of interests of end and professional users considered, and then selecting the optimal scheme. A case study of blood pressure meter is used to illustrate the proposed approach and the result shows that this approach is more robust compared with the widely used the Technique for Order of Preference by Similarity to Ideal Solution (TOPSIS) approach.     

Effect of working position and cold environment on muscle activation level and fatigue in the upper limb during manual work tasks

Several occupational groups are exposed to periods of low ambient temperatures while performing manual work tasks outdoors. Work tasks typically include heavy lifting, tool handling, and overhead work. This study evaluated the effect of working position and cold environment on muscle activation level (%RMS_max) and fatigue in the upper limb during manual work tasks. Fourteen male participants (25 ± 3 years, 80.9 ± 6.4 kg, 182 ± 5 cm) completed a 2-h test protocol consisting of five test periods alternating with four work periods, wearing identical sets of clothing, under cold (−15 °C) and control (5 °C) conditions. The work periods consisted of manual work at the hip level, manual overhead work, and a lifting exercise. The test periods consisted of isometric maximal voluntary contractions (MVC) and seated rest. Skin temperatures decreased during cold exposure, especially in the extremities. %RMS_max in the forearm was higher in the cold condition both during overhead work and work at the hip level than that for the same work in the control condition, especially at the end of the test when the difference was approximately 25% (equating to 2–3 %RMS_max). For the middle deltoid muscle, the %RMS_max was approximately three times (or 10 %RMS_max) higher during overhead work than work at the hip level, but there was no additional cost of working in the cold. Signs of deltoid muscle fatigue (decrease in electromyography median power frequency and an increase in %RMS_max) were observed during the overhead work periods in both temperature conditions. No decrease in MVC, as a sign of overall muscle fatigue, was observed in either condition.Relevance to industryThis study demonstrated that when wearing suitable cold-weather protective clothing, the adverse effect of work posture is much higher than that of cold on muscle demand and physical strain.     

Design of data feature-driven 1D/2D convolutional neural networks classifier for recycling black plastic wastes through laser spectroscopy

In this study, two types of convolutional neural network (CNN) classifiers are designed to handle the problem of classifying black plastic wastes. In particular, the black plastic wastes have the property of absorbing laser light coming from spectrometer. Therefore, the classification of black plastic wastes remains still a challenging problem compared to classifying other colored plastic wastes using existing spectroscopy (i.e., NIR). When it comes the classification problem of black plastic wastes, effective classification techniques by the laser spectroscopy of Fourier Transform-Infrared Radiation (FT-IR) with Attenuated Total Reflectance (ATR) and Raman to analyze the classification problem of black plastic wastes are introduced. Due to the strong ability of extracting spatial features and remarkable performance in image classification, 1D and 2D CNN through data features are designed as classifiers. The technique of chemical peak points selection is considered to reduce data redundancy. Furthermore, through the selection of data features based on the extracted 1D data with peak points is introduced. Experimental results demonstrate that 2DCNN classifier designed with the help of 2D data feature selection as well as 1DCNN classifier shows the best performance compared with other reported methods for classifying black plastic wastes.     

Deterministic and probabilistic ship pitch prediction using a multi-predictor integration model based on hybrid data preprocessing,reinforcement learning and improved QRNN

The deterministic and probabilistic prediction of ship motion is important for safe navigation and stable real-time operational control of ships at sea. However, the volatility and randomness of ship motion, the non-adaptive nature of single predictors and the poor coverage of quantile regression pose serious challenges to uncertainty prediction, making research in this field limited. In this paper, a multi-predictor integration model based on hybrid data preprocessing, reinforcement learning and improved quantile regression neural network (QRNN) is proposed to explore the deterministic and probabilistic prediction of ship pitch motion. To validate the performance of the proposed multi-predictor integrated prediction model, an experimental study is conducted with three sets of actual ship longitudinal motions during sea trials in the South China Sea. The experimental results indicate that the root mean square errors (RMSEs) of the proposed model of deterministic prediction are 0.0254°, 0.0359°, and 0.0188°, respectively. Taking series #2 as an example, the prediction interval coverage probabilities (PICPs) of the proposed model of probability predictions at 90%, 95%, and 99% confidence levels (CLs) are 0.9400, 0.9800, and 1.0000, respectively. This study signifies that the proposed model can provide trusted deterministic predictions and can effectively quantify the uncertainty of ship pitch motion, which has the potential to provide practical support for ship early warning systems.     

Member combination selection for product collaborative design under the open innovation model

A temporary product collaborative design team (PCDT) formed by customers and candidate service providers is the main organization form required to complete the task of product collaborative design (PCD) under the open innovation model. Therefore, the aim of this study was to implement synergy effect-based member combination selection (SE-MCS) while ensuring customer participation in the PCD. First, the conceptual framework of SE-MCS method was developed to characterise the SE-MCS process that includes the customer. Second, SE-MCS indicators were determined by analysing the characteristics of PCD under the open innovation model, and the quantitative calculation methods for these indicators were provided. Subsequently, the mathematical model for SE-MCS considering customer participation was established, and a multi-objective optimisation algorithm was adopted to identify the optimal scheme. Finally, the formation of a design team for a beach waste collection vehicle was performed to verify the proposed method. The results showed that the proposed method is more suitable to implement SE-MCS of PCD under the open innovation model. It can facilitate the smooth operation of PCD tasks and improve the quality and efficiency of teamwork, thereby increasing customer satisfaction.     

Counterfactual inference to predict causal knowledge graph for relational transfer learning by assimilating expert knowledge --Relational feature transfer learning algorithm

Transfer learning (TL) is a machine learning (ML) method in which knowledge is transferred from the existing models of related problems to the model for solving the problem at hand. Relational TL enables the ML models to transfer the relationship networks from one domain to another. However, it has two critical issues. One is determining the proper way of extracting and expressing relationships among data features in the source domain such that the relationships can be transferred to the target domain. The other is how to do the transfer procedure. Knowledge graphs (KGs) are knowledge bases that use data and logic to graph-structured information; they are helpful tools for dealing with the first issue. The proposed relational feature transfer learning algorithm (RF-TL) embodies an extended structural equation modelling (SEM) as a method for constructing KGs. Additionally, in fields such as medicine, economics, and law related to people’s lives and property safety and security, the knowledge of domain experts is a gold standard. This paper introduces the causal analysis and counterfactual inference in the TL domain that directs the transfer procedure. Different from traditional feature-based TL algorithms like transfer component analysis (TCA) and CORelation Alignment (CORAL), RF-TL not only considers relations between feature items but also utilizes causality knowledge, enabling it to perform well in practical cases. The algorithm was tested on two different healthcare-related datasets — sleep apnea questionnaire study data and COVID-19 case data on ICU admission — and compared its performance with TCA and CORAL. The experimental results show that RF-TL can generate better transferred models that give more accurate predictions with fewer input features.     

A three-stage multi-objective heterogeneous integrated model with decomposition-reconstruction mechanism and adaptive segmentation error correction method for ship motion multi-step prediction

Reliable and accurate ship motion prediction is essential for ship navigation at sea and marine operations. Although previous studies have yielded rich results in the field of ship motion prediction, most of them have ignored the importance of the dynamic characteristics of ship motion for constructing forecasting models. Besides, the limitations of the single model and the autocorrelation characteristics of the residual series are also unfavorable factors that hinder the forecasting performance. To fill these gaps, a multi-objective heterogeneous integration model based on decomposition-reconstruction mechanism and adaptive segmentation error correction method is proposed in this paper for ship motion multi-step prediction. Specifically, the proposed model is divided into three stages, which are decomposition-reconstruction mechanism, multi-objective heterogeneous integration model and adaptive segmentation error correction method. The effectiveness of the proposed model is verified using four sets of real ship motion data collected from two sites in the South China Sea. The evaluation results show that the proposed model can effectively improve the prediction performance and outperforms other traditional models and state-of-the-art models in the field of ship motion prediction. Prospectively, the model proposed in this study can be used as an effective aid to ship warning systems and has the potential for practical application in ship marine operations.     

An IIoT-driven and AI-enabled framework for smart manufacturing system based on three-terminal collaborative platform

Smart manufacturing has great potential in the development of network collaboration, mass personalised customisation, sustainability and flexibility. Customised production can better meet the dynamic user needs, and network collaboration can significantly improve production efficiency. Industrial internet of things (IIoT) and artificial intelligence (AI) have penetrated the manufacturing environment, improving production efficiency and facilitating customised and collaborative production. However, these technologies are isolated and dispersed in the applications of machine design and manufacturing processes. It is a challenge to integrate AI and IIoT technologies based on the platform, to develop autonomous connect manufacturing machines (ACMMs), matching with smart manufacturing and to facilitate the smart manufacturing services (SMSs) from the overall product life cycle. This paper firstly proposes a three-terminal collaborative platform (TTCP) consisting of cloud servers, embedded controllers and mobile terminals to integrate AI and IIoT technologies for the ACMM design. Then, based on the ACMMs, a framework for SMS to generate more IIoT-driven and AI-enabled services is presented. Finally, as an illustrative case, a more autonomous engraving machine and a smart manufacturing scenario are designed through the above-mentioned method. This case implements basic engraving functions along with AI-enabled automatic detection of broken tool service for collaborative production, remote human-machine interface service for customised production and network collaboration, and energy consumption analysis service for production optimisation. The systematic method proposed can provide some inspirations for the manufacturing industry to generate SMSs and facilitate the optimisation production and customised and collaborative production.     

A digital twin-based multidisciplinary collaborative design approach for complex engineering product development

With the ever-increasing demand for personalized product functions, product structure becomes more and more complex. To design a complex engineering product, it involves mechanical, electrical, automation and other relevant fields, which requires a closer multidisciplinary collaborative design (MCD) and integration. However, the traditional design method lacks multidisciplinary coordination, which leads to interaction barriers between design stages and disconnection between product design and prototype manufacturing. To bridge the gap, a novel digital twin-enabled MCD approach is proposed. Firstly, the paper explores how to converge the MCD into the digital design process of complex engineering products in a cyber-physical system manner. The multidisciplinary collaborative design is divided into three parts: multidisciplinary knowledge collaboration, multidisciplinary collaborative modeling and multidisciplinary collaborative simulation, and the realization methods are proposed for each part. To be able to describe the complex product in a virtual environment, a systematic MCD framework based on the digital twin is further constructed. Integrate multidisciplinary collaboration into three stages: conceptual design, detailed design and virtual verification. The ability to verify and revise problems arising from multidisciplinary fusions in real-time minimizes the number of iterations and costs in the design process. Meanwhile, it provides a reference value for complex product design. Finally, a design case of an automatic cutting machine is conducted to reveal the feasibility and effectiveness of the proposed approach.     

The use of PCA and signal processing techniques for processing time-based construction settlement data of road embankments

Instrumentation is beneficial in civil engineering for monitoring structures during their construction and operation. The data collected can be used to observe real-time response and develop data-driven models for predicting future behaviour. However, a limited number of sensors are usually used for on-site civil engineering construction due to cost restrictions and practicalities. This results in relatively small raw datasets, which often contain errors and anomalies. Interpreting and making judicious use of the available dataset for developing reliable predictive model represents a significant challenge. Therefore, it is essential to pre-process and clean the data for improving their quality. To date, little investigation has been performed in the application of such data cleaning methods to geotechnical engineering datasets collected from full-scale sites. The purpose of this study is to apply simple and effective data pre-processing techniques to site-data collected from a highway embankment constructed on a sequence of soil layers of different physical make-up and non-linear consolidation characteristics. Various cleaning methods were applied to magnetic extensometer data collected for monitoring settlement within foundation soils beneath the embankment. PCA was used to explore raw data, identify and remove outliers. Numerous filtering and smoothing methods were used to clean noise in the data and their results were further compared using RMSE and NMSE. The methods adopted for data pre-processing and cleaning proved very effective for capturing the raw settlement behaviour on site. The findings from this study would be useful to site engineers regarding complex decision-making relating to ground response due to embankment construction. This also has positive prospects for developing dynamic prediction models for embankment settlement.     

Comparison of OWAS,RULA and REBA for assessing potential work-related musculoskeletal disorders

This study compared three representative observational methods for assessing musculoskeletal loadings: Ovako Working Posture Analysis System (OWAS), Rapid Upper Limb Assessment (RULA), and Rapid Entire Body Assessment (REBA). The comparison was based on 209 cases of upper-body musculoskeletal disorders (MSDs) diagnosed by medical doctors. The most awkward/stressful posture in each participant's tasks was assessed using these techniques. Postural loadings were rated more highly by the RULA than by the OWAS and REBA (p < 0.01). The chi-square test and logistic regression analysis showed that only RULA grand score and action level, and REBA action level were associated with MSD work-relatedness (p < 0.01, p < 0.05, and p < 0.05, respectively). The percentage concordant values of the logistic model for the RULA grand score and action level were 52.4% and 44.8%, respectively, while the percentage concordant value for the REBA action level was 22.1%. Therefore, the RULA may be the best system for estimating the postural loads and work-relatedness of MSDs.Relevance to industryWork-related musculoskeletal disorders are the leading cause of workplace disability in the developed countries. For preventing the disorders, quantification of musculoskeletal loads is required.     

Human–machine hybrid intelligence for the generation of car frontal forms

With the acceleration of the upgrading of the automobile consumption market, artificial intelligence has become an increasingly effective means of enhancing the creative design of automobile appearance modeling. However, when artificial intelligence processes specific design tasks, creativity is primarily based on data drive, resulting in machine-generated design schemes that do not match human-specific psychological intentions. Due to the absence of design knowledge in the process of machine design, there is a data gap between human cognitive thought and machine information processing. This paper aims to structure the human's complex cognitive knowledge of car frontal form, establish the consistency between human and machine cognitive structures, and reduce communication barriers in the process of human–machine hybrid creative design. To achieve this objective, a human–machine hybrid intelligence methodology – a combination of human cognitive mental model, human–machine shared knowledge base, and Generative Adversarial Networks (GAN) – was developed to generate a large number of car frontal forms that are consistent with the design intent. First, we constructed a mental model of human cognition based on three dimensions: design intent, drawing behavior, and functional structure. Second, we created a shared human–machine knowledge base with design Knowledge. This knowledge base contains 12,560 images of car frontal form designs with corresponding morphological semantic labels and 3,140 sketches of car frontal forms drawn by hand. Human–machine shared knowledge base data was utilized in a machine learning training network. In addition, a conditional cross-domain generative adversarial network was developed to investigate the implicit relationship between sketch characteristics, morphological semantics, and image visual effects. Using the suggested method, a large number of images with the specified morphological semantic category and resembling the hand-drawn sketch of a car frontal form can be generated rapidly. In terms of the quality of car frontal form generation, our research is superior to the baseline model according to qualitative and quantitative assessments. In comparison to the designer's output, the human–machine hybrid intelligent generation also demonstrates excellent creative performance.     

Are knee savers and knee pads a viable intervention to reduce lower extremity musculoskeletal disorder risk in residential roofers?

One factor commonly associated with musculoskeletal disorder risk is extreme postures. To lessen this risk, extreme postures should be reduced using proactive and prevention-focused methods. The effect of combinations of two interventions, knee pads and knee savers, on lower extremity kinematics during deep or near full flexion kneeling on differently sloped surfaces was analyzed. Nine male subjects were requested to keep a typical resting posture while kneeling on a sloped roofing simulator with and without knee pads and knee savers. Three-dimensional peak knee kinematics were recording using a motion capture system. The kinematic data were analyzed with a two-way—4(intervention) X 3(slope)—repeated measure analysis of variance (ANOVA). It was observed that knee pads did not alter lower extremity kinematics in a way that may reduce musculoskeletal injury risk, but they do provide comfort. Knee savers did statistically significantly reduce peak lower extremity kinematics, however these changes were small and it is uncertain if the changes will reduce musculoskeletal injury risk. This study has provided initial data that supports the use of knee savers as a potential intervention to reduce musculoskeletal disorder risk due to lower extremity joint angles on a sloped surface, nonetheless, further testing involving other musculoskeletal disorder risk factors is needed prior to a conclusive recommendation.