An evaluation methodology for crowdsourced design |
| |
Affiliation: | 1. Department of Design, Manufacture and Engineering Management, University of Strathclyde, Glasgow, UK;2. Department of Architecture, University of Strathclyde, Glasgow, UK;1. Tampere University of Technology, Fast-Lab., P.O. Box 600, FIN-33101 Tampere, Finland;2. Universidad de Cantabria, Department of Electrical and Energy Engineering, Avda. De los Castros s/n, 39005 Santander, Spain;1. Department of Civil and Environmental Engineering, University of Illinois at Urbana-Champaign, 205 N Mathews Ave., Urbana, IL 61801, United States;2. Department of Computer Science, University of Illinois at Urbana-Champaign, 201 N Goodwin Ave., Urbana, IL 61801, United States;3. Department of Civil and Environmental Engineering and Department of Computer Science, University of Illinois at Urbana-Champaign, 205 N Mathews Ave., Urbana, IL 61801, United States;1. Graduate School of Environmental and Life Science, Okayama University, Okayama 700-8530, Japan;2. Graduate School of Engineering, Kyoto University, Kyoto 615-8540, Japan;3. JP Design Co., Ltd., Tokyo 101-0021, Japan;1. Department of Civil and Environmental Engineering, Carnegie Mellon University, 119 Porter Hall, 5000 Forbes Avenue, Pittsburgh, PA 15213, United States;2. Polytechnic School of Engineering, New York University, 6 MetroTech Center, Brooklyn, NY 11201, United States;3. College of Engineering, Carnegie Mellon University, 110 Scaife Hall, 5000 Forbes Avenue, Pittsburgh, PA 15213, United States |
| |
Abstract: | In recent years, the “power of the crowd” has been repeatedly demonstrated and various Internet platforms have been used to support applications of collaborative intelligence in tasks ranging from open innovation to image analysis. However, crowdsourcing applications in the fields of design research and creative innovation have been much slower to emerge. So, although there have been reports of systems and researchers using Internet crowdsourcing to carry out generative design, there are still many gaps in knowledge about the capability and limitations of the technology. Indeed the process models developed to support traditional commercial design (e.g. Pugh’s Total Design, Agile, Double-Diamond etc.) have yet to be established for Crowdsourced Design (cDesign). As a contribution to the development of such a general model this paper proposes a cDesign framework to support the creation of crowdsourced design activities. Within the cDesign framework the effective evaluation of design quality is identified as a key component that not only enables the leveraging of a large, virtual workforce’s creative activities but is also fundamental to almost all iterative optimisation processes. This paper reports an experimental investigation into two different Crowdsourced design evaluation approaches; free evaluation and ‘Crowdsourced Design Evaluation Criteria’ (cDEC). The results are benchmarked against a ‘manual’ evaluation carried out by a panel of experienced designers. The results suggest that the cDEC approach produces design rankings that correlate strongly with the judgements of an “expert panel”. The paper concludes that cDEC assessment methodology demonstrates how Crowdsourcing can be effectively used to evaluate, as well as generate, new design solutions. |
| |
Keywords: | Crowdsourcing Crowdsourced design methodology Design evaluation Crowdsourced design evaluation criteria Collaborative design Human based genetic algorithm |
本文献已被 ScienceDirect 等数据库收录! |
|