From action icon to knowledge icon: Objective-oriented icon taxonomy in computer science

Icon plays a critical role in computer interface design. Studies on icon taxonomy explain the way in which various types of icon represent the objects and provide designers creation rules by which icons are more in line with users’ cognitive psychology. However, along with larger and larger use of icons, the previous classification criterion causes the boundary between categories blur. What’s more, Single classification standard is not able to well illustrate the icons applied in today’s computer applications. The purpose of this paper is to present an objective-oriented icon taxonomy which proposes to categorize icons into action icon and knowledge icon. To assess this proposition, we analyzed a sample of icons that applied in computer interface and suggest precise application domains to both action icon and knowledge icon categories. The results of this practice manifested that action icon and knowledge icon implied a high relation with applied environment and explicated the development trace of computer icons. This work is one of the first to point out the notion of knowledge icon and to highlight the importance of objective of icon application. Findings in this paper could enrich icon use in computer interface design, especially provides possible way to improve online knowledge sharing by visual tool like icon.     

EvIcon: Designing High-Usability Icon with Human-in-the-loop Exploration and IconCLIP

Interface icons are prevalent in various digital applications. Due to limited time and budgets, many designers rely on informal evaluation, which often results in poor usability icons. In this paper, we propose a unique human-in-the-loop framework that allows our target users, that is novice and professional user interface (UI) designers, to improve the usability of interface icons efficiently. We formulate several usability criteria into a perceptual usability function and enable users to iteratively revise an icon set with an interactive design tool, EvIcon. We take a large-scale pre-trained joint image-text embedding (CLIP) and fine-tune it to embed icon visuals with icon tags in the same embedding space (IconCLIP). During the revision process, our design tool provides two types of instant perceptual usability feedback. First, we provide perceptual usability feedback modelled by deep learning models trained on IconCLIP embeddings and crowdsourced perceptual ratings. Second, we use the embedding space of IconCLIP to assist users in improving icons' visual distinguishability among icons within the user-prepared icon set. To provide the perceptual prediction, we compiled IconCEPT10K, the first large-scale dataset of perceptual usability ratings over 10,000 interface icons, by conducting a crowdsourcing study. We demonstrated that our framework could benefit UI designers' interface icon revision process with a wide range of professional experience. Moreover, the interface icons designed using our framework achieved better semantic distance and familiarity, verified by an additional online user study.     

Icon identification in context: the changing role of icon characteristics with user experience

OBJECTIVE: This research examined the relative importance of icon characteristics in determining the speed and accuracy of icon identification. BACKGROUND: Studies to date have focused on the role of one or two icon characteristics when users first experience an icon set. This means that little is known about the relative importance of icon characteristics or how the role of icon characteristics might change as users gain experience with icons. METHODS: Thirty participants carried out an icon identification task over a long series of trials to simulate learning through experience. Icon characteristics investigated included semantic distance, concreteness, familiarity, and visual complexity. RESULTS: Icon characteristics were major determinants of performance, accounting for up to 69% of the variance observed in performance. However, the importance of icon characteristics changed with experience: Semantic distance is crucial initially while icon-function relationships are learned, but familiarity is important later because it has lasting effects on access to long-term memory representations. CONCLUSION: These findings suggest that icon concreteness may not be of primary importance when identifying icons and that semantic distance and familiarity may be more important. APPLICATION: Designers need to take into account icon characteristics other than concreteness when creating icons, particularly semantic distance and familiarity. The precise importance of the latter characteristics will vary depending on whether icons are rarely encountered or frequently used.     

Feature extraction and iconic visualization

We present a conceptual framework and a process model for feature extraction and iconic visualization. The features are regions of interest extracted from a dataset. They are represented by attribute sets, which play a key role in the visualization process. These attribute sets are mapped to icons, or symbolic parametric objects, for visualization. The features provide a compact abstraction of the original data, and the icons are a natural way to visualize them. We present generic techniques to extract features and to calculate attribute sets, and describe a simple but powerful modeling language which was developed to create icons and to link the attributes to the icon parameters. We present illustrative examples of iconic visualization created with the techniques described, showing the effectiveness of this approach     

Matching performance of vehicle icons in graphical and textual formats

The current research classified 82 vehicle icons into seven categories (image-related, concept-related, semi-abstract, arbitrary, abbreviation, word, and combined) for their matching accuracy, matching sequence, and matching time. These data can be compared and used as a framework for future icon development. Forty participants, all with a university degree, took part in this experiment. Half of the participants had intensive driving experience, while the other half never driven a car. The results indicated that on average, word icons had a significantly greater matching accuracy than the other icon formats; ranging from 4.7 to 20.8% difference. Regarding the matching sequence, participants matched image-related icons before other icon formats. Arbitrary and combined icons took significantly longer to match than other icon formats by 1.4–6.2 s. Based on the high matching accuracy (86.3%) and high ratings on subjective design features, word format can be used for functions describable using simple English for users with English reading ability. Confusion matrices showed that 63.2% of the misunderstandings were caused by similarity in format or function.     

基于因子分析法的图标设计评价方法

现有的图标设计评价方法大多基于审美评价或可用性而展开,缺少对图标间的关 系及设计因素的研究。为此,提出了一种基于因子分析法的界面图标设计评价方法,通过选取 图标设计中的6 个设计元变量,对其展开意象评价统计并建立均值矩阵,使用因子分析法对其 进行计算分析及评价。最终将图标设计的影响因子提取为图标外形和图标内部两个主要因子, 从而方便研究人员评价系列图标设计中各图标之间的关系和各构成要素的相互作用。该方法具 有可靠性,评价结果与现有系列图标设计的视觉表现及其市场表现相符,并得出图标外形因子 对于图标设计效果的影响作用大于图标内部因子这一主要观点。     

The effects of color combinations,luminance contrast,and area ratio on icon visual search performance

The visual search of icons in a digital interface plays an important role in human-computer interaction. In this behavior study about the visual search of graphic symbols, the effects of the color combination, luminance contrast, and icon area ratio were investigated. A total of 28 participants (12 men and 16 women, ages ranging from 20 to 28 years, Mean = 22.4, SD = 1.7) were asked to perform an icon search task. Participants’ icon search accuracy and response times were measured as a function of the following independent variables: three levels of area ratios, four background colors, four foreground colors, and three levels of luminance contrast. The results showed that although there was no significant main effect of luminance contrast on the icon search accuracy, participants responded more quickly to medium luminance contrast than low or high luminance contrast. Similarly, the medium or low area ratio was more conducive to the participants identifying icons. Moreover, a strong interaction was observed between the effects of luminance contrast and icon area ratio. The icon search performance of the high luminance contrast improved significantly as the figure/background area ratio decreased. Icon color combinations also significantly affected visual search performance. White on black, yellow on black, turquoise on black, white on red, yellow on red, and white on purple resulted in better performance than other color combinations. The findings of this study provide useful guidelines for designing more efficient and user-friendly icons and interfaces in the future.     

Learning and retention of associations between auditory icons and denotative referents: implications for the design of auditory warnings

OBJECTIVE: This study examined the way in which the type and preexisting strength of association between an auditory icon and a warning event affects the ease with which the icon/event pairing can be learned and retained. BACKGROUND: To be effective, an auditory warning must be audible, identifiable, interpretable, and heeded. Warnings consisting of familiar environmental sounds, or auditory icons, have potential to facilitate identification and interpretation. The ease with which pairings between auditory icons and warning events can be learned and retained is likely to depend on the type and strength of the preexisting icon/event association. METHOD: Sixty-three participants each learned eight auditory-icon/denotative-referent pairings and attempted to recall them 4 weeks later. Three icon/denotative-referent association types (direct, related, and unrelated) were employed. Participants rated the strength of the association for each pairing on a 7-point scale. RESULTS: The number of errors made while learning pairings was greater for unrelated than for either related or direct associations, whereas the number of errors made while attempting to recall pairings 4 weeks later was greater for unrelated than for related associations and for related than for direct associations. Irrespective of association type, both learning and retention performance remained at very high levels, provided the strength of the association was rated greater than 5. CONCLUSION: This suggests that strong preexisting associations are used to facilitate learning and retention of icon/denotative-referent pairings. APPLICATION: The practical implication of this study is that auditory icons having either direct or strong, indirect associations with warning events should be preferred.     

The effects of icon internal characteristics on complex cognition

The interaction between humans and digital interfaces is a complex cognitive process which has a high demand on working memory resources. However, most previous research on icon perception seems to focus only on the influences of an icon's internal characteristics (e.g. visual complexity, concreteness and familiarity) on simple tasks such as visual search and recall tasks. The study reported here applied a math task to simulate the complicated process of human-computer interaction and investigated the effects of icon internal characteristics on the performance of complex cognition. First, we created and filtered 80 novel icons of 4 different types (simple & concrete, simple & abstract, complex & concrete, complex & abstract). Subsequently, participants were required to perform an icon-meaning recall task, during which icon familiarity was manipulated by different exposure frequencies. Finally, after viewing random icon-digit associations, participants' abilities to solve algebraic equations involving icons were tested. The results indicated that participants performed significantly better when the icons were simple, concrete or familiar and these beneficial effects increased as the task became more complex. Additionally, strong evidence was found to show that it was easier to encode and maintain familiar icons and associated information in working memory. The findings of this study provide useful information for the icon design and interface design of human-computer interaction.     

Interacting with VDL-based structured icons on crisis map for emergency coordination: Interactive design and experimental demonstration

Accurate and timely information sharing among multiple participants is one of the crucial factors for collaboration in crisis management. The icon-based map was frequently applied as an effective means for crisis interaction and collaboration. However, former studies only regarded the icons as supplementary visualization components during the whole crisis collaboration process. In this paper, the concept of a structured-icon-relied interactive method was proposed to directly integrate all kinds of crisis and coordination information through icons on the crisis map. Moreover, structured icons are supposed to explicitly show the correlation among crisis information and to improve the interactive experience of information search. The effectiveness of this interactive method was verified by a controlled experiment with three sub-tasks for simulated crisis rescue. The results of the experiment showed that the design of the crisis map based on structured icons had a positive impact on collaborative decision-making and crisis interaction. The dynamic characteristics of the structured icon could represent the temporal and spatial attributes of crisis information and enhance users’ crisis coordination ability. The study aims to enrich the theory of crisis information visualization and interaction based on structured iconic representation. In practice, this research could optimize the design of a crisis collaboration system based on the icon as well as the interaction between people, crisis information, and collaborative system, which in turn provides accurate and timely rescue decisions.     

Influence mechanism of icon semantics on visual search performance: Evidence from an eye-tracking study

Explicit icon semantics can reduce the difficulty of understanding complex visual information. Optimizing the icon semantics and text semantics of icons can effectively improve the cognitive performance of digital interfaces. This paper adopts visual search tasks to study the effects of different combinations of icon semantic familiarity and the presence or absence of text on icon search performance under horizontal and vertical layouts. The behavioral experiment results show that under two layouts: 1. The main effect of icon semantics is significant, and the search performance increases with the increase of semantic familiarity. 2. The main effect of text is significant, and the search performance is negatively correlated with the addition of text. The eye movement experiment found that the semantic familiarity of icons had a significant impact on average fixation time. Furthermore, the number of fixation points changed significantly after the text variable was added. Therefore, there was no significant difference in the number of fixation points in the horizontal layout, and icon semantics was the main influencing factor in visual search. In the vertical layout, there was no significant difference in average fixation time, and text was the main influencing factor of visual search. The results show that the semantic familiarity of icons and different combinations with or without text significantly affect visual search performance in horizontal and vertical layouts. This paper provides a theoretical reference for the combination of icons and text in interface design.     

Study on the correlation and inhibition of visual marking and industrial icons

As a carrier of complex information, industrial icons play an important role in intelligent manufacturing systems, and the superiority of its visual presentation affects the visual search efficiency of operators. This paper applied the theoretical knowledge of visual marking to the study of industrial icons, and the relationship between the inhibitory mechanism of visual marking and the information characteristic, semantic categories and spatial layout of industrial icons is explored from the inhibition of location, feature, category and spatial structure in visual marking. The experimental results show that: in the aspect of feature inhibition, the 2.5D style inhibits the flat style and the complex icon inhibits the simple icon. In the aspect of category inhibition, the inhibitory degree of four different categories are warning, monitoring, equipment and production in order from high to low. In the aspect of spatial layout inhibition, the regular layout inhibits the chaotic layout and the orderly arrangement inhibits the disorderly arrangement. It is concluded that there is a certain correlation among the industrial icons’ inhibition of feature, category and spatial layout, and the priority of category is higher than that of feature, the spatial layout inhibition is jointly influenced by the inhibition of feature and category, among which category inhibition takes the lead role.     

A Taxonomy of Representation Strategies in Iconic Communication

Predicting whether the intended audience will be able to recognize the meaning of an icon or pictograph is not an easy task. Many icon recognition studies have been conducted in the past. However, their findings cannot be generalized to other icons that were not included in the study, which, we argue, is their main limitation. In this paper, we propose a comprehensive taxonomy of icons that is intended to enable the generalization of the findings of recognition studies. To accomplish this, we analyzed a sample of more than eight hundred icons according to three axes: lexical category, semantic category, and representation strategy. Three basic representation strategies were identified: visual similarity; semantic association; and arbitrary convention. These representation strategies are in agreement with the strategies identified in previous taxonomies. However, a greater number of subcategories of these strategies were identified. Our results also indicate that the lexical and semantic attributes of a concept influence the choice of representation strategy.     

How do app icon color and border shape influence visual search efficiency and user experience? Evidence from an eye-tracking study

Icon color and icon border shape are two key factors that affect search efficiency and user experience but have previously been studied separately. This study aimed to ascertain their separate and combined effects on smartphone interfaces. We conducted an experiment using eye tracking in addition to performance and experience measures to understand the effects of app icon color and border shape on visual efficiency and user experience. The results identified both features as essential attributes with interactive effects in the process of searching app icons on a smartphone interface. The study confirmed that varied colors across icons and a rounded square border shape helped to improve search efficiency, decrease cognitive effort, and lead to a more positive user experience.Relevance to industryUsers of smartphones are often confronted with the problem of selecting a single app from a great number of apps. Visual design of app icons plays a key role in influencing visual search efficiency and user experience. The results of this study have implications for designing app icons on the interface of smartphones to improve search efficiency and elicit positive user experience.     

Feature Extraction using Unit-linking Pulse Coupled Neural Network and its Applications

In this paper, we use Unit-linking PCNN (Pulse Coupled Neural Network), the simplified model of PCNN consisting of spiking neurons, to code a 2-dimensional image into a 1-dimensional time sequence called global Unit-linking PCNN image icon or time signature, including features of the original image and having the translation, rotation, and scale invariance. Dividing an image into multiple parts can obtain local Unit-linking PCNN image icons corresponding to the image’s local regions, which can reflect the local changes of the image. In the meantime, the global and the local Unit-linking PCNN image icons are used in navigation, object detection, and image authentication. In navigation, global Unit-linking PCNN image icon shows qualified performance especially in non-stationary-video navigation. Object detection using global Unit-linking PCNN image icon, is independent of variances of translation, rotation, and scale, and object segmentation is avoided. In image authentication, using local Unit-linking PCNN image icon can authenticate correctly some juggled images failed to authenticate by using local histogram or local mean intensity, and can locate the juggled positions in the juggled images with some accuracy.     

Interactive visual modeling for performance

An overview is given of Q+, an interactive tool for performance modeling that uses graphical input and visual output. Two major enhancements are a subnetwork capability for structuring models hierarchically and an integrated expression capability. New capabilities are custom icons and temporal browsing. With a Q+ icon palette, users can draw their own icons and manipulate existing ones. The browser allows browsing, editing and updating Q+ information, which can be textual or graphical. Automatic model building, operations management, and experimental design with Q+ are discussed     

图符一致性对识别效率及可靠性的影响

针对已有研究对图符一致性的影响考虑还不充分的不足,采用被试内实验设计,研究了人机界面图符一致性对识别效率及可靠性的影响。实验共分五组：实验一建立图符形状与指代功能之间的联系（建立用户心理模型）;实验二考察图符外观/形状一致性的影响;实验三考察功能按键位置一致性的影响;实验四和实验五考察图符外观/形状与功能/语义匹配一致性的影响。五组实验的错误率差异的卡方检验结果为：实验四＞实验五=实验三=实验二=实验一;反应时差异的单因素方差分析结果为：实验五=实验四＞实验三=实验二=实验一。结论：外观/形式与功能/语义的“匹配/对应”是界面一致性的核心。相似图符形状指代原有功能时,识别存在学习的正迁移;图符外观一致而指代的功能不一致或反之（新图符指代原有功能）时,识别则会由于心理模型冲突而造成学习的负迁移,表现为识别效率和可靠性的降低。     

基于面图标的三维对称张量场可视化研究

现有的三维对称张量场可视化的面图标方法,仅表现了张量场的某一特征向量场在面图标上的方向信息,而没有表现出特征向量场的大小,基于此,提出了在面图标上通过绘制三维等值线及利用颜色属性来表现特征向量场的大小信息,这样,面图标就将特征向量场的方向和大小信息同时表现出来,从而进一步完善了三维对称张量场的面图标方法,更全面地揭示了张量场位于空间曲面上的信息。     

Age-related differences in the initial usability of mobile device icons

Mobile devices offer much potential to support older adults (age 65+). However, older adults have been relatively slow to adopt mobile devices. Although much ongoing HCI research has examined usability problems to address this issue, little work has looked at whether existing graphical icons are harder to use for this population compared with younger adults. We conducted a qualitative exploratory study and a follow-up experimental study to determine which icon characteristics help initial icon usability for older adults. We found that our older participants did have more problems using existing mobile device icons, but that particular icon characteristics – semantically close meaning (i.e. natural, close link between depicted objects and associated function), familiar, labelled and concrete (i.e. those depicting real-world objects) – improved icon usability for them. We discuss how these findings can help icon designers to create mobile device icons that are more suited to the abilities and technology experience of older adults.