共查询到19条相似文献,搜索用时 125 毫秒
1.
在ICU中实现少数民族文字的处理 总被引:9,自引:7,他引:9
基于ISO/IEC 10646和UNICODE国际标准,用传统的字体技术(如TrueType)来实现少数民族文字处理所面临的一个“瓶颈”问题是:“变形显现字符”不存在确定的码位。这也是多年来民文系统重复开发、互不兼容的根本原因。本文基于ICU的文字处理体系结构,阐述了完全支持Unicode标准的少数民族文字(本文主要指蒙古文字、维文、藏文等)的实现方法。文中首先介绍了少数民族文字的特点,分析其与拉丁文、汉字在计算机输入、输出过程中的不同之处,并指出少数民族文字处理的难点。其次介绍了一种能满足少数民族文字处理需求的字体技术——OpenType。最后,阐述了文字处理引擎的工作原理,以及ICU中如何实现对少数民族文字的支持。 相似文献
2.
Unicode与UTF-8编码转换方法研究 总被引:7,自引:0,他引:7
为了对各国的文字、符号进行统一编码,Unicode协会先后推出了Unicode编码和UTF-8编码,两者目前在全球范围的信息交换领域均有广泛的应用。在对信息进行处理时,经常需要将两者进行相互转换。文章介绍了UTF-8的编码原则并详细说明了Unicode与UTF-8编码转换的算法。 相似文献
3.
UTF-n是Unicode常用编码方式.这种方式主要的问题是编码后的存储位数大大增加.本文分析了高效Unicode转换格式的原理,并根据高效Unicode转换格式的思路,利用Haffman算法建立一种Unicode的编码模型. 相似文献
4.
随着无线技术的迅猛发展,移动终端越来越成为一个必不可少的通信工具,但是因为少数民族文字在字形上的特点使得其在显示时不存在确定的码位,因此成为手机上显示少数民族文字的瓶颈,导致目前仍然没有这样的产品出现。针对这个问题,阐述基于文字体系处理结构,支持Unicode标准的少数民族文字的处理方法以及在现有的Pango布局引擎中实现对少数民族文字的支持的技术,采用一种能很好的支持少数民族文字处理需求的文字技术——Open Type较好的解决了少数民族文字在手机上的显示问题。 相似文献
5.
6.
基于高效UTF的Unicode编码方式研究 总被引:1,自引:0,他引:1
UTF-n是Unicode常用编码方式。这种方式主要的问题是编码后的存储位数大大增加。本文分析了高效Unicode转换格式的原理,并根据高效Unicode转换格式的思路,利用Haffman算法建立一种Unicode的编码模型。 相似文献
7.
8.
云太真 《电脑编程技巧与维护》2018,(9):4-8
使用Python语言中的正则表达式,进行了文本的模式匹配,根据匹配结果修改文本内容;讨论了ASCII、ANSI和Unicode等文字编码的原理,识别了带BOM标志的各种Unicode编码的TXT文件,对不带BOM标志的TXT文件区分UTF-8和ANSI编码进行了详细的讨论,并给出了具体实现. 相似文献
9.
10.
马创新 《电脑编程技巧与维护》2012,(9):16-19
介绍了使用VC++实现转换文本文件字符编码的方法,可使文本文件的字符编码在Unicode、Big5、UTF8、GBK等编码之间实现自由转换. 相似文献
11.
Unicode was designed to extend ASCII for encoding text in different languages, but it still has several important drawbacks. Multicode addresses many of Unicode's drawbacks and should have considerable appeal to programmers who work with text in a variety of languages. Its future, however, depends on the computer industry's acceptance. Multicode can represent Unicode files because it reserves a character set for Unicode. Converting Multicode to Unicode is also straightforward (although the opposite is not). Thus, both approaches can coexist-Multicode for programming ease and Unicode to support unified fonts 相似文献
12.
Text processing is an important computer application. Due to its importance, a number of text manipulation programming languages have been devised (e.g. Icon). These programming languages are very useful for applications such as natural language processing, text analysis, text editing, document formatting, text generation, etc. However, they were mainly designed to handle English texts, and are ineffective for Chinese. This is because English and Chinese texts are represented very differently in a computer. An English character is mainly represented in 7-bit ASCII, and its Chinese counterpart commonly in 16-bit GB or BIG-5. This difference makes direct application of English-based text manipulation programming languages to Chinese erroneous, e.g. application of Icon to reverse a string of Chinese characters. In this paper, a new dialect of Icon, referred to as Chicon (i.e. Chinese Icon), is proposed. In the design of Chicon, new data types were introduced to differentiate pure English and English/Chinese mixed texts. In addition, existing Icon text manipulation functions were modified to account for Chinese texts. Experiments have shown that Chicon not only could overcome the problems of Chinese processing in Icon, but its execution speed was actually superior to Icon in handling Chinese. Furthermore, application of Chicon to a real sized problem, namely word segmentation, has proved that the language is practical. © 1998 John Wiley & Sons, Ltd. 相似文献
13.
14.
Nicholas A. John 《Journal of Computer-Mediated Communication》2013,18(3):321-338
This paper examines the technologies that enable the representation of Hebrew on websites. Hebrew is written from right to left and in non‐Latin characters, issues shared by a number of languages which seem to be converging on a shared solution—Unicode. Regarding the case of Hebrew, I show how competing solutions have given way to one dominant technology. I link processes in the Israeli context with broader questions about the ‘multilingual Internet,’ asking whether the commonly accepted solution for representing non‐Latin texts on computer screens is an instance of cultural imperialism and convergence around a western artifact. It is argued that while minority languages are given an online voice by Unicode, the context is still one of western power. 相似文献
15.
16.
该文以收集整理翻译的彝语言语料为基础,在SQL Server 2008数据库环境下,通过ODBC,利用VC++ 6.0编写彝语言语料入库程序,实现了彝语言语料U文件(Unicode彝文)和Y文件(YIWIN彝文)的自动入库,完成了彝语言语料资源数据库的设计;通过编写WEB服务端的查询和统计程序,利用C/S方式实现了彝语言语料基于WEB浏览器的访问和远程共享,同时也为其他少数民族文字信息处理中的类似问题提供了一个可参考的解决方案。 相似文献
17.
18.