Data Squashing by Empirical Likelihood

Data squashing was introduced by W. DuMouchel, C. Volinsky, T. Johnson, C. Cortes, and D. Pregibon, in Proceedings of the 5th International Conference on KDD (1999). The idea is to scale data sets down to smaller representative samples instead of scaling up algorithms to very large data sets. They report success in learning model coefficients on squashed data. This paper presents a form of data squashing based on empirical likelihood. This method reweights a random sample of data to match certain expected values to the population. The computation required is a relatively easy convex optimization. There is also a theoretical basis to predict when it will and won't produce large gains. In a credit scoring example, empirical likelihood weighting also accelerates the rate at which coefficients are learned. We also investigate the extent to which these benefits translate into improved accuracy, and consider reweighting in conjunction with boosted decision trees.     

Data mining of resilience indicators

In recent years, the Asia-Pacific region has experienced several financial setbacks, including speculative attacks in 1998 and the SARS outbreak in 2003. Financial stresses of this nature are unanticipated, and not all of the dangers can be predicted by the examination of market information and macroeconomic indicators. The Early Warning System (EWS) that has been adopted by the International Monetary Fund may not be able to predict future financial crises for all possible scenarios, because shocks come in many different forms. To supplement the EWS, this paper proposes a data mining framework to measure the resilience of an economy. The resilience framework does not predict a crisis, but rather assesses the current state of health of an economy and its ability to withstand a financial shock should one occur. The framework is based on a feedback system consisting of two stages. The first stage assigns a resilience score to each economy based on a fuzzy logic scoring scheme that is built on the ambiguous reasoning of experts. The second stage uses the classification tree approach to estimate thresholds for each economic indicator, and examines the quality of the fuzzy score. The result from the second stage is then passed back to the first stage as feedback. The final result is obtained when the feedback system reaches its equilibrium state. The proposed resilience framework is applied to the external-sector and the public-sector economies of several countries to illustrate its applicability.     

最长公共子序列算法在填空题评分程序中的应用

讨论最长公共子序列算法在填空题评分中的应用,并具体设计一种基于网络环境下,考试系统中的填空题题型的通用答案识别逻辑,在独立学院网络考试系统中操作可行。     

软件重构及设计模式在摄像头阅卷系统中的应用研究

首先设计并实现一个基于摄像头的阅卷系统,该系统由试卷获取、灰度化、二值化、畸变变换、倾斜校正、图像定位和识别等图像处理流程组成。然后以此为依据,通过对重构技术及设计模式原则和方法的系统研究,对该系统框架进行优化和重构。本文充分参照现有的设计模式,通过重构技术,改善现有代码的质量,增加系统的可维护性和可复用性。     

PSO-SVM模型的构建与应用

为了使支持向量机(SVM)获得更好的分类效果,针对人为选择参数的随机性,提出了利用粒子群算法(PSO)进行参数自动选取的优化方法,构建了PSO-SVM模型.在个人信用评估中,通过对粒子适应度函数的设置来控制造成较大损失的第二类误判,应用结果表明:模型在训练和测试样本中的分类精度可以达到95%,第二类误判率分别仅为0.78%和2.02%.利用PSO对SVM中的参数进行优化,可以避免人为选择的随机性,并且在解决分类问题中表现出较好的稳健性.     

神经网络在个人信用组合预测中的应用

该文运用组合预测的思想,提出了通过感知器、BP、Elman和LVQ等不同的具有代表性的神经网络模型,将多元线性回归和logistic回归两单一方法进行组合,并分别应用于某商业银行的个人信用评估,其结果表明:感知器、BP、Elman和LVQ神经网络组合预测方法精确度不尽相同,但总体上能够获得比多元线性回归和logistic回归更高的预测精度,尤其在避免纳伪错误方面更具优势。     

基于用户特征属性和云模型的协同过滤推荐算法

随着数据的极端稀疏性,仅仅依赖于传统的协同过滤相似性的度量方法已无法取得精确的推荐结果。针对这一问题,提出基于用户特征属性和云模型的协同过滤算法。首先,算法利用云模型计算用户评分云相似性,结合用户打分偏好对原矩阵进行填充,在此基础上得到用户的评分云相似性;其次,再结合用户特征属性相似性通过加权因子计算用户的最终相似性,得到一种新的相似性度量方法;最后,得到算法的评分预测。实验结果表明,该方法能够提高推荐质量。     

基于共同语境的近义词/同义词短语查找模型

为了实现大型语料库中近义词/同义词短语的查找,提出了一种基于共同语境的近义词/同义词短语查找模型,它通过[n]-gram分布式方法捕获语义相似性,不需要解析就能隐式地保存局部句法结构,使底层方法语言独立;具体实现分为两个阶段：第一阶段是上下文收集和过滤,即用围绕查询短语的本地上下文作为条件模型的特征来捕获语义和语法信息。第二阶段是候选词短语收集和筛选,即对数据中的每个“左”“右”和“配对”的全部实例进行迭代,以收集一组近义词/同义词候选短语;还给出了构成模型的要素和用于评价模型性能的评分函数;基于不同大型语料库的实验结果表明,提出的建模方法在总的统计评分查找性能和整体可扩展性方面都优于常用的其他查找方法模型。     

基于VBA的高级工考试自动评分研究

计算机系统管理员的高级工考试是一项资格认证考试,与之相适应需要一项自动的评分系统.其中选择题的自动评分已经实现,而操作题需要手工阅卷.为了实现对操作题的答题结果自动评分,采用VBA技术分析考生的操作结果,可以实现自动阅卷且准确性高.     

C语言源程序的自动评判系统

自动评判系统为通过编译C语言源程序生成的可执行程序创建进程,输入适当的测试数据,对输出结果与预设答案进行比较和评判。提出了通过匿名管道进行数据输入输出的实现方法,分析了自动评判机制中的主要问题及解决方法,重点对分级评判进行了探讨,进而提出了四级评判机制。