HchMER: 一种混合人机智能的手写数学表达式识别方法
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

TP391

基金项目:

国家自然科学基金(62172397); 中国科学院青年创新促进会项目(20200113)


HchMER: Hybrid Human-machine Intelligence Method for Handwritten Mathematical Expression Recognition
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    随着人工智能和端到端识别方法在手写数学表达式识别上的应用, 数学表达式识别准确率有了明显的提高. 然而, 与公开数据集上的测试不同, 实际应用中人的参与为识别算法引入了更多的不确定因素, 如个性化的笔画信息、包含歧义的手写字符, 以及不确定的公式结构等, 影响了识别算法的性能. 为此, 我们提出了一种混合人机智能的手写数学表达式识别方法HchMER. 该方法借助手写数学公式识别算法、知识库和用户反馈, 增强机器对用户输入的数学表达式的理解, 从而提升手写数学表达式的编辑速度和准确率. 为了验证HchMER的有效性, 我们将其分别与MyScript Math Recognition (MyScript)算法, 以及一个成熟的商用产品“ Microsoft Ink Equation” (InkEquation)进行了比较. 实验结果表明, HchMER在准确率上较MyScript和InkEquation分别提高了23.2%和26.51%. 在平均完成时间上, HchMER比MyScript增加了44.46%(9.6s), 但是比InkEquation降低了11.48%(4.05s). 同时, 被试在问卷调查和半结构化访谈中对HchMER给予了肯定.

    Abstract:

    With the application of artificial intelligence (AI) and end-to-end recognition methods in handwritten mathematical expression recognition, there has been a significant improvement in recognition accuracy. However, in contrast to tests on public datasets, real-world applications involving human input introduce more uncertain factors into recognition algorithms in practice. Factors such as personalized stroke information, ambiguous handwritten characters, and uncertain formula structures can significantly impact the performance of the recognition method. To address these challenges, HchMER, a hybrid human-machine intelligence method for handwritten mathematical expression recognition, is proposed. HchMER combines handwritten mathematical formula recognition algorithms, knowledge bases, and user feedback to enhance the machine's comprehension of user-input mathematical expressions, thereby improving the editing speed and accuracy of handwritten mathematical expressions. To assess the effectiveness of HchMER, it is compared with MyScript Math Recognition (MyScript) and a mature commercial product named “Microsoft Ink Equation” (InkEquation). Results show that HchMER outperformed MyScript and InkEquation in accuracy by 23.2% and 26.51%, respectively. In terms of average completion time, HchMER exceeded MyScript by 44.46% (9.6s) but fell short of InkEquation by 11.48% (4.05s). Furthermore, participants affirm HchMER in a questionnaire survey and semi-structured interviews.

    参考文献
    相似文献
    引证文献
引用本文

康文惠,黄进,仝青山,付强,田丰,戴国忠. HchMER: 一种混合人机智能的手写数学表达式识别方法.软件学报,,():1-26

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2023-09-07
  • 最后修改日期:2023-12-07
  • 录用日期:
  • 在线发布日期: 2024-06-14
  • 出版日期:
您是第位访问者
版权所有:中国科学院软件研究所 京ICP备05046678号-3
地址:北京市海淀区中关村南四街4号,邮政编码:100190
电话:010-62562563 传真:010-62562533 Email:jos@iscas.ac.cn
技术支持:北京勤云科技发展有限公司

京公网安备 11040202500063号