基于复杂性评估的分流式人体动作生成
CSTR:
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

基金项目:

国家自然科学基金重大项目(72293580, 72293583)


Complexity-assessed Routing for Human Motion Generation
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    具身智能的发展要求智能体能够根据语言指令生成自然、连贯且符合身体结构约束的动作行为,文本驱动人体动作生成因此成为连接语言理解与身体行为表达的重要任务。现有基于扩散模型的人体动作生成方法在动作自然性和文本语义一致性方面取得了显著进展,但通常在训练和推理阶段对不同复杂性样本采用统一处理方式,难以充分适应样本复杂性差异。针对上述问题,本文提出一种基于复杂性评估的分流式人体动作生成方法CARM。该方法首先通过骨盆特征与文本特征之间的运动方向匹配度,以及四肢特征与文本特征之间的运动姿态匹配度,计算样本复杂性评分,并据此获得不同复杂性样本的分流标记;在训练阶段,根据样本复杂性评分为不同样本分配差异化的时间步采样范围,实现时间步采样分流;在推理阶段,根据复杂性评分选择浅层、中层或深层输出路径,使复杂性评分较低的样本提前输出,而复杂性评分在当前阶段仍然偏高的样本继续进入更深层路径生成。进一步地,本文引入浅层和中层辅助出口损失,以提升多出口推理的稳定性。实验结果表明,本文方法在HumanML3D和KIT-ML数据集上提升了动作生成质量,验证了所提方法的有效性。

    Abstract:

    Embodied intelligence requires agents to generate natural, coherent, and physically plausible motions from language instructions. Text-driven human motion generation has therefore become an important task for bridging language understanding and embodied behavior expression. Existing diffusion-based methods have achieved notable progress in motion naturalness and text-motion semantic consistency. However, they usually apply a unified training and inference strategy to samples with different complexity levels, limiting their ability to handle variations in sample complexity. To address this, this paper proposes CARM, a complexity-assessed routing method for human motion generation. CARM first measures the motion direction matching degree between pelvis features and text features, and the motion posture matching degree between limb features and text features. The two matching scores are then used to compute a sample complexity score and generate routing labels. During training, CARM assigns differentiated timestep sampling ranges according to the sample complexity score, enabling timestep sampling routing. During inference, the complexity score is used to select a shallow, intermediate, or deep output path. Samples with lower complexity scores can exit early, while samples whose complexity remains high at the current stage are forwarded to deeper paths for generation. In addition, auxiliary losses are introduced at the shallow and intermediate exits to improve the stability of multi-exit inference. Experiments on the HumanML3D and KIT-ML datasets show that the proposed method improves motion generation quality, demonstrating its effectiveness.

    参考文献
    相似文献
    引证文献
引用本文

高宇童,汪小康,翁彧,孙利娟,刘征,刘轩.基于复杂性评估的分流式人体动作生成.软件学报,2027,38(5):

复制
相关视频

分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2026-04-27
  • 最后修改日期:2026-06-18
  • 录用日期:
  • 在线发布日期: 2026-09-14
  • 出版日期:
文章二维码
您是第位访问者
版权所有:中国科学院软件研究所 京ICP备05046678号-3
地址:北京市海淀区中关村南四街4号,邮政编码:100190
电话:010-62562563 传真:010-62562533 Email:jos@iscas.ac.cn
技术支持:北京勤云科技发展有限公司

京公网安备 11040202500063号