Auxiliary Diagnosis for Parkinson’s Disease Using Multimodel Feature Analysis
Author:
Affiliation:

  • Article
  • | |
  • Metrics
  • |
  • Reference [54]
  • |
  • Related [20]
  • | | |
  • Comments
    Abstract:

    Parkinson’s disease is a widespread neurodegenerative disease that slowly impairs the motor and certain cognitive functions of patients. It is insidious and incurable and can cause a significant burden on sufferers and their families. However, clinical diagnosis of Parkinson’s disease typically relies on subjective rating scales, which can be influenced by the examinee’s recall bias and assessor subjectivity. Numerous researchers have investigated the physiological aspects of Parkinson’s disease from multiple modalities and have provided objective and quantifiable tools for auxiliary diagnosis. However, given the diversity of neurodegenerative diseases and the similarities in their effects, it remains a problem among unimodal methods built upon the representations of Parkinson’s disease to identify the disease uniquely. To address this issue, a multimodal auxiliary diagnosis system comprising the paradigms that evoke aberrant behaviors of Parkinson’s disease is developed in this study. First, parametric tests of the features are performed based on the results of the normal distribution test, and statistically significant feature sets are constructed (p<0.05). Second, multimodal data are collected from 38 cases in a clinical setting using the MDS-UPDRS scale. Finally, the significance of different feature combinations for the assessment of Parkinson’s disease is analyzed based on gait and eye movement modalities; the high immersion triggered task paradigm and the multimodal Parkinson’s disease auxiliary diagnosis system are validated in virtual reality scenarios. It is worth noting that it only takes 2–4 tasks for the combination of gait and eye movement modalities to obtain an average AUC of 0.97 and accuracy of 0.92.

    Reference
    [1] Hirtz D, Thurman DJ, Gwinn-Hardy K, Mohamed M, Chaudhuri AR, Zalutsky R. How common are the "common" neurologic disorders? Neurology, 2007, 68(5):326-337.
    [2] Poewe W, Seppi K, Tanner CM, Halliday GM, Brundin P, Volkmann J, Schrag AE, Lang AE. Parkinson disease. Nature Reviews Disease Primers, 2017, 3:17013.
    [3] Zhou JH, Li JC, Papaneri AB, Kobzar NP, Cui GH. Dopamine neuron challenge test for early detection of Parkinson's disease. npj Parkinson's Disease, 2021, 7(1):116.
    [4] Goetz CG, Fahn S, Martinez-Martin P, et al. Movement disorder society-sponsored revision of the unified Parkinson's disease rating scale (MDS-UPDRS):Process, format, and clinimetric testing plan. Movement Disorders, 2007, 22(1):41-47.
    [5] Taylor Tavares AL, Jefferis GSXE, Koop M, Hill BC, Hastie T, Heit G, Bronte-Stewart HM. Quantitative measurements of alternating finger tapping in Parkinson's disease correlate with UPDRS motor disability and reveal the improvement in fine motor control from medication and deep brain stimulation. Movement Disorders, 2005, 20(10):1286-1298.
    [6] Pagan FL. Improving outcomes through early diagnosis of Parkinson's disease. MJH Life Sciences, 2012, 18(S7):S176-S182.
    [7] Fröhlich H, Bontridder N, Petrovska-Delacréta D, et al. Leveraging the potential of digital technology for better individualized treatment of Parkinson's disease. Frontiers in Neurology, 2022, 13:788427.
    [8] Kamran I, Naz S, Razzak I, Imran M. Handwriting dynamics assessment using deep neural network for early identification of Parkinson's disease. Future Generation Computer Systems, 2021, 117:234-244.
    [9] Pereira CR, Pereira DR, Rosa GH, Albuquerque VHC, Weber SAT, Hook C, Papa JP. Handwritten dynamics assessment through convolutional neural networks:An application to Parkinson's disease identification. Artificial Intelligence in Medicine, 2018, 87:67-77.
    [10] Tang W, Van Ooijen PMA, Sival DA, Maurits NM. 2D gait skeleton data normalization for quantitative assessment of movement disorders from freehand single camera video recordings. Sensors, 2022, 22(11):4245.
    [11] Khan T, Lundgren LE, Anderson DG, Nowak I, Dougherty M, Verikas A, Pavel M, Jimison H, Nowaczyk S, Aharonson V. Assessing Parkinson's disease severity using speech analysis in non-native speakers. Computer Speech & Language, 2020, 61:101047.
    [12] Farashi S. Analysis of vertical eye movements in Parkinson's disease and its potential for diagnosis. Applied Intelligence, 2021, 51(11):8260-8270.
    [13] Hsiao I T, Weng Y H, Hsieh C J, Lin W Y, Wey S P, Kung M P, Yen T C, Lu C S, Lin K J. Correlation of Parkinson disease severity and 18F-DTBZ positron emission tomography. JAMA Neurology, 2014, 71(6):758-766.
    [14] Mozhdehfarahbakhsh A, Chitsazian S, Chakrabarti P, Chakrabarti T, Kateb B, Nami M. An MRI-based deep learning model to predict Parkinson's disease stages. Health Informatics, 2021.
    [15] Dhawan V, Dhoat S, Williams AJ, DiMarco A, Pal S, Forbes A, Tobías A, Martinez-Martin P, Chaudhuri KR. The range and nature of sleep dysfunction in untreated Parkinson's disease (PD). A comparative controlled clinical study using the Parkinson's disease sleep scale and selective polysomnography. Journal of the Neurological Sciences, 2006, 248(1-2):158-162.
    [16] Wen CJ, Yen AMF, Chiu SYH, Chen SLS, Fann JCY, Hwang YC, Chen TF, Wen YR, Liou HH, Chen HH. Active and passive methods of detecting Parkinson's disease. Journal of the American Geriatrics Society, 2015, 63(6):1261-1263.
    [17] Axelrod BN, Meyers JE, Davis JJ. Finger tapping test performance as a measure of performance validity. The Clinical Neuropsychologist, 2014, 28(5):876-888.
    [18] Swaine BR, Desrosiers J, Bourbonnais D, Larochelle JL. Norms for 15- to 34-year-olds for different versions of the finger-to-nose test. Archives of Physical Medicine and Rehabilitation, 2005, 86(8):1665-1669.
    [19] Oung QW, Muthusamy H, Lee HL, Basah SN, Yaacob S, Sarillee M, Lee CH. Technologies for assessment of motor disorders in Parkinson's disease:A review. Sensors, 2015, 15(9):21710-21745.
    [20] Bot BM, Suver C, Neto EC, Kellen M, Klein A, Bare C, Doerr M, Pratap A, Wilbanks J, Dorsey ER, Friend SH, Trister AD. The mPower study, Parkinson disease mobile data collected using ResearchKit. Scientific Data, 2016, 3(1):160011.
    [21] Monje MHG, Foffani G, Obeso J, Sánchez-Ferro Á. New sensor and wearable technologies to aid in the diagnosis and treatment monitoring of Parkinson's disease. Annual Review of Biomedical Engineering, 2019, 21(1):111-143.
    [22] Lu RR, Xu Y, Li XH, Fan YL, Zeng WQ, Tan Y, Ren K, Chen WW, Cao XB. Evaluation of wearable sensor devices in Parkinson's disease:A review of current status and future prospects. Parkinson's Disease, 2020, 2020:4693019.
    [23] Barth J, Klucken J, Kugler P, Kammerer T, Steidl R, Winkler J, Hornegger J, Eskofier B. Biometric and mobile gait analysis for early diagnosis and therapy monitoring in Parkinson's disease. In:Proc.of the 2011 Annual Int'l Conf. of the IEEE Engineering in Medicine and Biology Society. Boston:IEEE, 2011. 868-871.
    [24] Bae J, Tomizuka M. A tele-monitoring system for gait rehabilitation with an inertial measurement unit and a shoe-type ground reaction force sensor. Mechatronics, 2013, 23(6):646-651.
    [25] Altilio R, Rossetti A, Fang Q, Gu XD, Panella M. A comparison of machine learning classifiers for smartphone-based gait analysis. Medical & Biological Engineering & Computing, 2021, 59(3):535-546.
    [26] Capecci M, Pepa L, Verdini F, Ceravolo MG. A smartphone-based architecture to detect and quantify freezing of gait in Parkinson's disease. Gait & Posture, 2016, 50:28-33.
    [27] Aich S, Pradhan PM, Chakraborty S, Kim HC, Kim HT, Lee HG, Kim IH, Joo MI, Jong Seong S, Park J. Design of a machine learning-assisted wearable accelerometer-based automated system for studying the effect of dopaminergic medicine on gait characteristics of Parkinson's patients. Journal of Healthcare Engineering, 2020, 2020:1823268.
    [28] Cao XG, Xue YZ, Chen JS, Chen XH, Ma Y, Hu CH, Ma HM, Ma HB. Video based shuffling step detection for parkinsonian patients using 3D convolution. IEEE Trans. on Neural Systems and Rehabilitation Engineering, 2021, 29:641-649.
    [29] Yan SJ, Xiong YJ, Lin DH. Spatial temporal graph convolutional networks for skeleton-based action recognition. In:Proc. of the 32nd AAAI Conf. on Artificial Intelligence. New Orleans:AAAI, 2018. 912.
    [30] Guo R, Shao XX, Zhang CC, Qian XH. Multi-scale sparse graph convolutional network for the assessment of parkinsonian gait. IEEE Trans. on Multimedia, 2022, 24:1583-1594.
    [31] Just MA, Carpenter PA. A theory of reading:From eye fixations to comprehension. Psychological Review, 1980, 87(4):329-354.
    [32] Srivastava A, Goyal V, Sood SK, Sharma R. Reduced saccadic velocity and pupillary width in young onset Parkinson's disease. Neurology, Psychiatry and Brain Research, 2018, 27:17-20.
    [33] Zhang JY, Zhang B, Ren QG, Zhong Q, Li Y, Liu GT, Ma XT, Zhao CP. Eye movement especially vertical oculomotor impairment as an aid to assess Parkinson's disease. Neurological Sciences, 2021, 42(6):2337-2345.
    [34] Anastasopoulos D, Ziavra N, Savvidou E, Bain P, Bronstein AM. Altered eye-to-foot coordination in standing Parkinsonian patients during large gaze and whole-body reorientations. Movement Disorders, 2011, 26(12):2201-2211.
    [35] Zhang Y, Yan AJ, Liu BY, Wan Y, Zhao YC, Liu Y, Tan JX, Song L, Gu Y, Liu ZG. Oculomotor performances are associated with motor and non-motor symptoms in Parkinson's disease. Frontiers in Neurology, 2018, 9:960.
    [36] Wu CC, Cao B, Dali V, Gagliardi C, Barthelemy OJ, Salazar RD, Pomplun M, Cronin-Golomb A, Yazdanbakhsh A. Eye movement control during visual pursuit in Parkinson's disease. PeerJ, 2018, 6:e5442.
    [37] Tsitsi P, Benfatto MN, Seimyr GÖ, Larsson O, Svenningsson P, Markaki I. Fixation duration and pupil size as diagnostic tools in Parkinson's disease. Journal of Parkinson's Disease, 2021, 11(2):865-875.
    [38] Ma WB, Li M, Wu JR, Zhang ZH, Jia FF, Zhang MS, Bergman H, Li XM, Ling ZP, Xu X. Multiple step saccades in simply reactive saccades could serve as a complementary biomarker for the early diagnosis of Parkinson's disease. Frontiers in Aging Neuroscience, 2022, 14:912967.
    [39] Talman LS, Hiller AL. Approach to posture and gait in Huntington's disease. Frontiers in Bioengineering and Biotechnology, 2021, 9:668699.
    [40] 敖翔, 王绪刚, 戴国忠, 王宏安. 基于多通道融合的连续手写识别纠错方法. 软件学报, 2007, 18(9):2162-2173. http://www.jos.org.cn/1000-9825/18/2162.htm
    Ao X, Wang XG, Dai GZ, Wang HA. Error correction of continuous handwriting recognition by multimodal fusion. Ruan Jian Xue Bao/Journal of Software, 2007, 18(9):2162-2173 (in Chinese with English abstract). http://www.jos.org.cn/1000-9825/18/2162.htm
    [41] 丁静, 舒祥波, 黄捧, 姚亚洲, 宋砚. 基于多模态多粒度图卷积网络的老年人日常行为识别. 软件学报, 2023, 34(5):2350-2364. http://www.jos.org.cn/1000-9825/6439.htm
    Ding J, Shu XB, Huang P, Yao YZ, Song Y. Multimodal and multi-granularity graph convolutional networks for elderly daily activity recognition. Ruan Jian Xue Bao/Journal of Software, 2023, 34(5):2350-2364 (in Chinese with English abstract). http://www.jos.org.cn/1000-9825/6439.htm
    [42] Zhan AD, Mohan S, Tarolli C, Schneider RB, Adams JL, Sharma S, Elson MJ, Spear KL, Glidden AM, Little MA, Terzis A, Dorsey ER, Saria S. Using smartphones and machine learning to quantify Parkinson disease severity:The mobile Parkinson disease score. JAMA Neurology, 2018, 75(7):876-880.
    [43] Omberg L, Chaibub Neto E, Perumal TM, et al. Remote smartphone monitoring of Parkinson's disease and individual response to therapy. Nature Biotechnology, 2022, 40(4):480-487.
    [44] Wan SH, Liang Y, Zhang Y, Guizani M. Deep multi-layer perceptron classifier for behavior analysis to estimate Parkinson's disease severity using smartphones. IEEE Access, 2018, 6:36825-36833.
    [45] Arora S, Venkataraman V, Zhan A, Donohue S, Biglan KM, Dorsey ER, Little MA. Detecting and monitoring the symptoms of Parkinson's disease using smartphones:A pilot study. Parkinsonism & Related Disorders, 2015, 21(6):650-653.
    [46] Oung QW, Muthusamy H, Basah SN, Lee H, Vijean V. Empirical wavelet transform based features for classification of Parkinson's disease severity. Journal of Medical Systems, 2018, 42(2):29.
    [47] Vasquez-Correa JC, Arias-Vergara T, Orozco-Arroyave JR, Eskofier B, Klucken J, Noth E. Multimodal assessment of Parkinson's disease:A deep learning approach. IEEE Journal of Biomedical and Health Informatics, 2019, 23(4):1618-1630.
    [48] Barth J, Sünkel M, Bergner K, Schickhuber G, Winkler J, Klucken J, Eskofier B. Combined analysis of sensor data from hand and gait motor function improves automatic recognition of Parkinson's disease. In:Proc. of the 2012 Annual Int'l Conf. of the IEEE Engineering in Medicine and Biology Society. San Diego:IEEE, 2012. 5122-5125.
    [49] Mazzoni P, Shabbott B, Cortés JC. Motor control abnormalities in Parkinson's disease. Cold Spring Harbor Perspectives in Medicine, 2012, 2(6):a009282.
    [50] Teulings HL, Contreras-Vidal JL, Stelmach GE, Adler CH. Parkinsonism reduces coordination of fingers, wrist, and arm in fine motor control. Experimental Neurology, 1997, 146(1):159-170.
    [51] Anderson TJ, MacAskill MR. Eye movements in patients with neurodegenerative disorders. Nature Reviews Neurology, 2013, 9(2):74-85.
    [52] Wang CY, Gao Y, Mathur A, De C. Williams AC, Lane ND, Bianchi-Berthouze N. Leveraging activity recognition to enable protective behavior detection in continuous data. Proc. of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2021, 5(2):81.
    Cited by
Get Citation

强薇,杜宇,李信金,范向民,苏闻,陈海波,孙伟,田丰.多模态特征分析的帕金森病辅助诊断方法.软件学报,2024,35(5):2192-2207

Copy
Share
Article Metrics
  • Abstract:1044
  • PDF: 3582
  • HTML: 1492
  • Cited by: 0
History
  • Received:April 10,2023
  • Revised:June 08,2023
  • Online: September 11,2023
  • Published: May 06,2024
You are the firstVisitors
Copyright: Institute of Software, Chinese Academy of Sciences Beijing ICP No. 05046678-4
Address:4# South Fourth Street, Zhong Guan Cun, Beijing 100190,Postal Code:100190
Phone:010-62562563 Fax:010-62562533 Email:jos@iscas.ac.cn
Technical Support:Beijing Qinyun Technology Development Co., Ltd.

Beijing Public Network Security No. 11040202500063