metricas
covid
Buscar en
European Journal of Psychiatry
Toda la web
Inicio European Journal of Psychiatry Differential diagnosis of schizophrenia using decision tree analysis based on co...
Información de la revista
Vol. 36. Núm. 4.
Páginas 246-251 (octubre - diciembre 2022)
Compartir
Compartir
Descargar PDF
Más opciones de artículo
Visitas
556
Vol. 36. Núm. 4.
Páginas 246-251 (octubre - diciembre 2022)
Original article
Acceso a texto completo
Differential diagnosis of schizophrenia using decision tree analysis based on cognitive testing
Visitas
556
Wentian Donga, Yong Hea, Jiuju Wanga, Chuan Shia, Qihui Niub, Haokui Yuc, Jun Jid, Xin Yua,
,1
a Peking University Sixth Hospital, Peking University Institute of Mental Health, NHC Key Laboratory of Mental Health (Peking University), National Clinical Research Center for Mental Disorders (Peking University Sixth Hospital), Beijing 100191, China
b The First Affiliated Hospital of Zhengzhou University, Zhengzhou, 450052
c Beijing Wanling Pangu Technology Co., Ltd., Beijing, 100089
d College of Computer Science and Technology, Qingdao University, Qingdao, 266000
Este artículo ha recibido
Información del artículo
Resumen
Texto completo
Bibliografía
Descargar PDF
Estadísticas
Figuras (3)
Mostrar másMostrar menos
Abstract
Background and objectives

To explore the discriminatory ability of a decision tree model based on cognitive testing data for the differential diagnosis of schizophrenia.

Methods

This study enrolled 82 patients with schizophrenia and 82 patients with affective disorders. The cognitive function of the two groups of participants was assessed based on learning, symbol coding, digital span, trail making, and category fluency tests. The logistic regression model in the sklearn package in Python was applied to discriminate and analyse the data for all 11 variables in the MATRICS Consensus Cognitive Battery (MCCB).

Results

The recognition rate for schizophrenia and affective disorder using all 11 variables of the MCCB was 82%.

Conclusion

The logistics model based on cognitive data distinguished patients with schizophrenia from those with affective disorder.

Keywords:
Differential diagnosis
Schizophrenia
Decision tree analysis
Cognitive testing
Texto completo
Introduction

Schizophrenia is a mental disorder characterized by hallucinations, delusions, and cognitive dysfunction. This condition has a high disability rate and a lifetime prevalence rate of 0.6%.1 At present, the diagnosis of schizophrenia mainly depends on doctors' judgment, as objective and quantifiable indicators are lacking. Cognitive deficits are one of the main symptoms of schizophrenia. These are the primary symptoms of schizophrenia rather than a result of the disease and are also an important factor affecting the social function and prognosis of patients.2-5 Cognitive deficits in schizophrenia may be objective disease markers with clear auxiliary diagnostic value.6,7 Affective disorder is the most common type of mental illness, with a lifetime prevalence rate as high as 7.4%, with depression accounting for 6.8% and bipolar disorder accounting for 0.6%.1 Patients with affective disorders also have varying degrees of cognitive deficits.8,9

The MATRICS Consensus Cognitive Battery (MCCB) for schizophrenia is often used as an evaluation tool to assess cognitive function in mental illness.10,11 The MCCB was translated and revised by Chuan Shi and colleagues, standardized in the Chinese culture, and has good reliability and validity, with test-retest reliability ranging from 0.73 to 0.94.12,13 The MCCB contains seven dimensions, each of which includes one or more measurement indicators. For example, the spatial span test includes two indicators: the forward and backward spatial span test scores. Many studies have shown that patients with schizophrenia have lower scores than unaffected controls on almost every dimension and each subtest of the MCCB.14-16 Therefore, a cognitive index system based on cognitive measurement indicators, especially a cognitive index system containing multiple cognitive measurements, may be helpful for the auxiliary diagnosis of diseases.

Patients with schizophrenia have a certain degree of affective cognitive impairment17,18 that is often accompanied by depressive symptoms.19 It is difficult to distinguish between schizophrenia and affective disorders based on traditional experience. In recent years, an increasing number of studies have used machine learning for the auxiliary or differential diagnosis of diseases.20 A decision tree algorithm is a machine learning algorithm, first described in "Experiments in Induction" by E. B. Hunt et al. in 1966; however, it was Ross Quinlan who made decision tree a mainstream machine learning algorithm (in 2011, he won the most prestigious award in the field of data mining, the Knowledge Discovery and Data Mining [KDD] Innovation Award). Quinlan proposed the Iterative Dichotomiser 3 (ID3) algorithm in 1979, which stimulated decision tree research.

The present study applied machine learning methods to analyse cognitive test data to identify new methods for performing a differential diagnosis of schizophrenia and affective disorders. This study also used these methods to integrate cognitive test data and evaluate the effect of cognitive variables on the differential diagnosis of schizophrenia and affective disorders.

MethodsParticipants

Schizophrenia group: 82 patients with schizophrenia were selected from the Peking University Sixth Hospital. The enrolment criteria were: 1) meeting the diagnostic criteria for schizophrenia according to the fourth edition of the Diagnostic and Statistical Manual of Mental Disorders in the United States (DSM-4) and 2) age 18–60 years, with an education level above elementary school.

Affective disorder group: 82 patients with affective disorder were selected from the Peking University Sixth Hospital. The enrolment criteria were: 1) meeting the diagnostic criteria for affective disorder according to the DSM-4 and 2) age 18–60 years, with an education level above elementary school.

The exclusion criteria were: 1) associated mental retardation or cerebral organic diseases; 2) severe decline or impulsive excitement and uncooperativeness; 3) substance abuse; 4) hearing or visual impairment; and 5) severe physical illness.

The general clinical information is shown in Table 1. The study was approved by the Ethics Committee of Peking University Sixth Hospital (approval number 2009_1) and all participants signed an informed consent form before the test.

Table 1.

Comparison of basic information and cognitive function between patients with schizophrenia and patients with affective disorders.

  Schizophrenia (n=82)  Affective disorder (n=82)  F/t 
Gender      <0.001  1.000 
Male  41  41   
Female  41  41   
Education level      <0.001  1.000 
Primary school     
Junior high school  12  12     
High school  33  33     
Associate degree  24  24     
Bachelor's degree or higher  10  10     
Age  35.18±7.47  32.99±8.98  1.694  0.092 
HVLT-R Trial 1 total recall score  4.89±1.69  6.04±2.03  -3.938  <0.001 
HVLT-R Trial 2 total recall score  6.95±2.42  7.84±2.09  -2.590  0.010 
HVLT-R Trial 3 total recall score  8.12±2.37  8.94±2.32  -2.233  0.027 
HVLT-R delayed recall total score  6.71±3.09  6.8±3.1  -0.202  0.840 
HVLT-R true-positive recognition hits  6.83±4.08  8.24±3.19  -2.473  0.014 
HVLT-R false-positive errors  0.84±1.55  1.43±1.52  -2.438  0.016 
Total score for symbol coding  24.12±9.04  28.05±9.29  -2.743  0.007 
Total time of trail making  66.51±44.96  43.4±22.61  4.159  <0.001 
Forward spatial span test score  4.94±3.28  5.02±3.6  -0.159  0.874 
Backward spatial span test score  4.89±2.65  5.1±2.35  -0.53  0.597 
Category fluency total score  19.04±6.16  21.43±5.72  -2.575  0.011 
Assessment instrumentsHopkin's verbal learning test-revised (HVLT-R)

This instrument examines the ability to learn and instantly recall, retain, and regenerate word information and to recognize words after a delay. A list of 12 words (three semantic categories with four words in each category) was presented to the participants three times. After each presentation, the participants were asked to recall as many words from the list as possible in any order. Twenty to 30 minutes after the three presentations, the participants were asked to recall the words on this list. Subsequently, a list of 24 words was read to the participants; the words were read one at a time, and the participants were asked if each word has appeared on the original list. The words presented at the recognition stage included the original words, words with the same semantic classification, and unrelated words. The recorded results included the number of correctly named, repeated, and inserted words in trials 1, 2, and 3; delayed recall and re-recognition; and the number of true and false positive words identified in the re-recognition test. The present study used the total numbers of recalls and delayed recalls on the HVLT-R to reflect the patients' verbal learning and memory function.

Symbol coding test

This test is a subtest of the Chinese version of the Brief Assessment of Cognition in Schizophrenia (BACS). It is used to measure the speed of information processing and includes attention and writing exercises. The participants are asked to select the numbers that match different symbols and to fill in the blanks within 90 seconds using a standard template.

Trail making test

This test is a subtest of the Halstead–Reitan (H-R) Neuropsychological Battery. The participants are required to draw a line connecting circles numbered from 1 to 25 that are randomly distributed on a 16K-resolution screen in descending order. The completion time and number of errors are recorded. In addition to measuring the speed of information processing, the test also reflects the participants' attention, cognitive ranking ability, and visual-spatial function.

Spatial span test

This test is similar to the digital span test in the Wechsler Adult Intelligence Scale III (WAIS-III); the only difference is that it is presented visually rather than auditorily. The spatial span test board has 10 squares, each with a number from 1 to 10 printed on the side facing the examiner. Two operations are performed for each sequence length. Two sequence arrangements of the same length are not the same; only the number of blocks that need to be tapped is the same. The present study used the total spatial span scale to reflect the participants' visual-spatial working memory.

Category fluency test

This test requires participants to name as many words as possible within a specific category, such as "animals", "actions", "vegetables", and "vehicles", in 1 minute. This study used the widely used "animals" category for testing. The task required for this test is different from tasks that involve naming words that start with the same sound or the same single word as category fluency tests can activate oral word associations through concepts and categories. The score was the total number of correctly named words. The numbers of repetitions (repeating a correct word) and insertions (words that do not meet the guidelines, such as words that do not fit the category) were also recorded. Many neurocognitive functions are involved in word fluency, which usually reflects information processing speed, vocabulary size, semantic memory, working memory, suppression, and concept maintenance.

Statistical methodsGeneral data processing

Statistical analysis of the demographic data was conducted in IBM SPSS Statistics for Windows, version 22.0. T-tests were used to compare the age of the groups, while chi-square tests were used to compare sex and education levels between the groups.

Analysis of decision tree structure

The entire data analysis runs on Python software, and the source code are shown in Fig. 1. The diagnostic classifier was based on decision tree analysis using a machine learning approach. In this study, 80% and 20% of the data were used for training and testing, respectively.

Fig. 1.

Python source code for decision tree analysis.

(0.27MB).
Results

Patient age, sex, and education level did not differ significantly between the schizophrenia and affective disorder groups. Immediate recall, symbol coding, trail making, and category fluency differed significantly between the groups. The performance of the schizophrenia group was worse than that of the affective disorder group, with the schizophrenia group showing fewer corrections and a longer response time. Delayed recall and spatial span did not differ significantly between the groups (Table 1).

To compare the individual scores of the two groups of patients, scatterplots of eight cognitive test indicators that showed significant differences between the two groups of patients were created. Although the two groups showed significant differences in their average scores, a high degree of data overlap at the individual level was observed (Fig. 2).

Fig. 2.

Scatterplots of the results of cognitive tests.

(0.2MB).

The decision tree analysis method was used to incorporate all 10 variables of the cognitive test scale. Deep machine learning and recognition were performed for the cognitive performance of the patients with schizophrenia and affective disorders. The recognition accuracy rate was 82%. The details are listed in Table 2 and Fig. 3.

Table 2.

Sensitivity and specificity of the decision tree analysis of schizophrenia and affective disorder.

    Clinical diagnosis 
Decision tree analysis  Schizophrenia  Affective disorder  Total 
Schizophrenia  10 
Affective disorder  18  23 
  14  19  33 
Fig. 3.

Analysis steps of the decision tree for classifying schizophrenia and affective disorder.

(0.37MB).
Discussion

This study examined the cognitive function of patients with schizophrenia and affective disorder through multiple dimensions and observed significant differences between the two groups. The results of the decision tree analysis showed a correct recognition rate as high as 82% with the use of cognitive tests to distinguish schizophrenia from affective disorders.

Previous studies have reported differences in cognitive function between schizophrenia and affective disorders.19,21 The cognitive impairment in schizophrenia is more serious, which may be related to the older age and lower education level of patients with schizophrenia.22 The present study strictly matched the two groups of patients by age and education level. Other than digit span, all other cognitive abilities were worse in patients with schizophrenia than in those with affective disorders, a finding that may be related to the disease itself.

At present, few classification studies have applied a logistics model based on cognitive indicators for the comparison of schizophrenia and affective disorder. In this study, patients with schizophrenia and patients with affective disorders showed significant differences in multiple cognitive indicators but had large overlaps in a single cognitive indicator (Table 1); thus, it is difficult to distinguish the two groups using a single indicator. This problem can be solved through machine learning methods. The results of this study provide a reference for future research of the same type and for clinical auxiliary diagnosis based on cognitive deficiencies.

Author contributions

Xin Yu and Wentian Dong designed the study and critically reviewed the manuscript for important content. Wentian Dong wrote the raw manuscript and analyzed data. Xin Yu, Wentian Dong, Chan Shi and Qihui Niu diagnosed the patients. Yong He, Chuan Shi, Haokui Yu, Jun Ji performed the data collection and data analyses. Wentian Dong and Jiuju Wang drafted the initial manuscript. All of the authors reviewed and revised the manuscript.

Ethical considerations

The study was approved by the Ethics Committee of Peking University Sixth Hospital, and all subjects signed an informed consent before the test.

Funding

This work was supported by a grant from National Key R&D Program of China (2018YFC1314200), Beijing Science and Technology Plan (Z2011000055200092).

References
[1]
Y. Huang, Y. Wang, H. Wang, Z. Liu, X. Yu, J. Yan, et al.
Prevalence of mental disorders in China: a cross-sectional epidemiological study: the lancet.
Psychiatry, 6 (2019), pp. 211-224
[2]
Y. Xiang.
Schizophrenia and cognitive dysfunction: Chinese behavioral medicine.
Science, 14 (2005), pp. 620-622
[3]
C. Zhao, L. Cui, G. Cui, Z. Shen, G. Li.
Cognitive function in patients with schizophrenia.
Chin Minkang Med, 21 (2009), pp. 1873-1875
[4]
D.M. Bagner, M.R.D. Melinder, D.M. Barch.
Language comprehension and working memory language comprehension and working memory deficits in patients with schizophrenia.
Schizophr Res, 60 (2003), pp. 299-309
[5]
M.A. Boudewyn, C.S. Carter, T.Y. Swaab.
Cognitive control and discourse comprehension in schizophrenia.
Schizoph Res Treat, 2012 (2012),
[6]
M. Hu, J. Chen, L. Li, Y. Zheng, J. Wang, X. Guo, et al.
Semantic fluency and executive functions as candidate endophenotypes for the early diagnosis of schizophrenia in Han Chinese.
Neurosci Lett, 502 (2011), pp. 173-177
[7]
T. Suto, M. Fukuda, M. Ito, T. Uehara, M. Mikuni.
Multichannel near-infrared spectroscopy in depression and schizophrenia: cognitive brain activation study.
Biol Psychiatry, 55 (2004), pp. 501-511
[8]
C. Baeza-Velasco, S. Guillaume, E. Olie, A. Alacreu-Crespo, A. Cazals, P. Courtet.
Decision-making in major depressive disorder: Subjective complaint, objective performance, and discrepancy between both.
J Affect Disord, 270 (2020), pp. 102-107
[9]
A. Ferrer, J. Labad, N. Salvat-Pujol, J.A. Monreal, M. Urretavizcaya, J.M. Crespo, et al.
Hypothalamic-pituitary-adrenal axis-related genes and cognition in major mood disorders and schizophrenia: a systematic review.
Prog Neuropsychopharmacol Biol Psychiatry, 101 (2020),
[10]
S. Liang, W. Yu, X. Ma, S. Luo, J. Zhang, X. Sun, et al.
Psychometric properties of the MATRICS consensus cognitive battery (MCCB) in Chinese patients with major depressive disorder.
J Affect Disord, 265 (2020), pp. 132-138
[11]
S.M. August, J.N. Kiwanuka, R.P. McMahon, J.M. Gold.
The MATRICS consensus cognitive battery (MCCB): clinical and cognitive correlates.
Schizophr Res, 134 (2012), pp. 76-82
[12]
C. Shi, L. Kang, S. Yao, Y. Ma, T. Li, Y. Liang, et al.
What is the optimal neuropsychological test battery for schizophrenia in China?.
Schizophr Res, 208 (2019), pp. 317-323
[13]
C. Shi, L. Kang, S. Yao, Y. Ma, T. Li, Y. Liang, et al.
The MATRICS consensus cognitive battery (MCCB): co-norming and standardization in China.
Schizophr Res, 169 (2015), pp. 109-115
[14]
O. Bezdicek, J. Michalec, L. Kalisova, T. Kufa, F. Dechterenko, M. Chlebovcova, et al.
Profile of cognitive deficits in schizophrenia and factor structure of the Czech MATRICS consensus cognitive battery.
[15]
S. Kumar, B.H. Mulsant, C. Tsoutsoulas, Z. Ghazala, A.N. Voineskos, C.R. Bowie, et al.
An optimal combination of MCCB and CANTAB to assess functional capacity in older individuals with schizophrenia.
Int J Geriatr Psychiatry, 31 (2016), pp. 1116-1123
[16]
A. McCleery, J. Ventura, R.S. Kern, K.L. Subotnik, D. Gretchen-Doorly, M.F. Green, et al.
Cognitive functioning in first-episode schizophrenia: MATRICS consensus cognitive battery (MCCB) profile of impairment.
Schizophr Res, 157 (2014), pp. 33-39
[17]
D. Hoid, D.-N. Pan, Y. Wang, X. Li.
Implicit emotion regulation deficits in individuals with high schizotypal traits: an ERPstudy.
[18]
K. Lim, S.-A. Lee, A.E. Pinkham, M. Lam, J. Lee.
Evaluation of social cognitive measures in an Asian schizophrenia sample.
Schizophr Res Cognit, 20 (2020),
[19]
P.D. Harvey.
Mood symptoms, cognition, and everyday functioning: in major depression, bipolar disorder, and schizophrenia.
Innov Clin Neurosci, 8 (2011), pp. 14-18
[20]
J. Wang.
Research and Application of Decision Tree Classification Technology in Auxiliary Diagnosis System of Diseases.
Guizhou University, (2008),
[21]
G. Goldstein, W.J. Shemansky, D.N. Allen.
Cognitive function in schizoaffective disorder and clinical subtypes of schizophrenia.
Arch Clin Neuropsychol, 20 (2005), pp. 153-159
[22]
K.T. Mueser, S.I. Pratt, S.J. Bartels, B. Forester, R. Wolfe, C. Cather.
Neurocognition and social skill in older persons with schizophrenia and major mood disorders: An analysis of gender and diagnosis effects.
J Neurolinguistics, 23 (2010), pp. 297-317

Current address: NO.51 Huayuanbei Road, Haitian distract, Beijing, China

Copyright © 2022. Asociación Universitaria de Zaragoza para el Progreso de la Psiquiatría y la Salud Mental
Descargar PDF
Opciones de artículo
es en pt

¿Es usted profesional sanitario apto para prescribir o dispensar medicamentos?

Are you a health professional able to prescribe or dispense drugs?

Você é um profissional de saúde habilitado a prescrever ou dispensar medicamentos