nguhistВестник Новосибирского государственного университета. Серия: История, филологияVestnik NSU. Series: History and Philology1818-7919Novosibirsk State University10.25205/1818-7919-2024-23-2-39-55nguhist-1855Research ArticleЯЗЫКОЗНАНИЕLINGUISTICSМетоды машинного обучения для анализа морфологических и лексических особенностей речи мальчиков с расстройствами аутистического спектра и синдромом ДаунаMachine Learning Methods for Analyzing Morphological and Lexical Characteristics of Speech of Boys with Autism Spectrum Disorders and Down Syndromehttps://orcid.org/0000-0002-8992-9654МахныткинаО. В.MakhnytkinaO. V.

Олеся Владимировна Махныткина, кандидат технических наук 

Scopus Author ID 57208002090WoS Researcher ID F-2283-2017 

Санкт-Петербург 

Olesia V. Makhnytkina, Candidate of Sciences (Engineering) 

Scopus Author ID 57208002090WoS Researcher ID F-2283-2017 

St. Petersburg 

makhnytkina@itmo.ruhttps://orcid.org/0000-0002-6293-009XФроловаО. В.FrolovaO. V.

Ольга Владимировна Фролова, кандидат биологических наук 

Scopus Author ID 8521676200WoS Researcher ID G-2649-2015 

Санкт-Петербург 

Olga V. Frolova, Candidate of Sciences (Biology) 

Scopus Author ID 8521676200WoS Researcher ID G-2649-2015 

St. Petersburg 

olchel@yandex.ruhttps://orcid.org/0000-0002-6073-0393ЛяксоЕ. Е.LyaksoE. E.

Елена Евгеньевна Ляксо, доктор биологических наук, профессор 

Scopus Author ID 24468656100WoS Researcher ID H-9904-2013 

Санкт-Петербург 

Elena E. Lyakso, Doctor of Sciences (Biology), Professor 

Scopus Author ID 24468656100WoS Researcher ID H-9904-2013 

St. Petersburg 

lyakso@gmail.comУниверситет ИТМОРоссияITMO UniversityRussian FederationСанкт-Петербургский государственный университетРоссияSt. Petersburg State UniversityRussian Federation2024210220242323955Copyright © Махныткина О.В., Фролова О.В., Ляксо Е.Е., 20242024Махныткина О.В., Фролова О.В., Ляксо Е.Е.Makhnytkina O.V., Frolova O.V., Lyakso E.E.Данная работа распространяется под лицензией Creative Commons Attribution 4.0.This work is licensed under a Creative Commons Attribution 4.0 License.https://nguhist.elpub.ru/jour/article/view/1855

Предлагается подход к выявлению различий в речи мальчиков с типичным развитием (ТР), расстройствами аутистического спектра (РАС) и синдромом Дауна (СД) на основе сравнения морфологических и лексических характеристик их речи. В рамках исследования были интервьюированы 69 детей. Для каждой реплики ребенка выделено по 45 лингвистических признаков. На основании критерия Манна – Уитни выявлены различия между детьми с ТР и РАС, детьми с ТР и СД по 31 лингвистическому признаку, между детьми с РАС и СД по 15 признакам. Эти признаки были использованы для построения классификационных моделей методами машинного обучения. Выявленные признаки показали хорошую разделяющую способность, была достигнута точность классификации диалогов равная 88 %.

Purpose

Purpose. In this paper, we propose an approach to identifying significant differences in the speech of typically developing boys (TD), boys with Autism Spectrum Disorder (ASD) and Down syndrome (DS) based on a comparison of morphological and lexical characteristics of their speech. The linguistic characteristics were extracted automatically using the morphological analyzer pymorphy2. Sixty nine boys were interviewed. In total, 45 linguistic features were extracted from each dialogue.

Results

Results. The Mann – Whitney U test was used for assessing the differences in linguistic features of speech, and differences were identified for 31 linguistic features of speech of boys with TD and with ASD, 31 linguistic features of speech of boys with TD and with DS, and 15 linguistic features of speech of boys with ASD and with DS. These features were used to build classification models using machine learning methods: gradient boosting, random forest, and AdaBoost algorithm. The identified features showed good separability, and the accuracy of the classification of the dialogues of boys with typical development, autism spectrum disorders and Down syndrome equal to 88 % was achieved.

детская речьлингвистические признакимашинное обучениерасстройства аутистического спектрасиндром Даунаchildren’s speechlinguistic featuresmachine learningautism spectrum disorderDown syndromeИсследование выполнено при финансовой поддержке Российского научного фонда (проект RSF-DST № 22-45-02007)The study was funded by Russian Science Foundation (project RSF-DST no. 22-45-02007)ReferencesГородный В. А., Ляксо Е. Е. Характеристика речи детей 6–7 лет с расстройствами аутистического спектра и синдромом Дауна // Теоретическая и прикладная лингвистика. 2018. Т. 4, № 2. С. 22–37.Adamu A. S., Abdullahi S. E., Aminu R. K. A Survey on Software Applications use in Therapy for Autistic Children. In: 15th International Conference on Electronics, Computer and Computation (ICECCO), 2019, pp. 1–4. DOI 10.1109/ICECCO48375.2019.9043237Елисеева М. Б. Становление индивидуальной языковой системы ребенка. Ранние этапы. М.: ЯСК, 2015. 344 с.Cho S., Liberman M., Ryant N., Cola M., Schultz R.T., Julia Parish-Morris J. Automatic detection of Autism Spectrum Disorder in children using acoustic and text features from brief natural conversations. In: Proc. Interspeech 2019: 20th Annual Conference of the International Speech Communication Association, 2019, pp. 2513–2517. DOI 10.21437/Interspeech.2019-1452Лебединский В. В. Нарушения психического развития в детском возрасте. М.: Академия, 2003. 140 с.Cleland J., Wood S., Hardcastle W., Wishart J., Timmins C. Relationship between speech, oromotor, language and cognitive abilities in children with Down’s syndrome. International Journal of Language and Communication Disorders, 2010, vol. 45 (1), pp. 83–95.Ляксо Е. Е., Фролова О. В., Гречаный С. В., Матвеев Ю. Н., Верхоляк О. В., Карпов А. А. Голосовой портрет ребенка с типичным и атипичным развитием: Монография. СПб.: Изд.-полигр. ассоциация высших учебных заведений, 2020. 204 с.Eliseeva M. B. Stanovlenie individual'noi yazykovoi sistemy rebenka. Rannie etapy [Formation of a Child’s Individual Language System: Early Stages]. Moscow, Yazyki slavyanskoi kul'tury Publ., 2015, 344 р. (in Russ.)Ляксо Е. Е., Фролова О. В. Анализ текстов речи «взрослый – ребенок», «взрослый – взрослый» при нормальном и атипичном развитии информантов // Теоретическая и прикладная лингвистика. 2017. Т. 2. С. 20–47.Fusaroli R., Lambrechts A., Bang D., Bowler D. M., Gaigg S. B. Is Voice a Marker for Autism Spectrum Disorder? A Systematic Review and Meta-Analysis. Autism Research, 2017, vol. 10, pp. 384–407.Николаев А. С., Фролова О. В., Городный В. А., Ляксо Е. Е. Характеристика ответных реплик детей 5–11 лет с расстройствами аутистического спектра в диалогах со взрослыми // Вопросы психолингвистики. 2019. Т. 4, № 42. С. 92–105.Gorodnyi V. A., Lyakso E. E. Kharakteristika rechi detei 6–7 let s rasstroistvami autisticheskogo spektra i sindromom Dauna [Characteristic of Speech of Children aged 6‒7 years with Autism Spectrum Disorders and Down Syndrome]. Teoreticheskaya i prikladnaya lingvistika [Theoretical and Applied Linguistics], 2018, vol. 4, no. 2, pp. 22–37. (in Russ.)Adamu A. S., Abdullahi S. E., Aminu R. K. A Survey on Software Applications use in Therapy for Autistic Children // 15th International Conference on Electronics, Computer and Computation (ICECCO). 2019. P. 1–4. DOI 10.1109/ICECCO48375.2019.9043237Grossman R. B., Edelson L. R., Tager-Flusberg H. Emotional facial and vocal expressions during story retelling by children and adolescents with high-functioning autism. Journal of Speech, Language, and Hearing Research, 2013, vol. 56 (3), pp. 1035–1044.Cho S., Liberman M., Ryant N., Cola M., Schultz R. T., Julia Parish-Morris J. Automatic detection of Autism Spectrum Disorder in children using acoustic and text features from brief natural conversations // Proc. Interspeech 2019: 20th Annual Conference of the International Speech Communication Association. 2019. P. 2513–2517. DOI 10.21437/Interspeech.2019-1452Hessling A, Brimo D. M. Spoken fictional narrative and literacy skills of children with Down syndrome. Journal of Communication Disorders, 2019, no. 79, pp. 76–89. DOI 10.1016/j.jcomdis.2019.03.005Cleland J., Wood S., Hardcastle W., Wishart J., Timmins C. Relationship between speech, oromotor, language and cognitive abilities in children with Down’s syndrome // International Journal of Language and Communication Disorders. 2010. Vol. 45 (1). P. 83–95.Kanner L. Autistic disturbances of affective contact. Nervous Child, 1943, vol. 2, pp. 217–250.Fusaroli R., Lambrechts A., Bang D., Bowler D. M., Gaigg S. B. Is Voice a Marker for Autism Spectrum Disorder? // A Systematic Review and Meta-Analysis. Autism Research. 2017. Vol. 10. P. 384–407.Kumin L. Early communication skills for children with Down syndrome: A guide for parents and professionals. Bethesda, MD, Woodbine House, 2003, 391 p.Grossman R. B., Edelson L. R., Tager-Flusberg H. Emotional facial and vocal expressions during story retelling by children and adolescents with high-functioning autism // Journal of Speech, Language, and Hearing Research. 2013. Vol. 56 (3). Р. 1035–1044.Lebedinsky V. V. Narusheniya psikhicheskogo razvitiya v detskom vozraste [Disorders of Mental Development in Childhood]. Moscow, Akademiya Publ., 2003, 140 p. (in Russ.)Hessling A., Brimo D. M. Spoken fictional narrative and literacy skills of children with Down syndrome // Journal of Communication Disorders. 2019. Vol. 79. P. 76–89. DOI 10.1016/j.jcomdis.2019.03.005Lyakso E., Frolova O. Speech features of typically developing children and children with autism spectrum disorders. In: Abstract book. BIT’s 7th Annual World Congress of Neurotalk – 2016.Innovation of Neuroscience. 2016.Kanner L. Autistic disturbances of affective contact // Nervous Child. 1943. Vol. 2. P. 217–250.Lyakso E., Frolova O., Karpov A. A New Method for Collection and Annotation of Speech Data of Atypically Developing Children. In: International Conference on Sensor Networks and Signal Processing (SNSP), 2018, pp. 175–180. DOI 10.1109/SNSP.2018.00040Kumin L. Early communication skills for children with Down syndrome: A guide for parents and professionals. Bethesda, MD: Woodbine House, 2003. 391 p.Lyakso E. E., Frolova O. V. Analiz tekstov rechi “vzroslyi – rebenok”, “vzroslyi – vzroslyi” pri normal'nom i atipichnom razvitii informantov [Analysis of “Adult-Child” and “Adult-Adult” Speech Texts Produced by Informant with Typical and Atypical Development] Teoreticheskaya i prikladnaya lingvistika [Theoretical and Applied Linguistics], 2017, vol. 2, pp. 20–47. (in Russ.)Lyakso E., Frolova O. Speech features of typically developing children and children with autism spectrum disorders. In: Abstract book. BIT’s 7th Annual World Congress of Neurotalk – 2016. Innovation of Neuroscience. 2016.Lyakso E. E., Frolova O. V., Grechanyi S. V., Matveev Yu. N., Verkholyak O. V., Karpov A. A. Golosovoi portret rebenka s tipichnym i atipichnym razvitiem [Speech Profile of a Child with Typical and Atypical Development]. St. Petersburg, Izdatel'sko-poligraficheskaya assotsiatsiya vysshikh uchebnykh zavedenii, 2020, 204 p. (in Russ.)Lyakso E., Frolova O., Karpov A. A New Method for Collection and Annotation of Speech Data of Atypically Developing Children // International Conference on Sensor Networks and Signal Processing (SNSP). 2018. P. 175–180. DOI 10.1109/SNSP.2018.00040Makhnytkina O. V., Grigorev A., Nikolaev A. Analysis of dialogues of typically developing children, children with Down syndrome and ASD using machine learning methods. Lecture Notes in Computer Science, 2021, vol. 12997, p. 397–406. DOI 10.1007/978-3-030-87802-3_36Makhnytkina O. V., Grigorev A., Nikolaev A. Analysis of dialogues of typically developing children, children with Down syndrome and ASD using machine learning methods // Lecture Notes in Computer Science. 2021. P. 397–406. DOI 10.1007/978-3-030-87802-3_36.Matveev Y., Matveev A., Frolova O., Lyakso E. Automatic Recognition of the Psychoneurological State of Children: Autism Spectrum Disorders, Down Syndrome, Typical Development. Speech and Computer. SPECOM 2021. Lecture Notes in Computer Science, 2021, vol. 12997, pp. 417–425. DOI 10.1007/978-3-030-87802-3_38Matveev Y., Matveev A., Frolova O., Lyakso E. Automatic Recognition of the Psychoneurological State of Children: Autism Spectrum Disorders, Down Syndrome, Typical Development // Speech and Computer. SPECOM 2021. Lecture Notes in Computer Science. 2021. Vol. 12997. P. 417–425. DOI 10.1007/978-3-030-87802-3_38Mazzaggio G., Shield A. The Production of Pronouns and Verb Inflections by Italian Children with ASD: A New Dataset in a Null Subject Language. Journal of Autism and Developmental Disorders, 2020, vol. 50, pp. 1425–1433. DOI 10.1007/s10803-019-04349-7Mazzaggio G., Shield A. The Production of Pronouns and Verb Inflections by Italian Children with ASD: A New Dataset in a Null Subject Language // Journal of Autism and Developmental Disorders. 2020. Vol. 50. P. 1425–1433. DOI 10.1007/s10803-019-04349-7Nicholas J. S., Charles J. M., Carpenter L. A., King L. B., Jenner W., Spratt E. G. Prevalence and characteristics of children with autism-spectrum disorders. Annals of Epidemiology, 2008, vol. 18 (2), pp. 130–136.Nicholas J. S., Charles J. M., Carpenter L. A., King L. B., Jenner W., Spratt E. G. Prevalence and characteristics of children with autism-spectrum disorders // Annals of Epidemiology. 2008. Vol. 18 (2). P. 130–136.Nikolaev A. S., Frolova O. V., Gorodnyi V. A., Lyakso E. E. Kharakteristika otvetnykh replik detei 5–11 let s rasstroistvami autisticheskogo spektra v dialogakh so vzroslymi [Features of Responses of 5–11 years old Children with Autism Spectrum Disorders in Dialogues with Adults]. Voprosy psikholingvistiki [Journal of Psycholinguistics], 2019, vol. 4, no. 42, pp. 92–105. (in Russ.)Penke M. Verbal Agreement Inflection in German Children With Down Syndrome // Journal of Speech, Language, and Hearing Research. 2018. Vol. 61 (9). P. 2217–2234. DOI 10.1044/2018_JSLHR-L-17-0241Penke M. Regular and irregular inflection in Down syndrome – New evidence from German. Cortex, 2019, vol. 116, pp. 192–208. DOI 10.1016/j.cortex.2018.08.010Penke M. Regular and irregular inflection in Down syndrome – New evidence from German // Cortex. 2019. Vol. 116. P. 192–208. DOI 10.1016/j.cortex.2018.08.010Penke M. Verbal Agreement Inflection in German Children With Down Syndrome. Journal of Speech, Language, and Hearing Research, 2018, vol. 61 (9), pp. 2217–2234. DOI 10.1044/2018_JSLHR-L-17-0241Pokorny F. B., Schuller B., Marschik P. B., Brueckner R., Nyström P., Cummins N., Bölte S., Einspieler C., Falck-Ytter T. Earlier Identification of Children with Autism Spectrum Disorder: An Automatic Vocalisation-Based Approach // Interspeech. 2017. P. 309–313. DOI 10.21437/Interspeech.2017-1007Pokorny F. B., Schuller B., Marschik P. B., Brueckner R., Nyström P., Cummins N., Bölte S., Einspieler C., Falck-Ytter T. Earlier Identification of Children with Autism Spectrum Disorder: An Automatic Vocalisation-Based Approach. Interspeech, 2017, pp. 309–313. DOI 10.21437/Interspeech.2017-1007Schopler E., Reichler R. J., DeVellis R. F., Daly K. Toward objective classification of childhood autism: Childhood Autism Rating Scale (CARS) // Journal of Autism and Developmental Disorders. 1980. March. No. 10 (1). P. 91–103. DOI 10.1007/BF02408436Schopler E., Reichler R. J., DeVellis R. F., Daly K. Toward objective classification of childhood autism: Childhood Autism Rating Scale (CARS). Journal of Autism and Developmental Disorders, 1980, March, no. 10 (1), pp. 91–103. DOI 10.1007/BF02408436Tek S., Mesite L., Fein D., Naigles L. Longitudinal analyses of expressive language development reveal two distinct language profiles among young children with autism spectrum disorders // Journal of Autism and Developmental Disorders. 2014. Vol. 44 (1). P. 75–89.Tek S., Mesite L., Fein D., Naigles L. Longitudinal analyses of expressive language development reveal two distinct language profiles among young children with autism spectrum disorders. Journal of Autism and Developmental Disorders, 2014, vol. 44 (1), pp. 75–89.Terzi A., Marinis T., Zafeiri A., Francis K. Subject and Object Pronouns in High-Functioning Children with ASD of a Null-Subject Language // Frontiers in Psychology. 2019. Vol. 10, no. 1301. P. 1–8. DOI 10.3389/fpsyg.2019.01301Terzi A., Marinis T., Zafeiri A., Francis K. Subject and Object Pronouns in High-Functioning Children with ASD of a Null-Subject Language. Frontiers in Psychology, 2019, vol. 10, p. 1301. DOI 10.3389/fpsyg.2019.01301Wing L. The definition and prevalence of autism: a Review // European Child and Adolescent Psychiatry. 1993. Vol. 2 (1). P. 61–74.Wing L. The definition and prevalence of autism: a Review. European Child and Adolescent Psychiatry, 1993, vol. 2 (1), pp. 61–74.

The authors declare that there are no conflicts of interest present.