Autism Spectrum Disorder Detection in Children Via Deep Learning Models Based on Facial Images
DOI:
https://doi.org/10.61506/01.00241Keywords:
Autism spectrum disorder, Facial features, Convolutional neural network, Transfer learning, DenseNet-121Abstract
Autism spectrum disorder (ASD) is a complicated psychiatric disease that causes difficulty in communicating with others, and restricted behavior, speech, as well as nonverbal interaction. Children with autism have unique facial characteristics that distinguish them from ordinarily developing children. Therefore, there is a requirement for a precise and automated system capable of early detection of autism in children, yielding accurate results. The objective of this research is to assist both families and psychiatrists in diagnosing autism through a straightforward approach. Specifically, the study employs a deep learning method that utilizes experimentally validated facial features. The technique involves a convolutional neural network along with transfer learning for the detection of autism. MobileNetv2, Xception, ResNet-50, VGG16 and DenseNet-121 were the pretrained models used for detection of autism. The evaluation of these models utilized a dataset sourced from Kaggle, comprising 2,940 facial images. We evaluated the five deep learning models using standard measures like recall, precision, accuracy, F1 score, and ROC curve. The proposed DenseNet-121 model outperformed existing transfer learning models, with 96% accuracy rate. With respect to performance evaluation, the proposed method exhibited superiority over the most recent models. Our model possesses the capability to support healthcare professionals in validating the precision of their initial screening for Autism Spectrum Disorders (ASDs) in pediatric patients.
References
+ Autism Statistics: How Many People Have Autism? (n.d.). Retrieved February 6, 2024, from https://www.crossrivertherapy.com/autism-statistics
Ahmad, I., Rashid, J., Faheem, M., Akram, A., Khan, N. A., & Amin, R. U. (2024). Autism spectrum disorder detection using facial images: A performance comparison of pretrained convolutional neural networks. Healthcare Technology Letters, htl2.12073.
Ahmed, Z. A. T., Albalawi, E., Aldhyani, T. H. H., Jadhav, M. E., Janrao, P., & Obeidat, M. R. M. (2023). Applying Eye Tracking with Deep Learning Techniques for Early-Stage Detection of Autism Spectrum Disorders. Data, 8(11), 168.
Akram, A., Khan, I., Rashid, J., Saddique, M., Idrees, M., Ghadi, Y. Y., & Algarni, A. (2024). Enhanced Steganalysis for Color Images Using Curvelet Features and Support Vector Machine. Computers, Materials & Continua, 78(1), 1311–1328.
Akram, A., Ramzan, S., Rasool, A., Jaffar, A., Furqan, U., & Javed, W. (2022). Image splicing detection using discriminative robust local binary pattern and support vector machine. World Journal of Engineering, 19(4), 459–466.
Akram, A., Rashid, J., Hajjej, F., Yaqoob, S., Hamid, M., Arshad, A., & Sarwar, N. (2023). Recognizing Breast Cancer Using Edge-Weighted Texture Features of Histopathology Images. Computers, Materials & Continua, 77(1), 1081–1101.
Akram, A., Rashid, J., Jaffar, A., Hajjej, F., Iqbal, W., & Sarwar, N. (2024). Weber Law Based Approach for Multi-Class Image Forgery Detection. Computers, Materials & Continua, 78(1), 145–166.
Akram, A., Rashid, J., Jaffar, M. A., Faheem, M., & Amin, R. U. (2023). Segmentation and classification of skin lesions using hybrid deep learning method in the Internet of Medical Things. Skin Research and Technology, 29(11), e13524.
Akter, T., Ali, M. H., Khan, Md. I., Satu, Md. S., Uddin, Md. J., Alyami, S. A., Ali, S., Azad, A., & Moni, M. A. (2021). Improved Transfer-Learning-Based Facial Recognition Framework to Detect Autistic Children at an Early Stage. Brain Sciences, 11(6), 734.
Aldhyani, T. H. H., Nair, R., Alzain, E., Alkahtani, H., & Koundal, D. (2022). Deep Learning Model for the Detection of Real Time Breast Cancer Images Using Improved Dilation-Based Method. Diagnostics, 12(10), 2505.
Alkahtani, H., Aldhyani, T. H. H., & Alzahrani, M. Y. (2023). Deep Learning Algorithms to Identify Autism Spectrum Disorder in Children-Based Facial Landmarks. Applied Sciences, 13(8), 4855.
Alsaade, F. W., & Alzahrani, M. S. (2022). Classification and Detection of Autism Spectrum Disorder Based on Deep Learning Algorithms. Computational Intelligence and Neuroscience, 2022, 1–10.
Autism dataset. Accessed 8th December, 2023, from https://www.kaggle.com/datasets/cihan063/autism-image-data
Carette, R., Cilia, F., Dequen, G., Bosche, J., Guerin, J.-L., & Vandromme, L. (2018). Automatic Autism Spectrum Disorder Detection Thanks to Eye-Tracking and Neural Network-Based Approach. In M. U. Ahmed, S. Begum, & J.-B. Fasquel (Eds.), Internet of Things (IoT) Technologies for HealthCare (Vol. 225, pp. 75–81). Springer International Publishing.
Duranta, D. U. S., Ali, M. S., Das, A. A., Rahman, M. M., Ahsan, M. M., Miah, M. S., & Islam, M. K. (2023). Enhancing Atrial Fibrillation detection accuracy: A wavelet transform filtered single lead ECG signal analysis with artificial neural networks and novel feature extraction. Machine Learning with Applications, 12, 100472.
Elbattah, M., & Cilia, F. (2023). Applications of Machine Learning Methods to Assist the Diagnosis of Autism Spectrum Disorder [Preprint]. Open Science Framework.
Francés, L., Caules, J., Ruiz, A., Soler, C. V., Hervás, A., Fernández, A., Rodríguez-Quiroga, A., & Quintero, J. (2023). An approach for prevention planning based on the prevalence and comorbidity of neurodevelopmental disorders in 6-year-old children receiving primary care consultations on the island of Menorca. BMC Pediatrics, 23(1), 32.
Gaddala, L. K., Kodepogu, K. R., Surekha, Y., Tejaswi, M., Ameesha, K., Kollapalli, L. S., Kotha, S. K., & Manjeti, V. B. (2023). Autism Spectrum Disorder Detection Using Facial Images and Deep Convolutional Neural Networks. Revue d’Intelligence Artificielle, 37(03), 801–806.
Ghosh, T., Banna, Md. H. A., Rahman, Md. S., Kaiser, M. S., Mahmud, M., Hosen, A. S. M. S., & Cho, G. H. (2021). Artificial intelligence and internet of things in screening and management of autism spectrum disorder. Sustainable Cities and Society, 74, 103189.
Goh, K. L., Morris, S., Rosalie, S., Foster, C., Falkmer, T., & Tan, T. (2016). Typically developed adults and adults with autism spectrum disorder classification using centre of pressure measurements. 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 844–848.
Iqbal, S., & Khan, W. (2017). Exploring the Nexus of Service Quality, University Image, and Word-of-Mouth Communication: A Comparative Study of Public and Private Universities. Journal of Policy Options, 4(3), 60-69.
Kanhirakadavath, M. R., & Chandran, M. S. M. (2022). Investigation of Eye-Tracking Scan Path as a Biomarker for Autism Screening Using Machine Learning Algorithms. Diagnostics, 12(2), 518.
Kanner, L. (1968). Autistic disturbances of affective contact. Acta Paedopsychiatrica, 35(4), 100–136.
Kaur, N., & Gupta, G. (n.d.). Autism Disorder Detection Based on Deep Learning: Deep Analysis.
Li, J., Zhong, Y., Han, J., Ouyang, G., Li, X., & Liu, H. (2020). Classifying ASD children with LSTM based on raw videos. Neurocomputing, 390, 226–238.
Li, M., Tang, D., Zeng, J., Zhou, T., Zhu, H., Chen, B., & Zou, X. (2019). An automated assessment framework for atypical prosody and stereotyped idiosyncratic phrases related to autism spectrum disorder. Computer Speech & Language, 56, 80–94.
M. Ghazal, T., Munir, S., Abbas, S., Athar, A., Alrababah, H., & Adnan Khan, M. (2023). Early Detection of Autism in Children Using Transfer Learning. Intelligent Automation & Soft Computing, 36(1), 11–22.
Modak, D. S. (n.d.). Early detection of autism spectrum disorder (ASD) using Machine Learning techniques.
Mohanta, A., & Mittal, V. K. (2022). Analysis and classification of speech sounds of children with autism spectrum disorder using acoustic features. Computer Speech & Language, 72, 101287.
Mujeeb Rahman, K. K., & Subashini, M. M. (2022). Identification of Autism in Children Using Static Facial Features and Deep Neural Networks. Brain Sciences, 12(1), 94.
Pokorny, F. B., Schuller, B., Marschik, P. B., Brueckner, R., Nyström, P., Cummins, N., Bölte, S., Einspieler, C., & Falck-Ytter, T. (2017). Earlier Identification of Children with Autism Spectrum Disorder: An Automatic Vocalisation-Based Approach. Interspeech 2017, 309–313.
Rabbi, Md. F., Hasan, S. M. M., Champa, A. I., & Zaman, Md. A. (2021). A Convolutional Neural Network Model for Early-Stage Detection of Autism Spectrum Disorder. 2021 International Conference on Information and Communication Technology for Sustainable Development (ICICT4SD), 110–114.
Rahman, Md. M., Usman, O. L., Muniyandi, R. C., Sahran, S., Mohamed, S., & Razak, R. A. (2020). A Review of Machine Learning Methods of Feature Selection and Classification for Autism Spectrum Disorder. Brain Sciences, 10(12), 949.
Rashid, A., & Shaker, S. (2023). Autism spectrum Disorder detection Using Face Features based on Deep Neural network. Wasit Journal of Computer and Mathematics Science, 2(1), 74–83.
Rawat, W., & Wang, Z. (2017). Deep Convolutional Neural Networks for Image Classification: A Comprehensive Review. Neural Computation, 29(9), 2352–2449.
Sadik, R., S. Anwar, and M. Reza,. (2021). AutismNet: Recognition of Autism Spectrum Disorder from Facial Expressions using MobileNet Architecture. International Journal of Advanced Trends in Computer Science and Engineering, 10(1), 327–334.
Schelinski, S., Borowiak, K., & Von Kriegstein, K. (2016). Temporal voice areas exist in autism spectrum disorder but are dysfunctional for voice identity recognition. Social Cognitive and Affective Neuroscience, 11(11), 1812–1822.
Singh, A., Laroia, M., Rawat, A., & Seeja, K. R. (2023). Facial Feature Analysis for Autism Detection Using Deep Learning. In A. E. Hassanien, O. Castillo, S. Anand, & A. Jaiswal (Eds.), International Conference on Innovative Computing and Communications (Vol. 703, pp. 539–551). Springer Nature Singapore.
Sridurga, P.D., et al.,. (n.d.). Detecting Autism Spectrum Syndrome using VGG19 and Xception Networks. International Journal of Research in Engineering, Science and Management, 5(12, December 2022).
Talo, M., Baloglu, U. B., Yıldırım, Ö., & Rajendra Acharya, U. (2019). Application of deep transfer learning for automated brain abnormality classification using MR images. Cognitive Systems Research, 54, 176–188.
Thanarajan, T., Alotaibi, Y., Rajendran, S., & Nagappan, K. (2023). Eye-Tracking Based Autism Spectrum Disorder Diagnosis Using Chaotic Butterfly Optimization with Deep Learning Model. Computers, Materials & Continua, 76(2), 1995–2013.
Venkata Sai Krishna Narala, M. S., Vemuri, S., & Kattula, C. (2023). Prediction of Autism Spectrum Disorder Using Efficient Net. 2023 9th International Conference on Advanced Computing and Communication Systems (ICACCS), 1139–1143.
Zhu, F., Wang, S., Liu, W., Zhu, H., Li, M., & Zou, X. (2023). A multimodal machine learning system in early screening for toddlers with autism spectrum disorders based on the response to name. Frontiers in Psychiatry, 14, 1039293.
