Overview of MentalRiskES at IberLEF 2024Early Detection of Mental Disorders Risk in Spanish

  1. Mármol-Romero, Alba María
  2. Moreno-Muñoz, Adrián
  3. Plaza-del-Arco, Flor Miriam
  4. Molina-González, M. Dolores
  5. Martín-Valdivia, M. Teresa
  6. Ureña-López, L. Alfonso
  7. Montejo-Ráez, Arturo
Zeitschrift:
Procesamiento del lenguaje natural

ISSN: 1135-5948

Datum der Publikation: 2024

Nummer: 73

Seiten: 435-448

Art: Artikel

Andere Publikationen in: Procesamiento del lenguaje natural

Zusammenfassung

This paper presents the MentalRiskES shared task organized at IberLEF 2024, as part of the 40th International Conference of the Spanish Society for Natural Language Processing. This task aims to promote the early detection of mental risk disorders in Spanish. We propose three detection tasks: Task 1 to detect risk for depression or anxiety, Task 2 to detect risk for depression or anxiety but determining contextual risk factors and Task 3 to identify whether a subject is at risk for suicidal ideation. Furthermore, we asked participants to submit measurements of carbon emissions for their systems, emphasizing the need for sustainable natural language processing practices. In this second edition, 28 teams registered, 12 submitted results, and 10 presented papers. Most teams experimented with Transformers, including features, data augmentation, and preprocessing techniques.

Bibliographische Referenzen

  • Andreassen, C. S., S. Pallesen, and M. D. Griffiths. 2017. The relationship between addictive use of social media, narcissism, and self-esteem: Findings from a large national survey. Addictive behaviors, 64:287–293.
  • Casamayor, A., V. Ahuir, A. Molina, and L.-F. Hurtado. 2024. ELiRF-VRAIN at MentalRiskES 2024: Using Longformers for Early Detection of Mental Disorders Risk. In IberLEF (Working Notes). CEUR Workshop Proceedings.
  • Cedillo-Castelán, V. 2024. Suicidal ideation detection. In IberLEF (Working Notes). CEUR Workshop Proceedings.
  • Cohen, J. 1960. A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20(1):37–46.
  • Fandiño, A. G., J. A. Estapé, M. Pàmies, J. L. Palao, J. S. Ocampo, C. P. Carrino, C. A. Oller, C. R. Penagos, A. G. Agirre, and M. Villegas. 2022. MarIA: Spanish Language Models. Procesamiento del Lenguaje Natural, 68.
  • Fernandez-Hernandez, J., H. Fabregat, A. Duque, L. Araujo, and J. Martinez-Romo. 2024. UNED-GELP at MentalRiskES 2024: Transformer-Based Encoders and Similarity Techniques for Early Risk Prediction of Mental Disorders. In IberLEF (Working Notes). CEUR Workshop Proceedings.
  • González, E. B. and M. T. Vidal. 2024. BUAP 01 at MentalRiskES 2024: Detection of depression and anxiety using features based on tagging. In IberLEF (Working Notes). CEUR Workshop Proceedings.
  • He, P., X. Liu, J. Gao, and W. Chen. 2021. Deberta: Decoding-enhanced bert with disentangled attention. In International Conference on Learning Representations.
  • Larrayoz, X., A. Casillas, M. Oronoz, and A. P´erez. 2024. Mental Disorder Detection in Spanish: hands on skewed class distribution to leverage training. In IberLEF (Working Notes). CEUR Workshop Proceedings.
  • Losada, D. and F. Crestani. 2016. A test collection for research on depression and language use. volume 9822, pages 28–39, 09.
  • Mármol-Romero, A. M., A. Moreno-Muñoz, F. M. Plaza-del Arco, M. D. Molina-González, M. T. Martín-Valdivia, L. A. Ureña-López, and A. Montejo-Ráez. 2024. MentalRiskES: A new corpus for early detection of mental disorders in Spanish. In N. Calzolari, M.-Y. Kan, V. Hoste, A. Lenci, S. Sakti, and N. Xue, editors, Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), pages 11204–11214, Torino, Italia, May. ELRA and ICCL.
  • Mármol-Romero, A. M., A. Moreno-Muñoz, F. M. Plaza-del Arco, M. D. Molina-González, M. T. Martín-Valdivia, L. A. Ureña-López, and A. Montejo-Ráez. 2023. Overview of mentalriskes at iberlef 2023: Early detection of mental disorders risk in spanish. Procesamiento del Lenguaje Natural, 71:329–350.
  • Martinez, E., J. Cuadrado, J. C. Martinez-Santos, and E. Puertas. 2024. Automated Detection of Depression and Anxiety Using Lexical and Phonestheme Features in Spanish Texts. In IberLEF (Working Notes). CEUR Workshop Proceedings.
  • Muñoz-Muñoz, D., A. Marco-Perez, and D. Ramirez. 2024. Participation of UC3M-DAD on MentalRiskES task at IberLEF 2024. In IberLEF (Working Notes). CEUR Workshop Proceedings.
  • Nakayama, H., T. Kubo, J. Kamura, Y. Taniguchi, and X. Liang. 2018. doccano: Text annotation tool for human. Software available from https://github.com/doccano/doccano.
  • Pan, R., J. A. García-Díaz, and R. Valencia-García. 2024. UMUTeam at Mental-RiskES@IberLEF 2024: Using the Fine-Tuning Approach of Transformer-Based Models with Sentiment Feature for Early Detection of Mental Disorders. In Iber-LEF (Working Notes). CEUR Workshop Proceedings.
  • Parapar, J., P. Martín-Rodilla, D. E. Losada, and F. Crestani. 2021. Overview of erisk at clef 2021: Early risk prediction on the internet (extended overview). CLEF (Working Notes), pages 864–887.
  • Parapar, J., P. Martín-Rodilla, D. E. Losada, and F. Crestani. 2023. Overview of erisk 2023: Early risk prediction on the internet. In International Conference of the Cross-Language Evaluation Forum for European Languages, pages 294–315. Springer.
  • Paduraru, C. D. and I. M. Anghelina1. 2024. Early Risk Detection for Mental Health Disorders: UnibucAI at MentalRiskES 2024. In IberLEF (Working Notes). CEUR Workshop Proceedings.
  • Sadeque, F., D. Xu, and S. Bethard. 2018. Measuring the latency of depression detection in social media. In Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining, pages 495–503.
  • Shannon, H., K. Bush, P. J. Villeneuve, K. G. Hellemans, and S. Guimond. 2022. Problematic social media use in adolescents and young adults: Systematic review and meta-analysis. JMIR Ment Health, 9(4):e33450, Apr.
  • Sierra-Callau, M., M. Ángel Rodríguez-García, S. Montalvo-Herranzcand, and R. Martínez-Unanue. 2024. UNED MRES team at Mental-RiskES2024: Exploring hybrid approaches to detect Mental Disorder Risks in Social Media. In IberLEF (Working Notes). CEUR Workshop Proceedings.