Overview of the EmoEvalEs task on emotion detection for Spanish at IberLEF 2021

  1. Ureña López, Luis Alfonso
  2. Martín Valdivia, María Teresa
  3. Plaza-del-Arco, Flor Miriam
  4. Jiménez Zafra, Salud M.
  5. Montejo Ráez, Arturo
  6. Molina González, M. Dolores
Revista:
Procesamiento del lenguaje natural

ISSN: 1135-5948

Ano de publicación: 2021

Número: 67

Páxinas: 155-161

Tipo: Artigo

Outras publicacións en: Procesamiento del lenguaje natural

Resumo

This paper presents the EmoEvalEs shared task, organized at IberLEF 2021, as part of the 37th International Conference of the Spanish Society for Natural Language Processing (SEPLN 2021). The aim of this task is to promote the Emotion detection and Evaluation for Spanish. It consists of a fine-grained emotion classification of tweets from the EmoEvalEs corpus in one of these seven classes: anger, disgust, fear, joy, sadness, surprise, or others. In this edition, 70 teams registered, 15 submitted results and 11 presented papers describing their systems. Most teams experimented with neural networks, being Transformers the most widely used model. It should be noted that few of them also considered the features of offensiveness and event that were provided in the corpus apart from the tweet texts.

Referencias bibliográficas

  • Chiruzzo, L. and A. Rosá. 2021. RETUYTInCo at EmoEvalEs 2021: Multiclass Emotion Classification in Spanish. In Proceedings of the Iberian Languages Evaluation Forum (IberLEF 2021).
  • CEUR Workshop Proceedings, CEURWS, Málaga, Spain. de Arriba, A., M. Oriol, and X. Franch. 2021.
  • Applying Sentiment Analysis on Spanish Tweets Using BETO. In Proceedings of the Iberian Languages Evaluation Forum (IberLEF 2021). CEUR Workshop Proceedings, CEUR-WS, Málaga, Spain.
  • Díaz-Galiano, M. C., M. Vega, E. Casasola, L. Chiruzzo, M. A. G. Cumbreras, ´E. Martínez-Cámara, D. Moctezuma, A. M. Ráez, M. A. S. Cabezudo, E. S. Tellez, M. Graff, and S. Miranda-Jiménez. 2019. Overview of tass 2019: One more further for the global spanish sentiment analysis corpus. In IberLEF@SEPLN.
  • Ekman, P. 1992. An argument for basic emotions. Cognition & emotion, 6(3-4):169– 200.
  • Fu, Y., Z. Yang, N. Lin, L. Wang, and F. Chen. 2021. Sentiment Analysis for Spanish Tweets based on Continual Pre-training and Data Augmentation. In Proceedings of the Iberian Languages Evaluation Forum (IberLEF 2021). CEUR Workshop Proceedings, CEUR-WS, Málaga, Spain.
  • García-Díaz, J. A., M. Cánovas-García, and R. Valencia-García. 2020. Ontologydriven aspect-based sentiment analysis classification: An infodemiological case study regarding infectious diseases in latin america. Future Generation Computer Systems, 112:614–657.
  • García-Díaz, J. A., R. Colomo-Palacios, and R. Valencia-García. 2021. UMUTeam at EmoEvalEs 2021: Emotion Analysis for Spanish based on Explainable Linguistic Features and Transformers. In Proceedings of the Iberian Languages Evaluation Forum (IberLEF 2021). CEUR Workshop Proceedings, CEUR-WS, Málaga, Spain.
  • García-Díaz, J. A., M. Cánovas-García, R. Colomo-Palacios, and R. Valencia García. 2021. Detecting misogyny in spanish tweets. an approach based on linguistics features and word embeddings. Future Generation Computer Systems, 114:506 – 518.
  • Li, K. 2021. HAHA at EmoEvalEs 2021: Sentiment Analysis in Spanish Tweets with Cross-lingual Model. In Proceedings of the Iberian Languages Evaluation Forum (IberLEF 2021). CEUR Workshop Proceedings, CEUR-WS, Málaga, Spain.
  • Luo, H. 2021. Emotion Detection for Spanish with Data Augmentation and Transformer-Based Models. In Proceedings of the Iberian Languages Evaluation Forum (IberLEF 2021). CEUR Workshop Proceedings, CEUR-WS, Málaga, Spain.
  • Martínez-Cámara, E., Y. Almeida-Cruz, M. C. Díaz-Galiano, S. Estévez-Velarde, M. A. G. Cumbreras, M. Vega, Y. G. Vázquez, A. M. Ráez, A. Montoyo, R. Muñoz, A. Piad-Morffis, and J. VillenaRomán. 2018. Overview of tass 2018: Opinions, health and emotions. In TASS@SEPLN.
  • Montes, M., P. Rosso, J. Gonzalo, E. Aragón, R. Agerri, M. Alvarez Carmona, E. Alvarez Mellado, J. Carrillo-de Albornoz, L. Chiruzzo, L. Freitas, H. Gómez Adorno, Y. Gutiérrez, S. M. Jiménez-Zafra, S. Lima, F. M. Plazadel-Arco, and M. Taulé, editors. 2021. Proceedings of the Iberian Languages Evaluation Forum (IberLEF 2021).
  • Plaza-del-Arco, F., C. Strapparava, L. A. Ureña-Lopez, and M. T. Martin-Valdivia. 2020. EmoEvent: A Multilingual Emotion Corpus based on different Events. In Proceedings of the 12th Language Resources and Evaluation Conference, pages 1492–1498, Marseille, France, May. European Language Resources Association.
  • Plutchik, R. 2001. The nature of emotions: Human emotions have deep evolutionary roots, a fact that may explain their complexity and provide tools for clinical practice. American scientist, 89(4):344–350.
  • Qu, S., Y. Yang, and Q. Que. 2021. Emotion Classification for Spanish with XLMRoBERTa and TextCNN. In Proceedings of the Iberian Languages Evaluation Forum (IberLEF 2021). CEUR Workshop Proceedings, CEUR-WS, Málaga, Spain.
  • Qu, Y., S. Jia, and Y. Zhang. Sentiment Analysis in Spanish Tweets: The Model based on XLM-RoBERTa and Bi-GRU.
  • Rosenthal, S., N. Farra, and P. Nakov. 2017. Semeval-2017 task 4: Sentiment analysis in twitter. In Proceedings of the 11th international workshop on semantic evaluation (SemEval-2017), pages 502–518.
  • Sánchez, J. A. F., S. M. Herranz, and R. M. Unanue. 2021. URJC-Team at EmoEvalEs 2021: BERT for Emotion Classification in Spanish Tweets. In Proceedings of the Iberian Languages Evaluation Forum (IberLEF 2021). CEUR Workshop Proceedings, CEUR-WS, Málaga, Spain.
  • Vega, M., M. C. Díaz-Galiano, M. A. G. ´Cumbreras, F. M. Plaza-del-Arco, A. M. Ráez, S. Jiménez-Zafra, E. MartínezCámara, C. Aguilar, M. A. S. Cabezudo, L. Chiruzzo, and D. Moctezuma. 2020. Overview of tass 2020: Introducing emotion detection. In IberLEF@SEPLN 2020.
  • Vera, D., O. Araque, and C. A. Iglesias. 2021. GSI-UPM at IberLEF2021: Emotion Analysis of Spanish Tweets by Fine-tuning the XLMRoBERTa Language Model. In Proceedings of the Iberian Languages Evaluation Forum (IberLEF 2021). CEUR Workshop Proceedings, CEUR-WS, Málaga, Spain.
  • Vitiugin, F. and G. Barnab`o. 2021. Emotion Detection for Spanish by Combining LASER Embeddings, Topic Information, and Offense Features. In Proceedings of the Iberian Languages Evaluation Forum (IberLEF 2021). CEUR Workshop Proceedings, CEUR-WS, Málaga, Spain