mmissoldtw ←
SUMEval @ COLING 202535 posts
SUMEval @ COLING 2025 avatar

SUMEval @ COLING 2025

@sum_eval

2nd Workshop on Scaling Up Multilingual & Multi-Cultural Evaluation @ COLING 2025

◷ Joined June 2022
SUMEval @ COLING 2025 avatar
SUMEval @ COLING 2025@sum_eval·20 Jan 2025

11 AM GST: Panel Discussion-1: Challenges of Collecting Culturally Grounded Multilingual Data for Training and Evaluation of NLP Systems.

SUMEval @ COLING 2025 avatar
SUMEval @ COLING 2025@sum_eval·17 Oct 2024

** Updates ** * We are excited to announce that, there will be cash awards for two best papers, one for archival and one for non-archival track * We are extending the archival submission deadline to Nov 8, 2024 (no changes to the non-archival submission deadline Nov 25, 2024)

SUMEval @ COLING 2025 avatar
SUMEval @ COLING 2025@sum_eval·3 Aug 2024

***Important Dates*** Archival Submission: October 18th, 2024 Non-archival Submission: November 25th, 2024 Notification of Acceptance: December 3rd, 2024 Camera-Ready Papers Due: December 10th, 2024 Workshop Date: January 20th, 2025, co-located with COLING 2025

SUMEval @ COLING 2025 avatar
SUMEval @ COLING 2025@sum_eval·3 Aug 2024

* Probing and analysis of multilingual models across cultures and languages * Comparison of evaluation strategies for languages, cultures, and domains

SUMEval @ COLING 2025 avatar
SUMEval @ COLING 2025@sum_eval·3 Aug 2024

* Automated evaluation metrics for multilingual and multicultural evaluation * Studies on fairness and other aspects of evaluation * Studies on cultural representation in multilingual models * Data sets, benchmarks, or libraries for evaluating multi-lingual models

SUMEval @ COLING 2025 avatar
SUMEval @ COLING 2025@sum_eval·3 Aug 2024

We are inviting submissions on the following (and more) topics: * Under-represented cultures and languages * Studies on scaling up multilingual and multicultural evaluation * Human evaluation of multilingual and multicultural aspects of models

SUMEval @ COLING 2025 avatar
SUMEval @ COLING 2025@sum_eval·9 Sep 2022

** SumEVAL Paper Submission Deadline Extended ** We are extending the SumEVAL workshop paper submission deadline to September 23, 2022.