←
Eval4NLP59 posts
Eval4NLP avatar

Eval4NLP

@eval4nlp

Workshop on Evaluation and Comparison of NLP Systems, co-located with #AACL2025.

◷ Joined October 2019▧ 2 Photos and videos
NLLG avatar
⟳ Eval4NLP retweeted
NLLG@NLLG_lab·18 Oct 2024

📢📢📢The NLLG lab has three new open fully funded PhD positions: 1⃣ - Next Generation LLMs 2⃣ - NLP for Science 3⃣ - Multimodal evaluation metrics Deadlines: End of October ℹ️More information: nl2g.github.io/positions

NLLG avatar
⟳ Eval4NLP retweeted
NLLG@NLLG_lab·19 Mar 2024

📢📢👉👉@chrleiter presenting his work on how explainability can improve evaluation metrics for MT and summarization tomorrow at #eacl2024

Excited to present our paper "BMX: Boosting Natural Language Generation Metrics with Explainability" at #eacl2024! Join us in Virtual Poster Session B on 20.03.2024 at 2 p.m. as we unveil how explanations can enhance NLG evaluation metrics.

Eval4NLP avatar
Eval4NLP@eval4nlp·3 Nov 2023

Eval4NLP23 has concluded. We thank everyone + congratulate our shared task winners on inducing high-quality metrics for MT+summ. using prompting and efficient models: "HIT-MI&T Lab" (even beating GEMBA + COMET🚀) & "DSBA". Shared task overview paper: arxiv.org/pdf/2310.19792.pdf

Eval4NLP avatar
Eval4NLP@eval4nlp·27 Sep 2023

📢📢To accommodate the recent ARR author response period, Eval4NLP @aaclmeeting extends the deadline for pre-reviewed papers until September 30th. Pre-reviewed papers must include: the paper along with its original reviews and scores. More details: eval4nlp.github.io/

will depue avatar
⟳ Eval4NLP retweeted
will depue@willdepue·21 Sep 2023

Round #2 of DALLE images, using requests from y'all. Here's two animals mixed together into a new species.

Post attachmentPost attachmentPost attachmentPost attachment
will depue@willdepue20 Sep 2023

DALLE-3 is the best product I've seen since GPT-4, super easy to just get sucked in for hours generating images. No need for prompting since GPT-4 does it for you. Let me know if you have requests for prompts below. Here are some examples of what it can do:

Post attachmentPost attachmentPost attachmentPost attachment
Eval4NLP avatar
Eval4NLP@eval4nlp·3 Aug 2023

📢📢📢 We have released the description of Eval4NLP's shared task on "Prompting LLMs as Explainable Evaluation Metrics" (for MT & summarization). Dev phase: Aug. 7 Test phase: Sep. 18 System Submission Deadline: Sep. 23 More details: eval4nlp.github.io/2023/shar… 🚀🚀🚀

Post attachment