←
NLI4CT5 posts
NLI4CT avatar

NLI4CT

@NLI4CT

SemEval 2024 Task 2: Safe Biomedical Natural Language Inference for Clinical Trials

◷ Joined July 2022
Aryo Pradipta Gema avatar
⟳ NLI4CT retweeted
Aryo Pradipta Gema@aryopg·19 Apr 2024

Fine-tune your LLM unless you have access to GPT-4! In our SemEval 2024 @NLI4CT solution, we evaluated LLMs with ICL, CoT, and a novel PEFT method. And yet, GPT-4 produces surprisingly good results, ranking joint-first in the leaderboard! 👉 arxiv.org/abs/2404.00484 🧵 1/9

Post attachment
NLI4CT avatar
NLI4CT@NLI4CT·30 Oct 2023

This task aims to probe the robustness, consistency, and faithfulness of LLMs in clinical NLI, which is pivotal for advancing real-world applications, especially in the critical domain of healthcare. Visit sites.google.com/view/nli4ct… for more details.