←
UBC NLP Group134 posts
UBC NLP Group avatar

UBC NLP Group

@UBC_NLP

The NLP Group at the University of British Columbia

◷ Joined February 2022▧ 62 Photos and videos
UBC NLP Group avatar
UBC NLP Group@UBC_NLP·20h

We’re excited to have a guest speaker next Monday from the Centre of Data Science at NYU! They’ll be sharing insights on how language models (LMs) can understand their own structure and self-awareness. Come join us at 10:30 a.m. in ICCS 146!

Post attachment
UBC NLP Group avatar
UBC NLP Group@UBC_NLP·Oct 30

The UBC NLP Lab got into the Halloween spirit for our annual pumpkin carving 🎃 If you're on campus, check out our spooky creations outside the ICICS building 👻

Post attachmentPost attachment
UBC NLP Group avatar
UBC NLP Group@UBC_NLP·Oct 23

We’re thrilled to share the list of excellent papers from our lab, which will be presented at EMNLP2026 in Budapest. Come talk to us at the conference, and see you soon.

Post attachmentPost attachment
UBC NLP Group avatar
UBC NLP Group@UBC_NLP·Aug 10

We are excited to host Vagrant Gautam from Heidelberg Institute for Theoretical Studies for a talk on "Reference in Modern NLP". We look forward to seeing you there!   📅 Tue, Aug 18   🕙 11:00 AM   📍ICICS X836 @UBC_CS @CAIDA_UBC @UBCLangScis

Post attachment
UBC NLP Group avatar
UBC NLP Group@UBC_NLP·Aug 8

Congratulations to 🎓 Dr. Sahithya Ravi (@Sahithya_Ravi) for successfully defending her thesis, "Improving Commonsense Reasoning in Multimodal Models".👏 Wishing you continued success as you embark on the next chapter of your journey. Well deserved! 🎉

Post attachmentPost attachment
UBC NLP Group avatar
UBC NLP Group@UBC_NLP·Aug 8

Congratulations to 🎓 Dr. Soheil Alavi for successfully defending his thesis, "Language Models as Interactive Systems: From Game-Based Interaction to Persuasive Experiences".👏 Wishing you continued success in your future endeavors. Well deserved! 🎉

Post attachmentPost attachment
UBC NLP Group avatar
UBC NLP Group@UBC_NLP·Aug 6

We’re excited to have a guest speaker: Dayeon (Zoey) Ki from University of Maryland to give us a talk about auditing multilingual bias across the model pipeline. It will be in ICCS X836 on Friday, August 14 at 2 PM.

Post attachment
Amirhossein Abaskohi avatar
⟳ UBC NLP Group retweeted
Amirhossein Abaskohi@AmirAbaskohi·Jun 12

🎲 Can LLMs stand in for real, unpredictable systems? We're increasingly dropping LLMs into simulations: humans in economic models 📈, agents in multi-agent settings 🤖, processes in epidemiology 🦠. But if a model always returns the single "most plausible" answer, it can't capture how messy and unpredictable the real world is. Please check out our recent work from @UBC_NLP and @UBC_CS, where we introduce the first benchmark for evaluating randomness in LLMs. 🧪 Introducing UnpredictaBench: 448 problems spanning shuffling 🔀, real-world randomness 🌍, and random number sampling across 40 distributions 📊, testing whether models can truly sample from a target distribution, not just vary their outputs. 🔬 We also put creativity under a numerical microscope for the first time, measuring it as distributional behavior instead of vibes. 🚨 The result: no model clears 40% at KS@100. Most collapse to one answer. Reasoning helps a little, but there's no quick fix. 📄 huggingface.co/papers/2606.0… Thanks for my awesome collaborators and supervisors: @DabiriAghdam, Liang Luo, Ellie Dingqiao Wen, Lele Wang, @careninigiusepp, and @PeterWestTM.

UBC NLP Group avatar
UBC NLP Group@UBC_NLP·May 13

We are excited to host Kathleen Fraser from the University of Ottawa for a talk on “Bias and safety in large vision-language models”. We look forward to seeing you there! 📅 Fri, May 29 🕙 10:00 AM 📍ICICS 246 @UBC_CS @CAIDA_UBC @UBCLangScis

Post attachment
Yuwei Yin avatar
⟳ UBC NLP Group retweeted
Yuwei Yin@SeckexYIN·May 11

🌟 Intent, a cognitive state related to goals and plans in the human mind, is ubiquitous in human interactions across various domains. Accurately understanding the intent behind speech, conversation, and writing is crucial to the development of helpful Large Language Model (LLM) assistants, and misunderstanding the user intent could cause unexpected or even harmful consequences. 🤔 Intent understanding matters, but can LLMs grasp the intent as accurately as we expect? To assess their intentional ability, we introduce IntentGrasp, a comprehensive benchmark for evaluating LLMs' intent-understanding capability. IntentGrasp contains a large-scale training set of 262,759 instances and two evaluation sets: an All Set of 12,909 test cases and a more balanced and challenging Gem Set of 470 cases.

Post attachment
UBC NLP Group avatar
UBC NLP Group@UBC_NLP·Mar 27

Congrats to Annie Wang for presenting her MSc thesis titled "Promoting Epistemic Equity by Surfacing Knowledge Gaps between English Wikipedia and other Language Editions"! 🥳 You can read the preprint here: arxiv.org/pdf/2505.24195

Post attachment
UBC NLP Group avatar
UBC NLP Group@UBC_NLP·Mar 12

We are excited to host Sunipa Dev from Google Research for a talk on “Towards Cultural Intelligence in Large Language Models”. 📅 Thu, Mar 12 🕘 9:30 AM 📍 DMP 201 We look forward to seeing you there!

Post attachment
UBC NLP Group avatar
UBC NLP Group@UBC_NLP·Mar 2

We are delighted to welcome Stella Li, a PhD candidate at the Allen School of Computer Science at the University of Washington, for a special talk titled “Proactive Question Asking for Reliable and Personalized LLMs.” Join us: 📅 Mon, Mar 9th 🕒 10:30 AM 📍 ICCS X836

Post attachment