
Very excited to be featured in @Nature for our work showing how GenAI is creeping into bestselling novels.

Assistant Professor @sbucompsc @stonybrooku. Prev. @UMIACS @CLIPUMD @RiceCompSci @merl_news @MITIBMLab. EECS Rising Star'23. Former drummer. 🇨🇷

Very excited to be featured in @Nature for our work showing how GenAI is creeping into bestselling novels.

VLMs struggle to answer questions in adverse imaging conditions like fog, snow, rain, low light. Our #COLM2026 paper All-Weather VLM tackles this and outperforms baselines on real-world driving footage by reasoning about degradation type and severity. 🌐 mingyangx.github.io/All-Weat…

🚨 New paper on AI and Copyright 🚨 It's easy to dismiss AI-written books 📚 as slop nobody buys. So, armed with full-text AI detection from @pangram, we studied self-published genre fiction books sold on Amazon from 2023 to 2026 March Turns out Amazon is flooded with books with substantial AI text and these books are earning significant 💰💸 and most importantly, crowding out sales of non-AI books. FWIW, a book doesn't need to be high quality to have a market impact. It just has to exist in the thousands, which Generative AI enables. Joint w/ @dhillon_p (@UMich), @irisiris_l (@stonybrooku ) & Jane Ginsburg (@ColumbiaLaw) (1/n) 🧵

... reconnect with old friends (Moayed Haji Ali @moayedhajiali, who took the last picture+video 🎶); and perform a few songs at the reception on Saturday night with an incredible group of talented musicians! Hope to see y'all at the next conference!! -- paolacascante.com/lab/

I also had the privilege to work with my good friend, the amazing Abby Stylianou (@abby621), on this year's Doctoral Consortium; had my advisor, Vicente Ordónez-Román (@bluevincent), meet my students; reconnect with... (2/n)

Our group had a blast at #CVPR this year! We had multiple workshop presentations on our ongoing work on egocentric perception (@JeffriMurrugarr), spatial and semantic understanding (Kathakoli Sengupta), and VLM-SSM vision-encoders (Shang-Jui Ray Kuo). (1/n)

It was a privilege to work with my good friend, Paola Cascante-Bonilla, on this year's @CVPR Doctoral Consortium, again with support from the @NSF. What a remarkable group of graduating students (not all of whom are photographed here) -- you can see the list of recipients at docs.google.com/spreadsheets…

Thank you @Telegraph for covering our work @irisiris_l @niloofar_mire
New evidence that LLMs memorise huge chunks of works they are trained on. Great to see this important paper hitting the mainstream press. telegraph.co.uk/business/202…

🎓Still thinking about applying to the #CVPR2026 Doctoral Consortium? The submission deadline is April 13, 2026. If you are a PhD student nearing graduation, this is a great opportunity to network, receive mentorship, and present your work at CVPR. cvpr.thecvf.com/Conferences/…
📢 Call for Participation: The #CVPR2026 Doctoral Consortium submission portal is now open! Important Dates • Submission deadline: Apr 13, 2026 • Notification: Apr 27, 2026 (estimated) Details: cvpr.thecvf.com/Conferences/…

🚨New paper on AI & Copyright 👨⚖️Courts have credited LLM companies' claims that safety alignment prevents reproduction of copyrighted expression. But what if fine-tuning on a simple writing task ruins it all? Worse : Fine-tuning on a single author's books (e.g., Murakami) unlocks verbatim recall of copyrighted books from 30+ unrelated authors, sometimes as high as 90%. Joint work with @niloofar_mire (@LTIatCMU), Jane Ginsburg ( @ColumbiaLaw) and my amazing PhD student @irisiris_l (@sbucompsc ) (1/n)🧵

Do VLMs Need Vision Transformers? A controlled study of Transformer, state space, and hybrid vision backbones for frozen vision-language models. Finding: - Under matched settings, VMamba improves localization while staying competitive on open-ended VQA, making SSMs a practical alternative to ViTs. - Detection or segmentation pretraining generally improves VQA and localization, with the largest gains appearing in backbones that need more spatial inductive bias. - Better classification scores and naive scaling do not consistently predict stronger downstream VLM behavior, especially for grounding-sensitive tasks. - Some dense-objective checkpoints fail sharply in localization, but simple interface and connector adjustments recover much more robust behavior. Paper Title: Do VLMs Need Vision Transformers? Evaluating State Space Models as Project: lab-spell.github.io/vlm-ssm-… Link: arxiv.org/abs/2603.19209

📢 Call for Participation: The #CVPR2026 Doctoral Consortium submission portal is now open! Important Dates • Submission deadline: Apr 13, 2026 • Notification: Apr 27, 2026 (estimated) Details: cvpr.thecvf.com/Conferences/…

@dhillon_p and my work is in the @NewYorker today. Words can’t describe how I feel. Many thanks to Vauhini Vara for this beautiful and thought provoking essay. If you care about AI disclosures, Fair Use & the Future of Creative Labor I recommend reading it :)
People often dismiss A.I.-generated literature because they read books to access someone else’s consciousness. But what if they can’t tell the difference? newyorkermag.visitlink.me/GV…

🚨New paper on AI and copyright Several authors have sued LLM companies for allegedly using their books without permission for model training. 👩⚖️Courts, however, require empirical evidence of harm (e.g., market dilution). Our new pre-registered study addresses exactly this gap. Joint work with Profs @dhillon_p (@umsi) & Jane Ginsburg ( @ColumbiaLaw) (1/n)🧵

Thanks @arankomatsuzaki, @ManuelFaysse, and @_akhaliq for reposting our work! We extended matryoshka to multi-vector embedding and were glad to see that the popular concept, test-time scaling in LLM, also works in retrieval. Work done with @AIatMeta & @vislang!
Meta Superintelligence Labs presents MetaEmbed: Scalable multimodal retrieval • Flexible late interaction via Meta Tokens • Test-time scaling: trade off retrieval accuracy vs efficiency • SOTA on MMEB + ViDoRe, robust up to 32B models • Matryoshka training → coarse-to-fine multi-vector embeddings

Honored to get the outstanding position paper award at @icmlconf :) Come attend my talk and poster tomorrow on human centered considerations for a safer and better future of work I will be recruiting PhD students at @stonybrooku @sbucompsc coming fall. Please get in touch.
Very excited for a new #ICML2025 position paper accepted as oral w @mbodhisattwa & @TuhinChakr! 😎 What are the longitudinal harms of AI development? We use economic theories to highlight AI’s intertemporal impacts on livelihoods & its role in deepening labor-market inequality.