←
unify56 posts
unify avatar

unify

@letsunifyai

Continual learning for AI teams.

◷ Joined October 2026▧ 0 Photos and videos
Daniel Lenton avatar
⟳ unify retweeted
Daniel Lenton@DanielLenton1·May 31

In the end, I think agents will stream output actions continously. Think @thinkymachines interaction models but not only streaming speech and vision, but also streaming output control actions. This will also be end-to-end trained in the model weights, but I wonder how far you could get today by stitching something together with @livekit etc., with computer use models outputting high level actions and faster models outputting the micro-steps. This is kind of how we've done things in unity [github.com/unifyai/unity], but for now we only stream the speech and vision at the high-frequency conversational layer (not yet actions). In the end more of the harness will move to end-to-end training, and harnesses are a point-in-time solution to what will inevitably become an end-to-end trained system with latent representations at the boundaries instead of text etc.

Post attachment
unify avatar
unify@letsunifyai2021·4 Sep 2024

We’re excited to have @shirleyxiaoyic from @IndianaUniv, co-author of the paper "The Janus Interface: How Fine-Tuning in Large Language Models Amplifies Privacy Risks," joining us this Friday for our Paper Reading Session! 🤩 RSVP 👉 lu.ma/jok7bp2m The research introduces a novel attack, Janus, which exploits the fine-tuning interface to recover forgotten PIIs from the pre-training data in LLMs also formalizing the privacy leakage problem in LLMs, explaining why forgotten PIIs can be recovered through empirical analysis on open-source language models.🧠 Check out the Paper: arxiv.org/pdf/2310.15469 See you there!

Post attachment
unify avatar
unify@letsunifyai2021·6 Aug 2024

We're thrilled to announce that @Vapi_AI will be joining us for our weekly Webinar Series tomorrow! (Wednesday) 🤩 RSVP here: lu.ma/cke3hpft Join us as we welcome Sahil Suman, Solution Engineer at Vapi AI, to the session. Discover how VAPI enables the quick setup of high-quality voice agents and see the integration of @letsunifyai with VAPI for seamless access to various models and providers. See you there! 🧑‍💻 Explore Vapi: ⚡️vapi.ai/ ⚡️github.com/VapiAI

Post attachment
unify avatar
unify@letsunifyai2021·1 Aug 2024

We are really excited to welcome @zlwang_cs from @ucsd_cse, who co-authored the paper "Speculative RAG: Enhancing Retrieval Augmented Generation through Drafting". Happening Tomorrow!🤩 RSVP 👉 lu.ma/zesezv3u The research introduces SPECULATIVE RAG, a framework that leverages a larger generalist LM to efficiently verify multiple RAG drafts produced in parallel by a smaller, distilled specialist LM 🧠🤖 Check out the Paper👉arxiv.org/pdf/2407.08223 See you there!

Post attachment
unify avatar
unify@letsunifyai2021·30 Jul 2024

We are really excited to announce that we will be joined by @llmware for our Webinar Series today! (Tuesday)🤩 RSVP👉 lu.ma/e651sgj8 In this session, we're excited to welcome Darren Oberst and Namee Oberst from LLMware. We will explore how small specialized LLMs can compete with the larger models for specific use cases, especially for Financial, Legal, Compliance, and Regulatory-Intensive Industries. See you there! 🧑‍💻 Checkout LLMWare: ⚡️llmware.ai ⚡️github.com/llmware-ai/llmwar…

Post attachment
unify avatar
unify@letsunifyai2021·17 Jul 2024

We are really excited to welcome Devichand Budagam from @IITKgp, who co-authored the paper "Hierarchical Prompting Taxonomy: A Universal Evaluation Framework for Large Language Models". Happening Friday! 🤩 RSVP👉 lu.ma/7j11iscl ​The research introduces Hierarchical Prompting Taxonomy (HPT), a universal evaluation metric that can be used to evaluate both the datasets' complexity and LLMs' capabilities🧠 Check out the Paper👉 arxiv.org/pdf/2406.12644 See you there!

Post attachment
unify avatar
unify@letsunifyai2021·12 Jul 2024

We are really excited to announce that we will be joined by @tavilyai for our Webinar Series this Tuesday!🤩 RSVP👉 lu.ma/a77wgrao In this session, we'll explore how Tavily API makes search engine optimised for LLMs and RAG, to provide efficient, quick, and persistent search results. We'll also showcase Unify's SSO integration with Tavily 🧠🧑‍💻 Checkout Tavily: ⚡️tavily.com/ ⚡️github.com/tavily-ai

Post attachment
unify avatar
unify@letsunifyai2021·11 Jul 2024

We are really excited to welcome @sh_reya from @Berkeley_EECS, who co-authored the paper "Aligning LLM-Assisted Evaluation of LLM Outputs with Human Preferences". Happening Tomorrow! 🤩 RSVP 👉lu.ma/ttwrh0n4 The research introduces EvalGen, an interface that provides automated assistance in generating evaluation criteria and implementing assertions🧠👩‍💻 Check out the Paper👉 arxiv.org/pdf/2404.12272 See you there!

Post attachment
unify avatar
unify@letsunifyai2021·9 Jul 2024

We are really excited to announce that we will be joined by @CopilotKit for our Webinar Series this Thursday!🤩 RSVP 👉lu.ma/tv5h60nv In this session, we'll explore how CopilotKit makes integrating AI-powered Copilots into any product easy. We'll also showcase how the Unify Router can help you create Copilots that automatically select the best Large Language Model (LLM) for the task 🤖✨ Checkout CopilotKit: ⚡copilotkit.ai/ ⚡github.com/CopilotKit/Copilo… See you there!

Post attachment
unify avatar
unify@letsunifyai2021·3 Jul 2024

We are really excited to welcome @yyzTodd from @ZJU_China, who co-authored the paper "Knowledge Circuits in Pretrained Transformers". This Friday! 🤩 RSVP 👉 lu.ma/zdhovzbo The research dives into the computation graph of language models to uncover the knowledge circuits that are instrumental in articulating specific knowledge 🤖🧠 Check out the Paper 👉 arxiv.org/html/2405.17969v1 See you there!

Post attachment
unify avatar
unify@letsunifyai2021·25 Jun 2024

LLM Contributor Projects Week - LLM Resume Analyser 🔍 ⚡️Try it out! - ai-llm-resume-analyser.strea… Oscar Arroyo Vega (@OscarArroyoVega), Sanjay Suthar (@Sanjay__Suthar), Jeyabalan Ganesh Nadar, and Maissa Rekik have been working on an LLM Resume Analyser. The app extracts and analyzes key skills from resumes, provides matching scores for job descriptions, and suggests resume improvements! 📚✨ Check out their presentation - youtu.be/ch7cZBHzDtY Check out the repo here - github.com/OscarArroyoVega/L…

Post attachment
unify avatar
unify@letsunifyai2021·24 Jun 2024

We are super excited to welcome @felipemaiapolo from @UMich this Friday to our paper reading session. Felipe co-authored the paper "Efficient multi-prompt evaluation of LLMs" 🤩 ⚡️RSVP - lu.ma/hlekaxz4 His research introduces PromptEval, a new method for estimating performance across a large set of prompts, borrowing strength across prompts and examples to produce accurate estimates under practical evaluation budgets📈 📚Check out the paper - arxiv.org/pdf/2405.17202 See you there!

Post attachment
unify avatar
unify@letsunifyai2021·24 Jun 2024

LLM Contributor Projects Week - LlamaIndex RAG Playground🛝 Abhijeet Chintakunta has developed the LLamaIndex RAG Playground, an application that allows users to upload PDF documents and ask questions about them!⚡️ Try it out - unifyai-rag-playground.strea… Abhijeet used LLamaIndex to create a RAG application for this project. The application's interface is built with Streamlit, making it user-friendly and easy to interact with 🤝🤖 Check out their presentation - youtu.be/TdYR7jAS4h4 Check out the repo here -github.com/abhi2596/UnifyAI_…

Post attachment
unify avatar
unify@letsunifyai2021·21 Jun 2024

LLM Contributor Projects Week - LLM Debate 📚 Ogban Ugot (@OgbanUgot) and Sanjay Suthar (@Sanjay__Suthar), have been working on LLM Debate. Try it out! - sanjay8602-debate-app-app-kt… In this project, they developed a web application that allows two LLMs to engage in a real-time conversation on a topic chosen by the user. Users can select any two models, input a query, and view the dialogue between the LLMs as it unfolds. This application, built using Unify and deployed with Streamlit, offers a platform for users to observe AI-generated debates and explore the capabilities of different language models⚡️ ⚔️ Check out their presentation - youtu.be/1We7qWaynjo Check out the repo here - github.com/Sanjay8602/Debate…

Post attachment