←
Evidently AI2,260 posts
Evidently AI avatar

Evidently AI

@EvidentlyAI

Open source ML and LLM evaluation 📊 , testing 🚦and monitoring 📈 GitHub: github.com/evidentlyai/evide… Discord: discord.gg/xZjKRaNp8b

◷ Joined February 2020▧ 541 Photos and videos
Evidently AI avatar
Evidently AI@EvidentlyAI·9 Dec 2024

3️⃣ 2️⃣ 1️⃣ Our free course on LLM evaluations for AI product teams starts today! 🎥 7 days of byte-sized videos into your inbox ⭐️ Certificate upon completion 👩‍💻 No coding skills required 👩‍🎓500+ students have signed up You can still join the course👇 evidentlyai.com/llm-evaluati…

Post attachment
Evidently AI avatar
Evidently AI@EvidentlyAI·Apr 4

📌 In case you missed it How to evaluate an AI agent? Follow the tutorial as we: 1️⃣ Build an AI agent, 2️⃣ Create a test dataset, 3️⃣ Assess responses and tool choice, 4️⃣ Track the agent’s behaviour. Follow the tutorial from our LLM evals course: youtube.com/watch?v=9KMmadw7…

Evidently AI avatar
Evidently AI@EvidentlyAI·Apr 3

A Friday ML use case 📕 📚 From the database of 800 ML & LLM systems: cutt.ly/SwrZWL0g How Uber improves driver availability at airports: Estimated time-to-request model, Earnings-per-hour prediction, and Driver-deficit forecasting. uber.com/en-GB/blog/forecast…

Evidently AI avatar
Evidently AI@EvidentlyAI·Apr 1

🦾 More AI agents aren’t always better. Google evaluated 180 agent setups and found multi-agent systems help with parallel tasks but can hurt sequential ones. The work also proposes a model to predict optimal agentic designs. research.google/blog/towards…

Post attachment
Evidently AI avatar
Evidently AI@EvidentlyAI·Mar 28

📌 In case you missed it Let’s test your RAG system! Follow the tutorial as we: 1️⃣ Build a RAG system, 2️⃣ Generate test data, 3️⃣ Evaluate answers for correctness and faithfulness. Watch the tutorial from our LLM evals course: youtube.com/watch?v=jckp5R09…

Evidently AI avatar
Evidently AI@EvidentlyAI·Mar 27

A Friday ML use case 📕 📚 From the database of 800 ML & LLM systems: cutt.ly/SwrZWL0g How GoDaddy built Lighthouse, an internal AI analytics platform: prompt engineering framework, model orchestration, solution architecture, and use cases. godaddy.com/resources/news/h…

Nnenna avatar
⟳ Evidently AI retweeted
Nnenna@nnennahacks·Mar 24

(policyNIM oss tool) preflight command is working. when I provide a coding task, it kicks off a search through indexed policies to determine which rules are relevant for implementation. @nvidia for embedding w/ @OpenAI + @lancedb for vector storage. eval command is also working. using @EvidentlyAI for running eval suite.

Post attachmentPost attachment
Evidently AI avatar
Evidently AI@EvidentlyAI·Mar 24

🚦 Meta’s “Agents Rule of Two” According to Meta, AI agents should satisfy at most two of these conditions per session to reduce prompt-injection risk: - Handle untrusted inputs - Access sensitive data - Change state / act externally ai.meta.com/blog/practical-a…

Evidently AI avatar
Evidently AI@EvidentlyAI·Mar 20

A Friday ML use case 📕 📚 From the database of 800 ML & LLM systems: cutt.ly/SwrZWL0g How DoorDash improves its RecSys using LLMs to bridge behavioral silos in multi-vertical recommendations. careersatdoordash.com/blog/d…

Evidently AI avatar
Evidently AI@EvidentlyAI·Mar 14

📌 In case you missed it Can LLMs write engaging tech tweets? Follow the tutorial as we: 1️⃣ Build a tweet generator, 2️⃣ Score its outputs with custom LLM judges, 3️⃣ Improve the results with prompt iteration. Watch the tutorial from our LLM evals course: youtube.com/watch?v=KhkiM9C0…