←
Eric Jiang748 posts
Eric Jiang avatar

Eric Jiang

@veggie_eric

Eat your veggies

◷ Joined January 2020▧ 175 Photos and videos
Eric Jiang avatar
Eric Jiang@veggie_eric·Nov 13

woke up to headlines saying jensen "resigns as NVDA CEO" and in my mental haze interpreted that as "re-signed" like an NBA player to a new contract and was happi and then realized i'm dumb and now I'm depresso again 😭

Toby Pohlen avatar
⟳ Eric Jiang retweeted
Toby Pohlen@TobyPhln·Oct 30

Love is wise My first song is out. Please watch. Spotify link below

4:16
Zukai avatar
⟳ Eric Jiang retweeted
Zukai@wang_zukai·Oct 14

If you see a bug in XMoney, just reply to this post. Will try to fix it when I wake up.

Eric Jiang avatar
Eric Jiang@veggie_eric·Oct 14

Grok Voice is one of our fastest growing segments on API. Exciting to see companies switching to Grok from providers like ElevenLabs, seeing better naturalness across languages and lower cost. We just dropped Grok Voice 3.0, which is back at #1 on the AA Speech to Speech Index. Don't sleep on Grok!

Post attachment
Eric Jiang avatar
Eric Jiang@veggie_eric·Oct 13

The best burrito in the bay is NOT La Taqueria or El Farolito You will find it at Taqueria Grullense M&G in Palo Alto, thank me later

Post attachment
Eric Jiang avatar
Eric Jiang@veggie_eric·Oct 11

I love my country 🇺🇸

0:18
Eric Jiang avatar
Eric Jiang@veggie_eric·Oct 9

friendly psa to anyone doing system design interviews right now: NOT EVERYTHING NEEDS A QUEUE

Eric Jiang avatar
Eric Jiang@veggie_eric·Oct 8

Grok 4.7 is #1 on the Harvey+AA Legal Agent Benchmark

Today we are announcing Harvey LAB-AA v1.1 in collaboration with Harvey. This updates our scoring methodology for the Legal Agent Benchmark (LAB) to add a hallucination check and require correct responses to not include material misstatements. LAB-AA v1.1's new headline metric, Hallucination-Gated All-Pass Rate, only credits a task when the deliverables satisfy every rubric criterion and contain no material hallucinations. We define a material hallucination as one that would mislead a reader on a substantive point, such as a wrong contractually required date, while a minor hallucination is a real error that is unlikely to meaningfully affect the legal interpretation of a deliverable. Minor hallucinations are reported separately and do not affect the headline score. Grok 4.7 (xhigh) leads at 9.4% Hallucination-Gated All-Pass Rate, and >60% of otherwise passing results across the models tested at launch contain a material hallucination. This is the first step in enhancing the methodology for Harvey LAB-AA. In future updates, we’re working with Harvey to better account for the full set of factors lawyers value, including usability features like style and tone. Key takeaways: ➤ Top of the leaderboard: Grok 4.7 (xhigh) from @spacexai leads at 9.4% Hallucination-Gated All-Pass Rate, narrowly ahead of Muse Spark 1.3 (max) from @AIatMeta at 8.9% and GPT-6 Astra (max) from @OpenAI at 8.6% ➤ Hallucinations reshape the leaderboard: without the hallucination gate, Muse Spark 1.3 (max) would lead clearly with a 26.7% all-pass rate, but two thirds of those passes contain one or more material hallucinations, resulting in a Hallucination-Gated All-Pass Rate of 8.9%. GPT-6 Astra (max) retains almost all of its passes after the hallucination gate (8.9% to 8.6%) and moves from joint 10th to 3rd ➤ The GPT-6 model family is the most grounded: GPT-6 Astra (max) averages 0.03 material hallucinations per task (4 across all 120 tasks) and GPT-6 Sol (max) averages 0.07. When comparing six checker models on a 20-task subset, GPT-6 Astra had zero material hallucinations under every checker, including Claude Opus 5.5 (high). By comparison, Gemini 3.8 Flash (high) averages 13.96 material hallucinations per task. ➤ Top-scoring models aren’t the most expensive: Grok 4.7 (xhigh) takes the top spot on the leaderboard at a cost of ~$9.50 per task, under half the cost of Claude Fable 5.1 (max with fallback) at ~$21.70, the most expensive model. Muse Spark 1.3 (max) represents strong performance for its cost, landing in second for ~$4.20 per task Thank you to @nikogrupen and @ItsJulioPereyra from @harvey for their work on Harvey LAB and collaboration.

Post attachment
Eric Jiang avatar
Eric Jiang@veggie_eric·Sep 12

Use Grok in Powerpoint, Excel, and Word. Just the start of our collaboration with Microsoft Copilot 😊

Launching even more models in Copilot. Grok models from SpaceXAI are rolling out in Copilot in Word, Excel, and PowerPoint—starting with a focused release to customers in the Microsoft Frontier program.

0:05