←
MLCommons874 posts
MLCommons avatar✓

MLCommons ✓

@MLCommons

Better Artificial Intelligence for Everyone

◷ Joined September 2020▧ 160 Photos and videos
MLCommons avatar
MLCommons@MLCommons·Oct 29

MLCommons has launched Candela, a benchmarking service that runs AILuminate safety benchmarks where AI systems actually run: a model as released or a system as deployed. Practice on demand, official scores, percentiles comparable over time. mlcommons.org/2026/10/introd…

Post attachment
MLCommons avatar
MLCommons@MLCommons·Oct 20

MLPerf Client is in PCMag, StorageReview, and Wccftech, which used it to measure on-device AI performance on new laptops, including GenAI image generation and agentic workloads. Thanks to the reviewers! Try MLPerf Client: github.com/mlcommons/mlperf_…

MLCommons avatar
MLCommons@MLCommons·Oct 15

MLCommons has been selected as the Benchmarking Team for the STRIDE Ventures AI Efficiency Challenge. A $3.5 million, two-year award will fund MLPerf Agents: an industry-standard benchmark for the efficiency of complete agentic AI workflows. mlcommons.org/2026/10/nsf-st…

Post attachment
MLCommons avatar
MLCommons@MLCommons·Oct 8

A vendor's AI benchmark caught 82% of bugs. A rival re-ran the same test: 45%. An independent lab built its own: 63%. Same products. Only the grading changed. New from MLCommons: Assessing & Managing AI Risk for Business and Commercial Deployments. mlcommons.org/2026/10/ai-ris…

Post attachment
MLCommons avatar
MLCommons@MLCommons·Oct 1

MLPerf Training introduces DLRMv4: HSTU sequence modeling + Yambda-5B (4.79B real interactions) + a 560 GB embedding footprint. Production-scale recommenders, now benchmarked. Full breakdown from the AMD, Meta, NVIDIA, and ByteDance task force: More: mlcommons.org/2026/10/dlrmv4…

Post attachment
MLCommons avatar
MLCommons@MLCommons·Sep 24

MLPerf Training v6.1 adds the suite's first LLM post-training benchmark: agentic RL that teaches a 397B-parameter open-weight model to repair real software, scored on pass@4 quality - not just throughput. Details from the task force: mlcommons.org/2026/09/mlperf…

Post attachment
MLCommons avatar
MLCommons@MLCommons·Sep 23

MLCommons joins the EU-funded AIRIS consortium to benchmark next-generation biomedical AI. We're building an evaluation framework to measure mechanism-informed generative AI across accuracy, robustness, fairness, interpretability, and usability. More: mlcommons.org/2026/09/join-a…

Post attachment
MLCommons avatar
MLCommons@MLCommons·Sep 17

MLPerf Inference v6.1 WG chairs Miro Hodak and Frank Han walk through the record round, new silicon (AMD MI350P, Intel Arc Pro B70, NVIDIA Vera Rubin), the first cross-vendor heterogeneous submission, and what it signals for inference engineering. mlcommons.org/2026/09/chairs…

Post attachment