🔥 Trending today
Reality: The Final Eval — Lukas Petersson and Axel Backlund of Andon Labs
Latent Space9 days agoBenchmarkLatent Space talks with Lukas Petersson and Axel Backlund of Andon Labs, the authors behind VendingBench. The episode focuses on evaluating Claude models across a range from Haiku to Mythos. It also discusses how they build frontier evals from scratch, with an emphasis on creating benchmarks that remain useful and meaningful over time.
Harness, Scaffold, and the AI Agent Terms Worth Getting Right★ 75
Hugging Face Blog20 days agoTutorialHugging Face has published a comprehensive glossary of AI agent terminology to resolve industry-wide confusion. The guide focuses on defining critical concepts such as "scaffold" (the code wrapping the LLM) and "harness" (the evaluation and execution environment). This standardization helps developers and researchers communicate more precisely when building and benchmarking agentic systems.