Patreon Preview 358. *Se7en Voice* Whats in the Benchmark?

Published: Aug. 7, 2024, 4:43 a.m.

We first get an update on regulatory arbitrage in the weed vape industry, then discuss how the benchmarks used to rank AI models\u2014and make claims about their "intelligence" relative to humans\u2014are largely low quality, out-of-date, not fit for purpose, or just meaningless and deceptive. Yet they are widely treated by industry as authoritative standards. Then we talk a bit about yet another case of a risk scoring algorithm resulting in devastating consequences.\n\n\u2022\u2022\u2022 Everyone Is Judging AI by These Tests. But Experts Say They\u2019re Close to Meaningless https://themarkup.org/artificial-intelligence/2024/07/17/everyone-is-judging-ai-by-these-tests-but-experts-say-theyre-close-to-meaningless\n\u2022\u2022\u2022 An Algorithm Told Police She Was Safe. Then Her Husband Killed Her. https://www.nytimes.com/interactive/2024/07/18/technology/spain-domestic-violence-viogen-algorithm.html \n\nSubscribe to hear more analysis and commentary in our premium episodes every week! https://www.patreon.com/thismachinekills \n\nHosted by Jathan Sadowski (www.twitter.com/jathansadowski) and Edward Ongweso Jr. (www.twitter.com/bigblackjacobin). Production / Music by Jereme Brown (www.twitter.com/braunestahl)