MLPerf 3 Upsets the AI Apple Cart | Gestalt IT Rundown: June 28, 2023

Published: June 28, 2023, 5:55 p.m.

Training 3.0 benchmark results show performance gains of up to 1.54x compared to six months ago and 33-49x improvement over the first round, driving innovation and energy efficiency in the industry. Intel's Habana Gaudi2 ML training engine competes with Nvidia's offerings, boasting better performance than A100 and lower pricing than H100. Nvidia, on the other hand, unveils their NeMo model with half a trillion parameters and expands the MLPerf Training suite to include GPT-3 and a new Recommendation engine. Their collaboration with CoreWeave showcases the superior performance of the H100, providing a 3.6x speed increase for GPT-3 compared to Intel Xeon and Gaudi2. Nvidia is also developing foundation models for their DGX cloud, collaborating with major players in the industry, and Intel is widely rumored to be developing its own Gaudi2-as-a-Service offering. Then there's the Tiny 1.1 inferencing benchmark, which saw over 150 results and performance improvements up to 1000x. \n\nTime Stamps:\n0:00 - Welcome to the Rundown\n0:48 - What Red Hat is doing with CentOS\n3:36 - Moving Windows to the cloud for consumers\n6:31 - IBM acquires Apptio\n8:51 - Cisco set to acquire SamKnows\n12:04 - Databricks Acquires MosaicML\n15:37 - Cato Networks introduces AI tracker for malware command and control\n18:39 - MLPerf 3 Upsets the AI Apple Cart\n32:10 - The Weeks Ahead\n33:40 - Thanks for Watching\n\nFollow our Hosts on Social Media\nTom Hollingsworth: https://www.twitter.com/NetworkingNerd\nStephen Foskett: https://www.twitter.com/SFoskett \nTim Bertino: https://www.twitter.com/TimBertino\n\nFollow Gestalt IT\nWebsite: https://www.GestaltIT.com/\nTwitter: https://www.twitter.com/GestaltIT\nLinkedIn: https://www.linkedin.com/company/Gestalt-IT

\n

#Rundown, #MLPerf, #CentOS, #RHEL, @RedHat, #Cloud, @Microsoft, @Windows, @IBM, @Apptio, #NetworkMonitoring, @Cisco, @SamKnows, @Databricks, @MosaicML, @CatoNetworks, #AI, @MLCommons, #MLPerf3,