Bitcoin reached a new all-time high of $118,900 on Friday, surpassing its previous record of $113,822 set on Thursday. As Read more
Selling software to companies can be a daunting task, especially when it comes to meeting security requirements. Chas Ballew, founder Read more
Earlier this week, San Diego startup Gallant announced $18 million in funding to bring the first FDA-approved ready-to-use stem cell Read more
The world’s richest man buys out one of the most popular social media platforms and uses it as a propaganda Read more
Geekbench AI 1.0: Standardizing Performance Ratings
Primate Labs, known for their benchmarking tools, recently unveiled Geekbench AI 1.0. This new app, currently compatible with Android, Linux, MacOS, and Windows, aims to bring Geekbench’s principles to machine learning, deep learning, and other AI workloads. The goal is to create a standardized system for evaluating performance across different platforms. Geekbench AI 1.0 is the successor to Geekbench ML, first introduced in 2021 and now at version 0.6.
Understanding the Name Change
Explaining the decision to rename the tool, Primate Labs noted the industry trend of using the term ‘AI’ in various workloads and marketing efforts. By rebranding to Geekbench AI, the company hopes to clarify the purpose and functionality of the benchmark for both engineers and performance enthusiasts.
OpenAI’s SWE-bench Verified: Human-Validated AI Models
In a related development, OpenAI recently introduced SWE-bench Verified, a new iteration of their AI model benchmark. Unlike traditional benchmarks, SWE-bench Verified employs human validation to assess the effectiveness of AI models in addressing real-world challenges. This approach aims to provide a more nuanced evaluation of AI performance beyond numerical metrics.
