Apple’s new AI models aren’t living up to the hype on performance

Bitcoin reaches new all-time high of over $118,000 within 24 hours

Bitcoin reached a new all-time high of $118,900 on Friday, surpassing its previous record of $113,822 set on Thursday. As Read more

Conveyor Revolutionizes Vendor Security Reviews and RFPs with AI

Selling software to companies can be a daunting task, especially when it comes to meeting security requirements. Chas Ballew, founder Read more

Ready-made Stem Cell Therapies in Development for Pets

Earlier this week, San Diego startup Gallant announced $18 million in funding to bring the first FDA-approved ready-to-use stem cell Read more

Elon Musk’s Dodgy Election Claims Have Gone Viral with 2 Billion Views on X

The world’s richest man buys out one of the most popular social media platforms and uses it as a propaganda Read more

Apple recently announced updates to its AI models that power its Apple Intelligence features across various platforms. However, the company’s own benchmarks show that these new models are underperforming compared to older models from competitors like OpenAI.

According to Apple, human testers rated the text generated by the newest “Apple On-Device” model as comparable to, but not better than, text from similar Google and Alibaba models. Additionally, Apple’s more advanced model, “Apple Server,” was rated behind OpenAI’s GPT-4o in a separate test evaluating image analysis capabilities.

These benchmark results suggest that Apple’s AI research division is struggling to keep up with competitors in the AI race. Despite promises of a Siri upgrade, Apple’s AI capabilities have fallen short in recent years. Some customers have even taken legal action against Apple for falsely marketing AI features that have not been delivered.

See also  Vanguard revises Indian rideshare startup Ola's valuation to $2B

Both Apple On-Device and Apple Server have seen improvements in tool use and efficiency compared to their predecessors. They are capable of understanding around 15 languages, thanks to an expanded training dataset that includes various types of data such as images, PDFs, documents, and more. Developers can now access these models through Apple’s Foundation Models framework.

Defense startup Epirus in discussions to secure more than $150M in funding, potentially impacting valuation.

Marks & Spencer chair dodges question on paying hackers after cyber attack