Anthropic CEO Dario Amodei is facing challenges in a copyright lawsuit against OpenAI, as reported in new court filings. The Read more
Artificial Intelligence Terminology: A Comprehensive Guide Artificial General Intelligence (AGI) Artificial General Intelligence (AGI) surpasses conventional AI capabilities by excelling Read more
On Sunday, the European Union granted regulators the authority to prohibit the use of AI systems considered to pose an Read more
LexisNexis Risk Solutions, a data broker that collects and uses consumers’ personal data to help its paying corporate customers detect Read more
OpenAI utilized the subreddit, r/ChangeMyView, as a testing ground to evaluate the persuasive capabilities of its AI reasoning models. This testing method was disclosed in a system card accompanying the launch of OpenAI’s new “reasoning” model, o3-mini, on Friday.
Reddit’s r/ChangeMyView community, consisting of millions of users, serves as a platform for individuals to present their viewpoints in hopes of engaging in discussions from varying perspectives. Users engage in persuasive debates, aiming to sway the original poster’s opinion on a particular topic.
The utilization of platforms like r/ChangeMyView by tech companies, such as OpenAI, signifies the value of high-quality, user-generated data for training AI models. OpenAI gathers user posts from the subreddit and tasks its AI models with crafting responses designed to change the Reddit users’ viewpoints. Testers then evaluate the persuasiveness of these AI-generated arguments, comparing them against human responses.
OpenAI’s collaboration with Reddit under a content-licensing agreement allows the company to access and utilize Reddit posts for training its AI models. Despite concerns over data access and usage, OpenAI emphasizes that their evaluation based on ChangeMyView is distinct from their Reddit partnership and has no plans for public release.
In evaluating performance on the ChangeMyView benchmark, o3-mini demonstrates persuasive argumentation abilities comparable to o1 and GPT-4o, falling within the top 80-90th percentile of humans. OpenAI aims to strike a balance in AI model development, ensuring models do not exhibit overly persuasive or deceptive qualities that could pose risks in user interactions.
The ongoing pursuit of high-quality datasets remains a challenge for AI model developers, despite efforts to access public internet data and secure licensing agreements. The ChangeMyView benchmark underscores the complexities involved in sourcing reliable data for testing AI models, highlighting the ongoing dilemmas in AI development and ethical considerations.
