Tag Archives: Accuracy

ChatGPT’s Mathematical Accuracy Falls To Shocking 2%; Response Quality Deteriorates – Trak.in

In recent times, there has been a growing number of reports and discussions about a decline in the quality of responses from ChatGPT. To investigate this matter, a team of researchers from Stanford and UC Berkeley conducted a study to quantify the extent of this degradation. The study confirmed that the drop in ChatGPT’s quality was indeed real.

ChatGPT's Mathematical Accuracy Falls To Shocking 2%; Response Quality Deteriorates

The research paper titled “How Is ChatGPT’s Behavior Changing Over Time?” was authored by three prominent academics: Matei Zaharia, Lingjiao Chen, and James Zou. Matei Zaharia, who is a Computer Science Professor at UC Berkeley, shared the findings on Twitter, revealing a startling fact that GPT-4’s success rate in solving certain problems fell drastically from 97.6% to 2.4% between March and June.

GPT-4, which was recently released…


Source link