OpenAI, the company that launched ChatGPT a little over a year ago, has recently taken to social media to address concerns regarding the “lazy” performance of GPT-4 on social media and Google Reviews.
This move comes after growing user feedback online, which even includes a one-star Google Review on the company’s Google Business Profile.
OpenAI Gives Insight Into Training Chat Models, Performance Evaluations, And A/B Testing
OpenAI, through its @ChatGPTapp Twitter account, detailed the complexities involved in training chat models.
The organization highlighted that the process is not a “clean industrial process” and that variations in training runs can lead to noticeable differences in the AI’s personality, creative style, and political bias.
Thorough AI model testing includes offline evaluation metrics and online A/B tests. The final decision to release a new model is based on a data-driven approach to improve the “real” user experience.
OpenAI’s Google Review Score Affected By GPT-4 Performance, Billing Issues
This explanation comes after weeks of user feedback about GPT-4 becoming worse on social media networks like X.
Idk if anyone else has noticed this, but GPT-4 Turbo performance is significantly worse than GPT-4 standard.
I know it’s in preview right now but it’s significantly worse.
— Max Weinbach (@MaxWinebach) November 8, 2023
There has been discussion if GPT-4 has become “lazy” recently. My anecdotal testing suggests it may be true.
I repeated a sequence of old analyses I did with Code Interpreter. GPT-4 still knows what to do, but keeps telling me to do the work. One step is now many & some are odd. pic.twitter.com/OhGAMtd3Zq
— Ethan Mollick (@emollick) November 28, 2023
Complaints also appeared in OpenAI’s community forums.
The experience led one user to leave a one-star rating for OpenAI via Google Reviews.
In addition to GPT-4 performance “degeneration” and lack of intelligence, some Google Reviews pointed out billing and customer support issues.
Interestingly, the Google review with the most likes from five years ago aligns with recent rumors about a volatile workplace, alleging that OpenAI is a “Cutthroat environment. Not friendly. Toxic workers.”
Reviews voted the most helpful on Glassdoor about OpenAI suggested that employee frustration and product development issues stem from the company’s shift in focus on profits.
This incident provides a unique outlook on how customer and employee experiences can impact any business through various reviews and ratings platforms.
Google SGE Highlights Positive Google Reviews
In addition to occasional complaints, Google reviewers acknowledged the revolutionary impact of OpenAI’s technology on various fields.
The most positive review mentions about the company appear in Google SGE (Search Generative Experience).
Conclusion
OpenAI’s recent insights into training chat models and response to public feedback about GPT-4 performance illustrate AI technology’s dynamic and evolving nature and its impact on those who depend on the AI platform.
Especially the people who just received an invitation to join ChatGPT Plus after being waitlisted while OpenAI paused new subscriptions and upgrades. Or those developing GPTs for the upcoming GPT Store launch.
As AI advances, professionals in these fields must remain agile, informed, and responsive to technological developments and the public’s reception of these advancements.
Featured image: Tada Images/Shutterstock
