- tech360.tv
Baidu's AI model, Ernie 3.5, surpasses ChatGPT
Updated: Jan 5
Baidu's AI model, Ernie 3.5, surpasses ChatGPT and GPT-4 on key metrics, gaining traction in China's AI race.
Baidu Inc (9888.HK), the leading search engine provider in China, announced on Tuesday that its latest iteration of the ChatGPT-style service, Ernie 3.5, has outperformed the popular Microsoft-backed OpenAI chatbot across various crucial measures.
In a statement, Baidu revealed that Ernie 3.5 surpassed ChatGPT in comprehensive ability scores and demonstrated superior performance in multiple Chinese capabilities compared to GPT-4. The company based its claims on a test conducted by China Science Daily, which used AGIEval and C-Eval datasets to evaluate the AI models' performance.
OpenAI has not responded to an email seeking comment beyond regular business hours.
This announcement from Baidu adds to the ongoing global AI excitement sparked by ChatGPT, which has now spread to China, leading to a wave of domestic companies unveiling their rival products. Baidu took the lead among Chinese tech giants by introducing its language AI Ernie Bot in March as a competitor to ChatGPT. Built on Baidu's previous Ernie 3.0 AI model, Ernie Bot has undergone invite-only testing over the past three months. Other major Chinese tech firms, including Alibaba Group (9988.HK) and Tencent Holdings (0700.HK), have also disclosed their respective AI models since then.
Baidu's new model offers improved training and inference efficiency, positioning it for faster and more cost-effective iterations in the future. Additionally, Baidu announced that its model supports external "plugins," which are supplementary applications enabling the AI to handle specific scenarios such as summarizing lengthy texts and generating more accurate answers. Alibaba Group and Tencent Holdings have also introduced their own AI models with similar plugin capabilities.
Baidu's Ernie 3.5 surpasses Microsoft-backed OpenAI chatbot, ChatGPT, in key metrics.
Ernie 3.5 outperforms GPT-4 in various Chinese capabilities.
The evaluation test by China Science Daily validates Ernie 3.5's superior performance.
Baidu's Ernie Bot was the first Chinese AI product to rival ChatGPT.