According to recent reports, ByteDance is in the process of developing an AI model which could rival Anthropic’s Mythos system. These rumblings are since as part of a wider bid for the company to establish itself as a leader in China’s AI ecosystem.
Financial Times (FT) reported the TikTok owner is in the early stages of training a model with as many as 10 trillion parameters.
This would put ByteDance’s offering ahead of Anthropic’s cutting-edge Mythos and make it three-times larger than Moonshot Kimi K3, the biggest model to come out of China so far.
While Anthropic does not reveal the size of its models, FT reported the most advanced Mythos 5 system has 8 trillion parameters and its Fable 5 about 5 trillion.
ByteDance’s model is apparently being pre-trained, a stage in development which typically takes three-to-six-months. It would then be fine-tuned and released, provided there are no issues.
Chinese companies are showing their hand with regards to AI model development, with Moonshot and Alibaba highlighting releases in recent weeks.
FT added ByteDance invested more aggressively in AI than other Chinese companies, building data centres and attracting talent in the sector.
Founder Zhang Yiming reportedly told staff he wants the team to target “world-leading model capabilities” during an internal meeting last month.
Source: Mobile World Live
Image Credit: ByteDance
Source: Tahawul Tech