ByteDance, the company behind the popular social media platform TikTok, is developing a new artificial intelligence model with a potential scale of 10 trillion parameters. This initiative places the Chinese technology giant in direct competition with leading U.S. AI developers, including Anthropic and its Mythos system. The model is currently in its early pre-training phase, a process that is expected to last between three to six months.
The reported parameter count of 10 trillion would make ByteDance's model more than three times larger than Moonshot AI's Kimi K3, which currently holds the distinction of being China's largest released AI model at 2.8 trillion parameters. Industry estimates suggest that Anthropic's Mythos 5 model contains approximately 8 trillion parameters, placing ByteDance's new model in a comparable, if not larger, scale. While parameter count is a common metric for AI model scale, it does not solely determine a model's capability; data quality and training techniques also play significant roles.
ByteDance founder Zhang Yiming has reportedly urged the company's AI team to prioritize independent development and long-term innovation over short-term competition or the use of AI distillation techniques. This strategy emphasizes building foundational capabilities rather than relying on or copying existing models. This approach comes amid ongoing discussions and accusations between the U.S. and China regarding AI technology, including allegations of model distillation.
The company's commitment to developing such a large-scale model indicates its ambition to compete at the highest level of AI development. ByteDance already operates the consumer AI assistant Doubao, which has a significant user base in China, providing a potential distribution channel for its advanced AI models. The company has also developed the SeeDance video generation model, which is considered among the most advanced in its field.
The development of this massive AI model by ByteDance highlights a broader trend of Chinese technology firms aiming not only to catch up with but also to surpass their Western counterparts in the advanced AI sector. While specific details regarding the final parameter count and release timeline are yet to be determined, the project signifies a substantial investment in cutting-edge AI research and development by ByteDance. The company has not publicly commented on the report.