China Tech Talk

TP Huang

A podcast where I talk about various Chinese tech development in new energy, AI, semiconductor, robotics and military fields. Follow me on substack https://tphuang.substack.com or X https://x.com/tphuang tphuang.substack.com

  1. 22 July

    Talking about Kimi K3/WAIC on Carl Zha podcast

    This week, I had a chance to go on Carl Zha’s livestream to talk about the launch of Kimi K3 and what we saw at WAIC. Unfortunately, I had to leave early due to family obligations, but I think most of the issues I wanted to cover was already talked about. I’m actually a little surprised of the audio quality in there. I think next time, I have to go with something other than iPhone when I do this. I just want again to point out something that I think is very under reported out there. Chinese models are getting larger and they will keep getting larger. Biren Tech reported this week that Chinese models will get to 5T+ range next year and it looks like we will reach 10T the year after as larger super node becomes available that can pool together all the high bandwidth memory and do efficient inference of these large MoE models. All of the major Chinese AI players like Moonshot, Zai, DeepSeek, Qwen and Minimax are going into new and larger sized models this year. Larger models require more compute to train, more data and more longer term optimization for inference. All of this has been made easier by the increased automation these firms can use to improve and speed up their own model development and training time. We are now seeing these very fast iterative improvement from Kimi and GLM in recent times. These are the new standards. The public is no longer happy with a new big improvement every 3 to 4 months. This needs to be every 1 to 2 months and eventually every month by the end of this year. Teams will need to have both flagship LLM and smaller and cheaper distilled models. This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit tphuang.substack.com

    Talking about Kimi K3/WAIC on Carl Zha podcast

About

A podcast where I talk about various Chinese tech development in new energy, AI, semiconductor, robotics and military fields. Follow me on substack https://tphuang.substack.com or X https://x.com/tphuang tphuang.substack.com

You Might Also Like