https://www.vishalv.com/tags/kda Personal website of Vishal V, featuring writing, ideas, projects, and research en-us vishalvignesh.iitm@gmail.com (Vishal V) vishalvignesh.iitm@gmail.com (Vishal V) Fri, 28 Aug 2026 00:00:00 GMT https://www.vishalv.com/notes/teamKimiK3Open2026 https://www.vishalv.com/notes/teamKimiK3Open2026 We introduce Kimi K3, a 2.8T parameter Mixture-of-Experts model with 104 billion activated parameters, native vision capabilities, and a 1-million-token context window. Kimi K3 is built on Kimi Delta Attention and Attention Residuals, which improve information flow across... Fri, 28 Aug 2026 00:00:00 GMT vishalvignesh.iitm@gmail.com (Vishal V) moekdamla