News
Moonshot AI Releases 𝑨𝒕𝒕𝒆𝒏𝒕𝒊𝒐𝒏 𝑹𝒆𝒔𝒊𝒅𝒖𝒂𝒍𝒔 to Replace Fixed Residual Mixing with Depth-Wise Attention for Better Scaling in Transformers
Residual connections are one of the least questioned parts of modern Transformer design. In PreNorm...
Moonshot AI Launches Kimi Work, a Local Desktop Agent Reportedly Running on Kimi K2.6 With a 300-Sub-Agent Agent Swarm
Moonshot AI has introduced Kimi Work, an AI agent that runs on your own desktop...
MoonMath AI Open-Sources a HIP Attention Kernel for AMD MI300X That Beats AITER v3 on Every Shape and Rounding Mode
MoonMath AI team has released a bf16 forward attention kernel for AMD’s MI300X GPU. It...
Monadic Context Engineering
arXiv:2512.22431v2 Announce Type: replace-cross Abstract: The proliferation of Large Language Models (LLMs) has catalyzed a...
Moltbook was peak AI theater
For a few days this week the hottest new hangout on the internet was a...
MolLangBench: A Comprehensive Benchmark for Language-Prompted Molecular Structure Recognition, Editing, and Generation
arXiv:2505.15054v3 Announce Type: replace Abstract: Precise recognition, editing, and generation of molecules are essential prerequisites...
MoE Architecture Comparison: Qwen3 30B-A3B vs. GPT-OSS 20B
This article provides a technical comparison between two recently released Mixture-of-Experts (MoE) transformer models: Alibaba’s...
Modeling and Predicting Multi-Turn Answer Instability in Large Language Models
arXiv:2511.10688v1 Announce Type: new Abstract: As large language models (LLMs) are adopted in an increasingly...
Model Interpretability and Rationale Extraction by Input Mask Optimization
arXiv:2508.11388v1 Announce Type: new Abstract: Concurrent to the rapid progress in the development of neural-network...
Model Context Protocol: A promising AI integration layer, but not a standard (yet)
Enterprises should experiment with MCP where it adds value, isolate dependencies and prepare for a...
Model Context Protocol Explained in 3 Levels of Difficulty
MCP provides a standard way for AI applications and external systems to communicate...
Modality Collapse as Mismatched Decoding: Information-Theoretic Limits of Multimodal LLMs
arXiv:2602.23136v2 Announce Type: replace Abstract: Numerous studies have shown that multimodal LLMs process speech and...
