Mixture of Experts (Sparse MoE for LLMs)

An architecture where a router activates only a subset of expert sub-networks per token, scaling parameter count without proportional compute cost.

Two-hop subgraph: this entity, every entity it directly relates to, and every entity those neighbors relate to. Drag a node, scroll to zoom, click to inspect — or click any neighbor and re-center the atlas there.