NVIDIA's Nemotron 3.5 Lightning fits a 1M-token context on one node
A 30B open-weight model that activates only about 3B parameters per token, mixing Mamba-2, attention and mixture-of-experts layers. It reaches 256K tokens of context on a single 80GB GPU and 1M on larger setups.
- Source
- AlphaSignal
- Published
- Type
- model
- Read
- 1 min read
A 30B open-weight model that activates only about 3B parameters per token, mixing Mamba-2, attention and mixture-of-experts layers. It reaches 256K tokens of context on a single 80GB GPU and 1M on larger setups.
Commercial use is allowed. On most benchmarks it trails Qwen 3.6 35B A3B, so the draw is efficient long-context serving, not top scores.
Summarized by Atlas from AlphaSignal. Rights remain with the original publisher.
Read original report