Commit 4f343d3
committed
Add Intern-S2-Mobius (interns2_mobius) model
Hybrid Gated-DeltaNet / full-attention MoE with globally shared expert banks, fused gate/up SwitchGLU, and a guarded Metal router-topk kernel with a pure-MLX fallback.1 parent 5c13170 commit 4f343d3
3 files changed
Lines changed: 753 additions & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
30 | 30 | | |
31 | 31 | | |
32 | 32 | | |
33 | | - | |
| 33 | + | |
| 34 | + | |
0 commit comments