Output


tok_emb 8192 × 384 ×16 BLOCK RMSNorm attn GQA + RoPE 8Q / 2KV · d=48 RMSNorm ff SwiGLU ff=1024 final_norm · RMSNorm lm_head (tied to tok_emb) → logits
~28M params · quantized ~34MB