All tags
Posts tagged with "SGLang"
Autotune, End to End — From Triton to FlyDSL
How kernel autotuning is designed in Triton, used in aiter / quack / CuteDSL, and consumed by inference engines like SGLang — and, from all of that, how to design a real autotune path for FlyDSL. With a full HTML deep dive carrying six hand-drawn SVG plates.
Benchmark: Qwen3-Coder-30B-A3B + EAGLE3 Speculative Decoding
EAGLE3 speculative decoding benchmarks on Qwen3-Coder — 1.87x speedup for code generation