Compared with the decode implementation before v0.1.0, committed throughput on the same 85K-token code task increased from 143.46 to 198.10 tok/s — about 38.1% faster. Both measurements use two V100 ...
Some results have been hidden because they may be inaccessible to you
Show inaccessible results