Files
amd-r9700-vllm-toolboxes/benchmarks/benchmark_results_nvidia-a100/openai_gpt-oss-20b_tp1_throughput.json
T
2026-03-26 20:50:00 +08:00

7 lines
190 B
JSON

{
"elapsed_time": 156.32366928458214,
"num_requests": 1000,
"total_num_tokens": 738792,
"requests_per_second": 6.396983928131399,
"tokens_per_second": 4726.040550232053
}