Files
amd-r9700-vllm-toolboxes/benchmarks/benchmark_results_nvidia-a100/RedHatAI_Qwen3-14B-FP8-dynamic_tp1_throughput.json
T
2026-03-26 20:50:00 +08:00

7 lines
191 B
JSON

{
"elapsed_time": 248.4086626805365,
"num_requests": 1000,
"total_num_tokens": 741334,
"requests_per_second": 4.0256245060424485,
"tokens_per_second": 2984.3323175624723
}