Component
Analysis / Benchmark Report v0.2 conversion
Description
The inference-perf converter in native_to_br0_2.py writes aggregate output_token_rate, total_token_rate, and request_rate, but does not write input_token_rate.
The Benchmark Report v0.2 schema supports all three token-rate fields. Consumers such as Prism therefore cannot display input token throughput from the generated report, even though inference-perf summary_lifecycle_metrics.json contains enough information.
Current behavior
results.request_performance.aggregate.throughput.input_token_rate is absent from inference-perf BR v0.2 output.
Expected behavior
The converter should populate input_token_rate. It can use a native input-token throughput value when available, or derive it as total_token_rate - output_token_rate.
The converter should preserve None when the required source values are unavailable and include regression coverage for the mapping.
Reproduction
- Run an inference-perf benchmark with analysis enabled.
- Compare
summary_lifecycle_metrics.json with the generated benchmark_report_v0.2,_*.yaml.
- Observe that output and total token rates are present in the report, while input token rate is missing.
Component
Analysis / Benchmark Report v0.2 conversion
Description
The inference-perf converter in
native_to_br0_2.pywrites aggregateoutput_token_rate,total_token_rate, andrequest_rate, but does not writeinput_token_rate.The Benchmark Report v0.2 schema supports all three token-rate fields. Consumers such as Prism therefore cannot display input token throughput from the generated report, even though inference-perf
summary_lifecycle_metrics.jsoncontains enough information.Current behavior
results.request_performance.aggregate.throughput.input_token_rateis absent from inference-perf BR v0.2 output.Expected behavior
The converter should populate
input_token_rate. It can use a native input-token throughput value when available, or derive it astotal_token_rate - output_token_rate.The converter should preserve
Nonewhen the required source values are unavailable and include regression coverage for the mapping.Reproduction
summary_lifecycle_metrics.jsonwith the generatedbenchmark_report_v0.2,_*.yaml.