fix(speed_benchmark): align benchmarks with the Reactive_E2E contract (#92)#96
Merged
riita10069 merged 1 commit intoJun 30, 2026
Conversation
…autowarefoundation#92) The benchmark harnesses still assumed the pre-refactor API and crash on the current main: - AutoE2E no longer accepts `fusion_mode` (concat/cross_attn and the knob were removed; BEV is the only multi-view fusion) -> construct with view_fusion_kwargs={bev_h,bev_w} and drop the fusion_mode sweep. - AutoE2E.forward now takes `map_input` and returns the trajectory tensor directly (the (loss/traj, ego_hidden, future) 3-tuple was removed) -> feed a map image and stop unpacking a tuple. - planner_benchmark: gru was removed from PLANNER_REGISTRY -> benchmark flow_matching vs bezier; planners now return the trajectory directly, so read `out` (not out[0]) for the smoothness metric. planner_benchmark verified end-to-end (bezier jerk ~5e-6 vs flow_matching ~3.4); speed_benchmark forward path validated on CPU. ruff + mypy clean. Signed-off-by: GABRIELA CORDOVA <100548769@alumnos.uc3m.es>
Contributor
Author
|
CI green. The two harnesses under
Verified end-to-end ( |
riita10069
approved these changes
Jun 30, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Problem
Model/speed_benchmark/speed_benchmark.pyandplanner_benchmark.pystill assumethe pre-refactor API and crash on the current
main(postReactive_E2Erefactor).Fix
speed_benchmark.pyAutoE2Eno longer acceptsfusion_mode(concat / cross_attn and the knob wereremoved; BEV is the only multi-view fusion) → construct with
view_fusion_kwargs={"bev_h": 8, "bev_w": 8}and drop the fusion_mode sweep.AutoE2E.forwardnow takesmap_inputand returns the trajectory tensordirectly (the
(loss/traj, ego_hidden, future)3-tuple was removed) → feed amap image and stop unpacking a tuple.
planner_benchmark.pygruwas removed fromPLANNER_REGISTRY→ benchmarkflow_matchingvsbezier.out(notout[0]) for thesmoothness metric.
Verification
planner_benchmark.pyruns end-to-end: bezier jerk ~5e-6 vs flow_matching ~3.4(the Bernstein-basis smoothness guarantee holds, as expected).
speed_benchmark.pyforward path validated on CPU (is_pretrained=False).Closes #92.