add unittest validing mobidus with OnnxDiscrepancyCheck#2567
Conversation
|
@copilot fix lint |
|
@copilot test/passes/onnx/test_session_params_tuning.py:174: in test_ort_session_params_tuning_pass_with_dynamic_shapes |
|
@copilot resolve the merge conflicts in this pull request |
|
@copilot resolve the merge conflicts in this pull request |
There was a problem hiding this comment.
Pull request overview
This PR adds unit test coverage to ensure OnnxDiscrepancyCheck’s generation-comparison path correctly auto-detects ORT GenAI exporter artifacts produced by MobiusBuilder (via presence of genai_config.json) and behaves consistently with the existing ModelBuilder-based flow.
Changes:
- Add tests verifying a Mobius export directory containing
genai_config.jsonis used asgenai_model_pathfor generation metrics. - Add a test ensuring the
first_token_20metric forcesmax_new_tokens=20when running generation comparison. - Add a test ensuring generation comparison is skipped when a Mobius export directory lacks
genai_config.json.
Describe your changes
Make sure there is a test validating the mobius export path and OnnxDiscrepancyCheck.