Improve MA-BBOB evaluation by skipping zero-weight BBOB instances - #216
Open
shuheitnk wants to merge 1 commit into
Open
Improve MA-BBOB evaluation by skipping zero-weight BBOB instances#216shuheitnk wants to merge 1 commit into
shuheitnk wants to merge 1 commit into
Conversation
Suggestions: Improving Existing functionalities
Description in detail:
This PR suggests a small optimization to the MA-BBOB evaluation by skipping
BBOB instances with zero weights. The current implementation evaluates all
24 BBOB instances, including instances that do not contribute to the
objective. Skipping these evaluations avoids unnecessary computation while
preserving the MA-BBOB objective value.
The benchmark measures the time to evaluate 20,000 solutions on each of the
MA-BBOB instances {1..100}, across the dimensions {2, 5, 20, 40}. Runtime is
reduced from 211.26 s to 33.61 s (6.29× speedup).
Name of the function and file:
ioh::problem::bbob::ManyAffine::evaluate
include/ioh/problem/bbob/many_affine.hpp
Additional information:
No additional dependencies are required. The optimized implementation was
verified against the original evaluation by comparing the 20,000 objective
values of each instance bitwise, with no differences found across all
instances. The test suite passes (99/99).
The evaluation counters of skipped subproblems are not incremented.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Suggestions: Improving Existing functionalities
Description in detail:
This PR suggests a small optimization to the MA-BBOB evaluation by skipping
BBOB instances with zero weights. The current implementation evaluates all 24
BBOB instances, including instances that do not contribute to the objective.
Skipping these evaluations avoids unnecessary computation while preserving the
MA-BBOB objective value.
The benchmark measures the time required to evaluate 20,000 solutions for each
of the MA-BBOB instances {1..100}, across dimensions {2, 5, 20, 40}. Runtime is
reduced from 211.26 s to 33.61 s (6.29× speedup).
Name of the function and file:
ioh::problem::bbob::ManyAffine::evaluate
include/ioh/problem/bbob/many_affine.hpp
Additional information:
No additional dependencies are required. The modified implementation was
verified against the original implementation by comparing the 20,000 objective
values of each instance bitwise, with no differences found across all
instances. The test suite passes (99/99).
The evaluation counters of skipped subproblems are not incremented.