Skip to content

Minor modifications#2

Open
mam10eks wants to merge 4 commits into
sisap-challenges:mainfrom
mam10eks:minor-modifications
Open

Minor modifications#2
mam10eks wants to merge 4 commits into
sisap-challenges:mainfrom
mam10eks:minor-modifications

Conversation

@mam10eks

@mam10eks mam10eks commented Jul 5, 2026

Copy link
Copy Markdown

Some minor modifications to add more details to the json results and to write a temporary cache file to speed up the csv creation. (the evaluation otherwise runs hours on task 1)

Comment thread eval.py
print(dataset, task, attrs.get("algo"), attrs.get("params"), "=>", recall)
row["recall"] = recall[0]
row["recall_description"] = recall[1]
add_details_from_tira(fn, row)

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This should be guarded by a flag parsed as command line argument

Comment thread eval.py
recall = get_recall(knns, gt_I, k)
row = dict(attrs)
row["recall"] = recall
print(dataset, task, attrs.get("algo"), attrs.get("params"), "=>", recall)

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Wasn't that rather helpful? :-) to see the progress?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants