Skip to content

Repository files navigation

Building an evaluation program that works with CodaLab

This example uses python.

evaluate.py - is an example that checks that the submission data matches the truth data, which is "Hello World!" setup.py - this is a file that enables py2exe to build a windows executable of the evaluate.py script. metadata - this is a file that lists the contents of the program.zip bundle for the CodaLab system.

Once these pieces are assembled they are packages as program.zip which CodaLab can then use to evaluate the submissions for a competition.

About

Tutorial on running a coda lab regression competition

Resources

Stars

3 stars

Watchers

1 watching

Forks

Releases

Packages

Contributors

Languages