poprox_recommender.evaluation.collect

Collect offline metrics from different pipelines for a run.

For an evaluation EVAL, this script collects metrics from outputs/EVAL/*/metrics.json, and outputs them to outputs/EVAL-metrics.csv. It likewise aggregates the profile metrics.

Usage:

poprox_recommender.evaluation.collect [options] EVAL

Options:

-v, --verbose

enable verbose diagnostic logs

--log-file=FILE

write log messages to FILE

EVAL the name of the evaluation to aggregate

Functions

main()