This repository contains the Python and MATLAB evaluation code for the George B. Moody PhysioNet Challenge 2022.
The evaluate_model
script evaluates the output of your classifier using the evaluation metric that is described on the webpage for the 2022 Challenge. While this script reports multiple evaluation metrics, we use the last score (Challenge
) to rank your model.
You can run the Python evaluation code by installing the NumPy package and running the following command in your terminal:
python evaluate_model.py labels outputs scores.csv class_scores.csv
where
labels
(input; required) is a folder with labels for the data, such as the training data on the PhysioNet webpage;outputs
(input; required) is a folder containing files with your model's outputs for the data;scores.csv
(output; optional) is a collection of scores for your model; andclass_scores.csv
(output; optional) is a collection of per-class scores for your model.
You can run the MATLAB evaluation code by installing Python and the NumPy package and running the following command in MATLAB:
evaluate_model('labels', 'outputs', 'scores.csv', 'class_scores.csv')
where
labels
(input; required) is a folder containing files with the labels for the data, such as the training data on the PhysioNet webpage;outputs
(input; required) is a folder containing files with outputs produced by your model for the data;scores.csv
(output; optional) is a collection of scores for your model; andclass_scores.csv
(output; optional) is a collection of per-class scores for your model.
Unable to run this code with your code? Try one of the example classifiers on the training data. Unable to install or run Python? Try Python, Anaconda, or your package manager.
Please see the Challenge website for more details. Please post questions and concerns on the Challenge discussion forum.