From ff422e55c649d00ecc169de20723fb4bf36bfbc2 Mon Sep 17 00:00:00 2001 From: Till Beemelmanns Date: Wed, 29 May 2024 10:54:56 +0200 Subject: [PATCH] update README.md --- README.md | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/README.md b/README.md index 8c4142d..f1c0f73 100644 --- a/README.md +++ b/README.md @@ -142,15 +142,15 @@ Preprint: [https://arxiv.org/abs/2402.11677](https://arxiv.org/abs/2402.11677) ## Metrics We adhere to the official nuScenes metric definition for computing the NDS and mAP metrics on the MultiCorrupt dataset. To quantitatively compare the performance between the corrupted dataset and the clean nuScenes datasets, we use a metric called the *Resistance Ability* (RA). This metric is calculated across the different severity levels with -$$RA_{c,s} = \frac{{M}_{c,s}}{{M}_{clean}}, RA_c = \frac{1}{3} \sum_{s=1}^{3} RA_{c,s}$$ +$$RA_{c,s} = \frac{M_{c,s}}{M_{clean}}, RA_c = \frac{1}{3} \sum_{s=1}^{3} RA_{c,s}$$ $$mRA = \frac{1}{N} \sum_{c=1}^{N} RA_c$$ -where ${M}_{c,s}$ represents metric for the $c$ types of corruption at the $s$-the severity level, $N$ is the total number of corruption types considered in our benchmark, and ${M}_{clean}$ is performance on the "clean" nuScenes dataset. +where $M_{c,s}$ represents metric for the $c$ types of corruption at the $s$-the severity level, $N$ is the total number of corruption types considered in our benchmark, and $M_{clean}$ is performance on the "clean" nuScenes dataset. *Relative Resistance Ability* ( $RRA_{c}$ ) compares the relative robustness of each model for a specific type of corruption with a baseline model. If the value is greater than zero, it indicates that the model demonstrates superior robustness compared to the baseline model. If the value is less than zero, it suggests that the model is less robust than the baseline. We can summarize the relative resistance by computing *Mean Relative Resistance Ability* (mRRA), which measures the relative robustness of the candidate model compared to a baseline model for all types of corruptions -$$RRA_{c} = \frac{\sum\limits_{i=1}^{3} ({M}_{c, s})}{\sum\limits_{i=1}^{3} ({M}_{baseline, c, s})} - 1,$$ +$$RRA_{c} = \frac{\sum\limits_{i=1}^{3} (M_{c, s})}{\sum\limits_{i=1}^{3} (M_{baseline, c, s})} - 1,$$ $$mRRA = \frac{1}{N} \sum_{i=1}^{N} RRA_c.$$