CVAT mask download is not working

[bilalcodehub]

Hi,

CVAT version 2.22.1.

Projects/Tasks are created by MONAILabel server. The code to download labels from CVAT after annotation is given below:

def download_from_cvat(self, max_retry_count=5, retry_wait_time=10):
        status = self.task_status()
        if status != "completed":
            logger.info(f"No Tasks with completed status (current: {status}) to refresh/download the final labels")
            return None

        project_id = self.get_cvat_project_id(create=False)
        task_id, task_name = self.get_cvat_task_id(project_id, create=False)
        logger.info(f"Preparing to download/update final labels from: {project_id} => {task_id} => {task_name}")

        download_url = f"{self.api_url}/api/tasks/{task_id}/annotations?action=download&format=Segmentation+mask+1.1"
        tmp_folder = tempfile.TemporaryDirectory().name
        os.makedirs(tmp_folder, exist_ok=True)

        tmp_zip = tempfile.NamedTemporaryFile(suffix=".zip").name
        retry_count = 0
        for retry in range(max_retry_count):
            try:
                r = requests.get(download_url, allow_redirects=True, auth=self.auth)
                time.sleep(retry_wait_time)

                with open(tmp_zip, "wb") as fp:
                    fp.write(r.content)
                shutil.unpack_archive(tmp_zip, tmp_folder)

                segmentations_dir = os.path.join(tmp_folder, "SegmentationClass")
                final_labels = self._datastore.label_path(DefaultLabelTag.FINAL)
                for f in os.listdir(segmentations_dir):
                    label = os.path.join(segmentations_dir, f)
                    if os.path.isfile(label) and label.endswith(".png"):
                        os.makedirs(final_labels, exist_ok=True)

                        dest = os.path.join(final_labels, f)
                        if self.normalize_label:
                            img = np.array(Image.open(label))
                            mask = np.zeros_like(img)

                            labelmap = self._load_labelmap_txt(os.path.join(tmp_folder, "labelmap.txt"))
                            for name, color in labelmap.items():
                                if name in self.label_map:
                                    idx = self.label_map.get(name)
                                    mask[np.all(img == color, axis=-1)] = idx
                            Image.fromarray(mask[:, :, 0]).save(dest)  # single channel
                            logger.info(f"Copy Final Label: {label} to {dest}; unique: {np.unique(mask)}")
                        else:
                            Image.open(label).save(dest)
                            logger.info(f"Copy Final Label: {label} to {dest}")

                # Rename after consuming/downloading the labels
                patch_url = f"{self.api_url}/api/tasks/{task_id}"
                body = {"name": f"{self.done_prefix}_{task_name}"}
                requests.patch(patch_url, allow_redirects=True, auth=self.auth, json=body)
                return task_name
            except Exception as e:
                if retry_count:
                    logger.exception(e)
                logger.error(f"{retry} => Failed to download...")
            retry_count = retry_count + 1
        return None

I am getting following error at MONAILabel while downloading masks:

[2024-12-05 19:16:03,247] [1330] [MainThread] [INFO] (main:199) - +++ Adding Trainer:: tooltracking => <lib.trainers.tooltracking.ToolTracking object at 0x793bd0660040>
[2024-12-05 19:16:03,247] [1330] [MainThread] [INFO] (main:217) - +++ Adding Strategy:: tooltracking_epistemic => <monailabel.tasks.activelearning.epistemic.Epistemic object at 0x793bd068d030>
[2024-12-05 19:16:03,247] [1330] [MainThread] [INFO] (main:220) - Active Learning Strategies:: ['random', 'tooltracking_epistemic']
[2024-12-05 19:16:03,357] [1330] [MainThread] [INFO] (monailabel.tasks.infer.bundle:142) - Model: endoscopic_tool_segmentation; Type: segmentation; Label: background => 0
[2024-12-05 19:16:03,357] [1330] [MainThread] [INFO] (monailabel.tasks.infer.bundle:142) - Model: endoscopic_tool_segmentation; Type: segmentation; Label: tools => 1
[2024-12-05 19:16:03,364] [1330] [MainThread] [INFO] (main:234) - +++ Adding Scoring Method:: tooltracking_epistemic => <lib.scoring.cvat.CVATEpistemicScoring object at 0x793bd068cfd0>
[2024-12-05 19:16:03,364] [1330] [MainThread] [INFO] (main:237) - Active Learning Scoring Methods:: ['tooltracking_epistemic']
[2024-12-05 19:16:03,364] [1330] [MainThread] [INFO] (monailabel.utils.sessions:51) - Session Path: /root/.cache/monailabel/sessions
[2024-12-05 19:16:03,364] [1330] [MainThread] [INFO] (monailabel.utils.sessions:52) - Session Expiry (max): 3600
[2024-12-05 19:16:03,364] [1330] [MainThread] [INFO] (monailabel.tasks.scoring.epistemic_v2:103) - Starting Epistemic Uncertainty scoring
[2024-12-05 19:16:03,364] [1330] [MainThread] [INFO] (monailabel.tasks.scoring.epistemic_v2:118) - EPISTEMIC:: Total unlabeled images: 384; max_samples: 0
[2024-12-05 19:16:03,377] [1330] [MainThread] [INFO] (monailabel.tasks.scoring.epistemic_v2:162) - EPISTEMIC:: {'total': 384, 'skipped': 384, 'executed': 0, 'latency': 0.013}
[2024-12-05 19:16:05,931] [1330] [MainThread] [INFO] (lib.scoring.cvat:63) - Existing Task Status: completed; Scoring/Result: {'total': 384, 'skipped': 384, 'executed': 0, 'latency': 0.013}
[2024-12-05 19:16:05,932] [1330] [MainThread] [INFO] (lib.scoring.cvat:76) - Latest Active Learning Task in CVAT is under progress/not-consumed. Skip to create new!
[2024-12-05 19:16:05,932] [1330] [MainThread] [INFO] (__main__:61) - Result: {"total": 384, "skipped": 384, "executed": 0, "latency": 0.013}
[2024-12-05 19:16:06,620] [1190] [ThreadPoolExecutor-0_0] [INFO] (monailabel.utils.async_tasks.utils:83) - Return code: 0
[2024-12-05 19:17:04,063] [1190] [Thread-5] [INFO] (monailabel.datastore.cvat:190) - Preparing to download/update final labels from: 3 => 3 => ActiveLearning_Iteration_1
[2024-12-05 19:17:14,409] [1190] [Thread-5] [ERROR] (monailabel.datastore.cvat:238) - 0 => Failed to download...
[2024-12-05 19:17:24,758] [1190] [Thread-5] [ERROR] (monailabel.datastore.cvat:237) - /tmp/tmpqbjfyeyo.zip is not a zip file
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/dist-packages/monailabel/datastore/cvat.py", line 205, in download_from_cvat
    shutil.unpack_archive(tmp_zip, tmp_folder)
  File "/usr/lib/python3.10/shutil.py", line 1314, in unpack_archive
    func(filename, extract_dir, **kwargs)
  File "/usr/lib/python3.10/shutil.py", line 1201, in _unpack_zipfile
    raise ReadError("%s is not a zip file" % filename)
shutil.ReadError: /tmp/tmpqbjfyeyo.zip is not a zip file
[2024-12-05 19:17:24,760] [1190] [Thread-5] [ERROR] (monailabel.datastore.cvat:238) - 1 => Failed to download...
[2024-12-05 19:17:35,103] [1190] [Thread-5] [ERROR] (monailabel.datastore.cvat:237) - /tmp/tmpqbjfyeyo.zip is not a zip file
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/dist-packages/monailabel/datastore/cvat.py", line 205, in download_from_cvat
    shutil.unpack_archive(tmp_zip, tmp_folder)
  File "/usr/lib/python3.10/shutil.py", line 1314, in unpack_archive
    func(filename, extract_dir, **kwargs)
  File "/usr/lib/python3.10/shutil.py", line 1201, in _unpack_zipfile
    raise ReadError("%s is not a zip file" % filename)
shutil.ReadError: /tmp/tmpqbjfyeyo.zip is not a zip file
[2024-12-05 19:17:35,104] [1190] [Thread-5] [ERROR] (monailabel.datastore.cvat:238) - 2 => Failed to download...

Any suggestion what might be wrong at the CVAT end that mask downloading function fails?