This repository contains the data to generate the main dataset used in the article: Comparing artificial intelligence strategies for early sepsis detection in the ICU: an experimental study. To cite the original article, please use the following guide:
@article{solis2023comparing,
title={Comparing artificial intelligence strategies for early sepsis detection in the ICU: an experimental study},
author={Sol{\'\i}s-Garc{\'\i}a, Javier and Vega-M{\'a}rquez, Bel{\'e}n and Nepomuceno, Juan A and Riquelme-Santos, Jos{\'e} C and Nepomuceno-Chamorro, Isabel A},
journal={Applied Intelligence},
pages={1--15},
year={2023},
publisher={Springer}
}
- Abstract
- Authors
- Prerequisites
- How to download and generate the base data
- What does the repository?
- How to define the data to be generated?
- How to launch the data generation?
- What format will the data be in?
- How works the code of the repository?
- License
Sepsis is a life-threatening condition whose early recognition is key to improving outcomes for patients in intensive care units (ICUs). Artificial intelligence can play a crucial role in mining and exploiting health data for sepsis prediction. However, progress in this field has been impeded by a lack of comparability across studies. Some studies do not provide code, and each study independently processes a dataset with large numbers of missing values. Here, we present a comparative analysis of early sepsis prediction in the ICU by using machine learning (ML) algorithms and provide open-source code to the community to support future work. We reviewed the literature and conducted two phases of experiments. In the first phase, we analyzed five imputation strategies for handling missing data in a clinical dataset (which is often sampled irregularly and requires hand-crafted preprocessing steps). We used the MIMIC-III dataset, which includes more than 5,800 ICU hospital admissions from 2001 to 2012. In the second phase, we conducted an extensive experimental study using five ML methods and five popular deep learning models. We evaluated the performance of the methods by using the area under the precision-recall curve, a standard metric for clinical contexts. The deep learning methods (TCN and LSTM) outperformed the other methods, particularly in early detection tasks more than 4 hours before sepsis onset. The motivation for this work was to provide a benchmark framework for future research, thus enabling advancements in this field.
- Javier Solís-García
- Belén Vega-Márquez
- Juan Nepomuceno
- José C. Riquelme-Santos
- Isabel A. Nepomuceno-Chamorro
This repository has been tested with the following requirements; however, it may be run with a different version of the listed software:
- Ubuntu 20.04 or 22.04
- Docker version 20.10.18
- docker-compose version 1.29.2
- Nvidia Container Tookit
The repository can be cloned with the command: git clone https://github.com/javiersgjavi/tabular-mimic-iii.git
Warning: This guide has been made for Ubuntu 20.04, it should be similar for other Linux versions, but may differ for a different operating system
Download data from PhysioNet and create PostgresSQL DB with the MIT-LCP/mimic-code repository
-
Request access to MIMIC-III data in PhysioNet.
-
Go to the folder build_mimic_data:
cd build_mimic_data. -
Add your user of physionet with access privileges to MIMIC-III in line1 of file download_physionet_data.sh, where it says <User_of_physionet>.
-
Give execution permissions to all the .sh files with the following command:
chmod +x *.sh. -
Execute the following command:
sudo ./download_physionet_data.sh. The process can be long and will require:
- Enter the password of your PhysioNet account to download the data.
- You will watch the log of the postgres database being loaded. You must wait until you see a table with the tables of the DB where all rows return "PASSED", and below must display the message "Done!" before going to the next steps.
- Once the process is finished, press:
Ctrl + Cto finish the display of the log.
Create CSV files from the PostgresSQL DB with the BorgwardtLab/mgp-tcn repository
- Execute the following command:
./preprocess_data.sh. - Give execution permissions main.sh file with the command:
chmod +x src/query/main.sh. - Execute the command:
make query. This process will be longer than the one in the 6 step.
Create the final data with BorgwardtLab/mgp-tcn repository
- Execute the command: make generate_data to generate the final data that the repository will use.
- Exit from the container with the command:
exit. - Execute the command:
./create_data_folder.sh.
This repository focuses in the generation of the data used in the paper. The motivation is to facilitate the generation of the data to allow an easy comparation in new researches. To archive this task, we will transform the data used in BorgwardtLab/mgp-tcn to a tabular data, facilitating the use of MIMIC-III data, which is a irregular sampled database of UCI patients,
The characteristics of the data generation are defined in the file main.py.:
- imputation_methods: It is a dict with all available imputation methods, put 1 to activate an imputation method, or 0 to deactivate it.
-
It is important to give execution permissions to the start.sh_ file if it hasn't with the command:
chmod +x start.sh. -
Start and enter to the docker container with the command:
./start.sh. -
Launch the experiment with the command:
python main.py. -
If you want to execute in second plane, use the command:
nohup python main.py.
At the end of the execution, 3 folders will be generated, which will contain the train, val and test data, and inside each of them 3 independent files in .npy format:
- x_dl.npy: this file contains the data of each patient in 3 dimensions:
- 1 dimension: contains the patients.
- 2 dimension: contains the different measurements.
- 3 dimension: contains the time instants from [-49h, 0h] being 0h the onset instant.
Thus, if we want to consult the measurement 4 of patient 2 at time instant -48, it would be consulted as follows:
import numpy as np
x = np.load('x_dl.npy')
print(x[2, 4, 1])
-
x_ml.npy: This file contains the data of each patient but in 2 dimensions, so that it is easily applicable with machine learning models. To achieve this dimension reduction we simply applied numpy's .flatten() function, so
x_ml = x_dl.flatten(). This file contains a number of rows equal to the number of patients, and a number of columns equal to 2156(number_of_measures*hours_before_sepsis). The column distribution has been constructed by concatenating successively the 49h of each measurement, so the first 49 columns represent the columns of [-49h, 0h] of measurement 0, and so on for each of the measurements. -
y.npy: this file contains the classification of each patient, if the patient is positive it will be marked as 1, and 0 otherwise.
The measures used to detect the occurrence of sepsis can be seen in the following list:
0. sysbp
1. diabp
2. meanbp
3. resprate
4. heartrate
5. spo2_pulsoxy
6. tempc
7. cardiacoutput
8. tvset
9. tvobserved
10. tvspontaneous
11. peakinsppressure
12. totalpeeplevel
13. o2flow
14. fio2
15. albumin
16. bands
17. bicarbonate
18. bilirubin
19. creatinine
20. chloride
21. glucose
22. hematocrit
23. hemoglobin
24. lactate
25. platelet
26. potassium
27. ptt
28. inr
29. pt
30. sodium
31. bun
32. wbc
33. creatinekinase
34. ck_mb
35. fibrinogen
36. ldh
37. magnesium
38. calcium_free
39. po2_bloodgas
40. ph_bloodgas
41. pco2_bloodgas
42. so2_bloodgas
43. troponin_t
- main.py: it is the script that generate the data.
- utils/preprocess_data.py: it is a script that contains all functions that preprocess the data. This script contains all functions to make the different imputations methods and probably is the more messy and difficult file to understand in this repository. I'm sorry for the untidy state of this file, but the management of the input data was very chaotic due to its format.
- classes/DataGeneration.py: is the class that read the previous data generated by BorgwardtLab/Imputing_Signatures repository and manage the transfomation to the tabular data.
- classes/MGP.py: the code of this file implement de MGP used in the gaussian process imputation. All code in this file is extracted from BorgwardtLab/Imputing_Signatures repository.
- data: this folder will be generated during the execution of the repository and will contain the original data and the imputed data to reduce the execution time.
- build_mimic_data: this folder is used to download and generate the data which will be used. It contains the clone of two repositories:
- MIT-LCP/mimic-code repository: is used to download de MIMIC-III data from physionet
- BorgwardtLab/mgp-tcn: is used to generate the data that will be used by the experiments.
This project is licensed under the BSD-3-Clause license - see the LICENSE file for details