imPROSE (integrated methods for prediction of super-enhancers) is a computational workflow to predict super-enhancers or constituents of super-enhancers from a list of candidate enhancers. It comes with options to asses the predictive potential of individual and combinatorial fetures. This pipeline integrates diverse types of data including DNase I hypersensitivity (DNaseI), histone modifications (HMs), cofactors, transcription factors (TFs) and DNA sequence.
It comes with six state-of-the-art parametric and non-parametric machine learning models including Random Forest (RF), Support Vector Machines (SVM), K-Nearest Neighbor (kNN), AdaBoost (AB), Decision Tree (DT) and Naive Bayes (NB).
Random Forest is our optimal and default model but user can select any of the models and further test it using cross-validation, independent test data or use it to make predictions.
imPROSE requires:
* Python (>= 2.6 or >= 3.3)
* NumPy (>= 1.6.1): http://www.numpy.org/
* SciPy (>= 0.9): http://www.scipy.org/
* Scikit-learn (>= 0.17): http://scikit-learn.org/
* Pandas (>= 0.16.0): http://pandas.pydata.org/
If you already have a working installation of numpy and scipy, the easiest way to install scikit-learn and pandas is using pip::
pip install -U scikit-learn
pip install -U pandas
or using conda::
conda install scikit-learn
conda install pandas
If you don’t already have a python installation with numpy, scipy and pandas, we recommend to install either via your package manager or via a python bundles (Canopy, Anaconda). These come with numpy, scipy, scikit-learn, pandas and many other helpful scientific and data processing libraries and available for platforms including Windows, Mac OSX and Linux.
You can install imPROSE either from PyPi using pip and install it from the source. Please make sure you have already installed the above mentioned python libraries required to run imPROSE.
Install from PyPi::
pip install improse
Install from the source::
tar -zxvf improse-1.0.tar.gz
cd improse-1.0
python setup.py install
Once you have installed imPROSE, you can type:
improse --help
to find the available commands and required parameters to run imPROSE.
To run a demo using Random Forest model and validate it using 10-fold cross-validation, you can type::
improse --demo
This will save the results in the current working directory with a folder named Improse_results. If you wish to save the results in a specific folder, you can type::
improse --demo --output ~/path/to/your/folder
imPROSE comes with six state-of-the-art machine learning models including Random Forest (RF), Support Vector Machines (SVM), K-Nearest Neighbor (kNN), AdaBoost (AB), Decision Tree (DT) and Naive Bayes (NB). Random Forest is the default model.
To select model you need to type::
improse --model MODEL_NAME
MODEL_NAME can be rf, svm, knn, ab, dt, nb or use all if you want use all models one by one.
To tell the model to use specific features you need to type::
improse --model svm --feature H3K27ac,Brd4,p300,GC_Content
Make sure the features names are comma separated.
If you want to compare the individual predictive power or combinatorial predictive power of different features, you need to pass the argument --compare with --features::
improse --model svm --feature H3K27ac,Brd4,p300,GC_content --compare
To check the combinatorial predictive power of features, you need to combine features with + symbol::
improse --model svm --feature H3K27ac+Brd4,p300,GC_content+AT_content --compare
Here model will test the combinatorial predictive power [H3K27ac,Brd4] and [GC_content,AT_content] along with p300.
By default all models use 10-fold cross-validation. If you want to set different fold lets say 5, set --cv parameter as::
improse --model rf --feature H3K27ac,Brd4,p300,GC_Content,AT_Content,phastCons --cv 5
To run the model with a test data you need the feature data saved a CSV file. Next, you need to tell the model, features you have to make prediction with using --feature and also provide the CSV file to '--input' and next type --test to tell model it is test datasets::
improse --model rf --feature H3K27ac,Brd4,p300,pGC,pAT,phastCons --input ~/path/to/CSV/file.csv --test
This will generate an ROC plot and save the performance evaluations [precision, recall, f1-score, AUC, PRC] to Improse_tesults.txt.
To make predictions should have computed available features and saved a CSV file. Next, you need to tell the model the features you have to make prediction with using --feature and also provide the CSV file to --input and next type --pred to make predictions::
improse --model rf --feature H3K27ac,Brd4,p300,pGC,pAT,phastCons --input ~/path/to/CSV/file.csv --pred
This will save the predictions results as CSV file Improse_[MODEL_NAME]_predictions.csv. In the CSV file the field Class is 1=SE and 0=TE. We also report probability score for each prediction to tell the user how good and bad a prediction is. This will help to decide which candidates to select for further analysis.
If you have questions, or found any bug in the program, please write to us at aziz.khan[at]ncmm.uio.no