Skip to content

BMS360, GBVS360

Compare
Choose a tag to compare
@plebreton plebreton released this 26 Sep 03:16
· 28 commits to master since this release

This version contains improvements over the model submitted at the ICME Grand Challenge. The new model called BMS360 have been introduced and is suggested as the new model to be used for Head motion-based saliency and Head/Eye motion-based saliency.

The former models can still be accessed through the options. Please refer to the option --help to obtain more information.

Usage

The following shows example of usage of the tool to perform the saliency prediction.

BMS360 + Equatorial prior : HEAD Saliency model

The Head saliency model submitted at ICME2018 was using BMS360 (with tuned parameters for omnidirectional images) and the "adaptive equatorial prior". The usage is as follow:

salient.exe -i P10.jpg --general-model 1 -o head_saliency.jpg

BMS360 without the equatorial prior : HEAD+Eye Saliency model

The Head+Eye saliency model in this build is using the BMS360 model without the equatorial prior. This model was NOT submitted to ICME2018 as other model are better suited for the Head+Eye saliency prediction. More details can be found here:

@article{lebreton2018GBVS360, title={GBVS360, BMS360, ProSal: Extending existing saliency prediction models from 2D to omnidirectional images}, author={Lebreton, Pierre and Raake, Alexander}, journal={Signal Processing: Image Communication}, volume={69}, pages={69--78}, year={2018}, publisher={Elsevier} }

Nevertheless, to get the result for the BMS360 model without equatorial prior, please run:

salient.exe -i P10.jpg --general-model 2 -o head_eye_saliency.jpg

Legacy model:

This program also contains the model submitted to the ICME2017 grand challenges and you can find the model "BMS+equatorial prior", and "GBVS360 with equatorial prior" using the following command (please note the use of the option --legacy-icme-2017):

BMS + Equatorial prior

The Head saliency model submitted at ICME2017 was using BMS model and the "adaptive equatorial prior". The usage is as follow:

salient.exe -i P10.jpg --general-model 1 -o saliency.jpg --legacy-icme-2017

GBVS360 + Equatorial prior

The Head+Eye saliency model submitted at ICME2017 was using GBVS360 model and the "adaptive equatorial prior". The usage is as follow:

salient.exe -i P10.jpg --general-model 2 -o saliency.jpg --legacy-icme-2017