Sensory Visual System for Cuayollotl Cognitive Architecture

This is the implementation of the Sensory Visual System. The article that describes this system can be found in:

Computational framework of the visual sensory system based on neuroscientific evidence of the ventral pathway

Also, you can go to the Wiki to see the documentation.

Installation and running of the project

Requeriments

• Windows

• Java

• Java SDK: The system needs to be run from the environment

• NetBeans: Version 13 is recommended (It also can run on IntelliJ)

• OpenCV: The system uses a dll; the file is "opencv_java455.dll"

• opencv-455.jar

• kmiddle.jar: Middleware jar library.

• JMathIO : Required by JMathPlot

• JMathPlot : Needed for visualizing some 2D and 3D plot

The following libraries and the DLL can be found ➡️ HERE ⬅️

Installation

First, it is necessary to go to the GitHub site, clone the project or download it. The address at which the project is located is as follows:

https://github.com/LuisHumanoide/MiddlewareVision

After that, is recommended to open the project in the NetBeans environment. NetBeans can be found at:

https://netbeans.apache.org/download/index.html

Once loaded into NetBeans, the project should run smoothly.

Running the project on NetBeans

Once the project is downloaded in Netbeans, if the requirements are met, the system can be run.

The GUI of the system is the following:

• Original image visualizer: Displays the original image in a square resolution; the image in this version is resized to this aspect ratio since operations need the arrays to have this relationship. It will then be modified to adopt any aspect ratio.

Monocular or binocular images can be displayed.

• Animation controls: They allow you to control if the sequence is going to animate, which can go forward or backward, in addition to being able to move to the following image or the previous one. Also, the frame rate per time unit of time can be adjusted to go faster or slower.

• Tab panel: It shows several tabs; the first tab corresponds to the folder selector, the second to the controls to adjust brightness, contrast, and other values; Finally, the third corresponds to the additional tools that serve to create convolution filters and configure the system.

• Activation viewer: Displays the array of images corresponding to the activations generated by the visual system.

• Navigation buttons: They are used to navigate in the activation viewer since the arrangement of images can be extensive, and it is convenient to display all the images on one screen.

Running the project on IntelliJ IDEA

The project can be also run on IntelliJ, but it is necessary to do some additional settings. It is recommended to copy the project folder to another location.

• Open the project in IntelliJ and create a new project, only for entering the big window (Because this option is not available in the welcome dialog)

• Go to File > New > Project from existing sources

• Choose the project folder, and continue with "create a project from existing resources"

• There will be a small windows with the message Ant build scripts found press Add Ant build file

• Go to Run tab, go to Edit configuration ... and a window will be opened, add a new configuration that will be Ant target

• In target name search the option run and accept.

• Go to Project Structure and choose a SDK

• Finally the project can run, go to the menu Run and choose the first option or Shift+F10