ConversationalInterface

Conversational Interface

NOTE: Not in Master-Branch yet.

The upcoming conversational interfaces will allow you to call some functions of SEE or ask for information about the visualized cities.

Before using it, you need to setup some components.

Rasa

First of all you need to download/install Rasa OpenSource. The easiest way is to run pip install rasa. After that you can open the full rasa-project you were provided with in e.g. PyCharm (At the moment only provided with the bachelor thesis of Sarah Augustinowski and a limited amount of functions, later on with open access over this repository with a higher functionality).

To start rasa you need two terminals in PyCharm, in one you run rasa shell in the other one rasa run actions. Rasa should be fully running now.

Neo4j

To get access to data of the city you need to create a database in neo4j. For that download neo4j desktop. Create a database thats fit the credentials in the code, or change them in the code to your database.

Usage in SEE

First of all you should load and draw a Code City. After that press F3 * to load this to your neo4j-database. That needs quit some time.

While pressing . the conversational interface is listening, after releasing the key, whisper transcribe your spoken words into text and this will be send to rasa.

The personal assistent will present you the answer.

NOTE: At the moment Rasa is only trained on a code city of SEE, this will be adapted later.

*= Will be changed in the future. Same key is used to toggle facecam position...