💻 MonikA.I. submod

This project aims to add new AI based features to Monika After Story mod with the submod API. It's using multiple AI models:

• Pygmalion conversational AI based on GPT-J Finetuning
• RWKV Language Model with it's RNN approach
• TTS Coqui-AI and Tortoise-TTS for Text to Speech
• OpenAI Whisper with microphone option for Speech to Text
• Character AI if you don't have a GPU
• Emotion detection from text model is also used linked with the chatbot
• Emotion detection with the webcam with a model from HSEmotion
• NLI Classification with deberta

Disclaimer: This project adds features (chatbots) that can be imprevisible and may not be in total accordance with the usual way Monika is supposed to speak. The goal is to have fun free interactions when running out of topics for example. There are also a lot of libraries and models involved so it can make the game slower when using them.

Check the discord server if you have some questions or if you want to be up to date with new fixes and releases !

Installation

✳️ User version installation (Windows)

This version includes conversing with chatbots or full voicing of the game, the two modes might not be compatible so it is preferable to use them separetely.

To install the user version with executables, I've made a tutorial HERE for versions equal or after 1.6.1 and here for versions equal or before 1.6.0.

🐧 Python version (Linux or MacOS)

Wiki page HERE

Using the Submod

🔥 Features

• Allow Monika to finally see you through the webcam and react to your emotions
• Speak without scripted text with Monika using the latest chatbots from Character AI or Pygmalion AI
• Hear Monika speak with a Text to Speech module using extracts of voiced dialogues
• Talk with your own voice with Monika thanks to Speech recognition
• Let Monika control actions in the game directly from your chat with her

🌟 Pygmalion chatbots

Be sure to follow the instructions here to use it.

⚠️ How to use after installing

After doing the installation, read the common information for usage on this page

How to contribute

If you want to contribute to the project, you can check out this page. It is not necessary to know how to code and you can add dialogs, expressions. Don't hesitate to propose new things if you have more experience !

Demonstrations

🎮 In Game

The features are available in a specific AI Talk menu in the game.

• Click on Let's chat together to use the Character AI Chatbot
• Click on Tell me about Pytorch if you think it is superior to Tensorflow

There is also the possibility of using buttons on the main screen to directly chat. These can be disabled in the Settings Submods if you don't like them.

🎦 Video Demonstration

demo_monikai.mp4

Common issues (to be updated)

• "failed wheels for building TTS": check if you have python 3.8 or 3.9, and not 3.10 or higher
• "playwright command not found": run python -m playwright install
• "Monika says that there is a bug somewhere": that means the website couldn't be accessed, check if you've done the playwright install and check on your browser if the website isn't down. You can set Use Debug Mode to Yes to see the connection with the graphic interface.