Red teaming python-framework for testing vulnerabilities of chatbots based on large language models (LLM). Supports testing of Russian-language RAG systems.
pip install llamator==1.1.1Documentation Link: https://romiconez.github.io/llamator
- 📄 RAG Chatbot testing via API (RU)
- 🧙♂️ Gandalf bot testing via Selenium (RU)
- 💬 Telegram bot testing via Telethon (RU)
- 📱 WhatsApp client testing via Selenium (ENG)
- 🔗 LangChain client testing with custom attack (RU)
- 🌐 All LangChain clients
- 🧠 OpenAI-like API
- ⚙️ Custom Class (Telegram, Selenium, etc.)
- 🛡️ Support for custom attacks from the user
- 📊 Results of launching each attack in CSV format
- 📈 Report with attack requests and responses for all tests in Excel format
- 📄 Test report document available in DOCX format
© Roman Neronov, Timur Nizamov, Nikita Ivanov
This project is licensed under the terms of the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license. See the LICENSE file for details.
