OfflineAI is an artificial intelligence that operates offline and uses machine learning to perform various tasks based on the code provided.
For people without technical experience you can buy the compiled,complete,more advanced, offline standalone GUI application for windows from here:
https://www.buymeacoffee.com/CorvusCodex/e/155047?from_page=extras
- Uses advanced machine learning techniques to generate responses
- Operates offline for privacy and convenience
- Built using the powerful Phi-3-mini-4k-instruct.Q4_0 model trained by Microsoft
- llama_cpp
Please note that an internet connection is required for the first-time installation to download the necessary libraries and models ( Just for console version, on windows app you can use it fullly offline).
You can install these libraries using pip by running the following command:
'''pip install llama_cpp'''
Here are some details about the default model:
- Model Size: 2.03 GB
- RAM: 4 GB
- Model: Phi-3-mini-4k-instruct.Q4_0.gguf
- Type: Very Fast Response
- Trained by Microsoft
- Chat based model
- Parameters: 4 billion
- Quant: q4_0
- Type: Phi-3
- Licence: MIT
Once the libraries and models are installed, you can run OfflineAI locally on your machine without an internet connection, get Windows standalone for instant program.
To use OfflineAI, you will need to have a model file for Phi-3-mini-4k-instruct.
Download it from here: https://huggingface.co/microsoft/Phi-3-mini-4k-instruct-gguf/blob/main/Phi-3-mini-4k-instruct-q4.gguf
Then put it in same folder where script is.
Once you have the model files, you can run the Offlineai.py script to interact with the AI. The script will print the AI's responses to the console.
Please note that while OfflineAI uses advanced machine learning techniques to generate responses, there is no guarantee that its responses will be accurate or appropriate for all situations. Use OfflineAI responsibly and at your own risk.
Support my work:
BTC: bc1q7wth254atug2p4v9j3krk9kauc0ehys2u8tgg3
ETH & BNB: 0x68B6D33Ad1A3e0aFaDA60d6ADf8594601BE492F0
Buy me a coffee: https://www.buymeacoffee.com/CorvusCodex
If you believe in the potential of open-source AI and want to support its development, consider buying me some equipment. With your help, I can build more powerful in-house AI models that can be used to improve OfflineAI and other open-source projects.
Your support will go towards purchasing high-performance hardware such as GPUs, CPUs, and other necessary components that will allow me to train and test AI models more efficiently. This will ultimately lead to better and more accurate AI models that can benefit everyone.
Here's how you can support the development of open-source AI models:
- Buy me some equipment from my wishlist
- Support my work for a month or year by becoming a member on Buy Me a Coffee
- Make a one-time donation through Buy Me a Coffee
Thank you for your support! Together, we can push the boundaries of what's possible with open-source AI.
The code within this repository comes with no guarantee, the use of this code is your responsibility. I take NO responsibility and/or liability for how you choose to use any of the source code available here. By using any of the files available in this repository, you understand that you are AGREEING TO USE AT YOUR OWN RISK. Once again, ALL files available here are for EDUCATION and/or RESEARCH purposes ONLY.
OfflineAI is released under the MIT License. See the LICENSE file for more details.
Copyright (c) 2023 CorvusCodex
Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:
The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
