A minimal CLI tool to locally summarize any text using LLM!

Run gguf LLM models in Latest Version TextGen-webui

This started out as a POC for chatting over my documents, but has turned into a whole framework for using LLMs.

Tiny Starcoder LLM Implementation, added to commands

This repository contains a Python-based tool for summarizing web content using the Ollama API. It scrapes articles from URLs, cleans and processes the HTML content, and generates summaries using a pre-trained language model. The repository also includes a rich-based logging utility for improved console output.

Unofficial entropix impl for Gemma2 and Llama and Qwen2 and Mistral

Alacritty + Fish + Zellij + Starship + Neovim + i3 + Supermaven + Ollama 🦙 = 🚀

This project is a multi-agent security framework that utilizes multiple LLM models to analyze and generate comprehensive security briefs.

Local, customizable, open-sourced role-play app.

Local AI Open Orca For Dummies is a user-friendly guide to running Large Language Models locally. Simplify your AI journey with easy-to-follow instructions and minimal setup. Perfect for developers tired of complex processes!

A german workshop where you learn how to build RAGs with Langchain

ScrAIbe Assistant is designed to leverage Whisper for precise audio processing and local LLMs via Ollama for efficient summarization. This tool is perfect for tasks such as taking notes from team meetings or lectures, offering a secure environment where no data—be it text, audio, or otherwise—leaves your local machine.

A library that manages tools (functions) for Local LLMs

A clone of InfiniteCraft (AI!!! LLMs!!) you can run on a laptop _without_ a good GPU!!

This projects build a local retrieval augmented generation (pipeline) from scratch, connects it to a local llm, and is deployed as a chatbot via Gradio.

A local chatbot for managing docs

BgGPT for Jan 👋

Chat with your pdf using your local LLM, OLLAMA client.

Slack bot that integrates local LLM into your workflows

This is a basic workflow with CrewAI agents working with sales transactions to draw business insights and marketing recommendations. The agents will work on everything from the execution plan to the business insights report. It works with local LLM via Ollama (I'm using llama3:8B but you can easily change it).