📄 Machine-readable metadata available
A beginner-friendly, privacy-first desktop application for running large language models locally on Windows. Run models like Mistral, LLaMA, DeepSeek, and others in GGUF format with zero setup required.
pip install ggufloaderggufloader
Discover how to supercharge your local AI workflows using the new floating addon system! No coding needed. Works offline.
Works on Windows, Linux, and macOS.
⚡ Click a link below to download the model file directly (no Hugging Face page in between).
| Phase | Timeline | Status | Key Milestones & Features |
|---|---|---|---|
| Phase 1: Core Foundation | ✅ Q3 2025 | 🚀 In Progress | - Zero-setup installer - Offline model loading (GGUF) - Intuitive GUI (PySide6) - Built-in tokenizer viewer - Basic file summarizer (TXT/PDF) |
| Phase 2: Addon Ecosystem | 🔄 Q3–Q4 2025 | 🧪 In Development | - Addon manager + sidebar UI (✅ started) - Addon popup architecture - Example addon templates - Addon activation/deactivation - Addon SDK for easy integration |
| Phase 3: Power User Features | Q4 2025 | 📋 Planned | - GPU acceleration (Auto/Manual) - Model browser + drag-and-run - Prompt builder with reusable templates - Dark/light theme toggle |
| Phase 4: AI Automation Toolkit | Q4 2025 – Q1 2026 | 🔬 Research | - RAG pipeline (Retrieval-Augmented Generation) - Multi-document summarization - Contract/book intelligence - Agent workflows (write → summarize → reply) |
| Phase 5: Cross-Platform & Sync | 2026 | 🎯 Vision | - macOS and Linux support - Auto-updating model index - Cross-device config sync - Voice command system (whisper.cpp integration) |
| Phase 6: Public Ecosystem | 2026+ | 🌐 Long-Term | - Addon marketplace - Addon rating and discovery - Developer CLI & SDK - Community themes, extensions, and templates |
Welcome to the GGUF Loader documentation! This guide will help you get started with GGUF Loader 2.0.0 and its powerful addon system.
- Installation Guide - How to install and set up GGUF Loader
- Quick Start Guide - Get up and running in minutes
- User Guide - Complete user manual
- Addon Development Guide - Create your own addons
- Addon API Reference - Complete API documentation
- Smart Floater Example - Learn from the built-in addon
- Configuration - Customize GGUF Loader settings
- Troubleshooting - Common issues and solutions
- Performance Optimization - Get the best performance
- Contributing Guide - How to contribute to the project
- Architecture Overview - Technical architecture details
- API Reference - Complete API documentation
The flagship feature of version 2.0.0 is the Smart Floating Assistant addon:
- Global Text Selection: Works across all applications
- AI-Powered Processing: Summarize and comment on any text
- Floating UI: Non-intrusive, always-accessible interface
- Privacy-First: All processing happens locally
Version 2.0.0 introduces a powerful addon system:
- Extensible Architecture: Easy to create and install addons
- Plugin API: Rich API for addon development
- Hot Loading: Load and unload addons without restarting
- Community Ecosystem: Share addons with the community
- Installation:
pip install ggufloader - Launch:
ggufloader(includes Smart Floating Assistant) - GitHub: https://github.com/gguf-loader/gguf-loader
- Issues: Report bugs and request features
- 📖 Check the User Guide for detailed instructions
- 🐛 Found a bug? Report it here
- 💬 Have questions? Join our discussions
- 📧 Contact us: support@ggufloader.com
Happy coding with GGUF Loader! 🎉
