rag-bot

RAG Bot — Private AI on Your Device
Have natural conversations with locally-running large language models. Your chats stay on your device with full conversation history and search.

Your Documents, AI-Powered
Upload PDFs or DOCX files. RAG Bot generates embeddings so you can chat with your documents using retrieval-augmented generation. Visualize your document embeddings in an interactive 3D atlas.

Choose Your Model
Browse and download from three AI providers (Cactus, ExecuTorch, llama.rn). Filter by type (LLM or embedding), size, capabilities like vision and tool calling — find the right model for your hardware.

Built for Performance
Real-time device monitoring shows memory and storage usage so you always know what your device can handle. Optimized for Apple Silicon with multiple inference backends.

Key Features

100% offline — no internet required after model download
Multiple model providers and quantization options
Document RAG with PDF, DOCX support
Conversation history with full search
Vision and tool-calling capable models
Real-time device resource monitoring
3D embedding visualization