AnythingLLM

Document Q&A

All-in-one private LLM and RAG desktop app for Mac, Windows, and Linux

AnythingLLM screenshot

About AnythingLLM

Introducing AnythingLLM, the ultimate all-in-one desktop application compatible with Mac, Windows, and Linux. With AnythingLLM, you can effortlessly download and execute any LLM while engaging in private chats about your documents. The LLM, embedding, and vector database are securely stored locally by default, allowing for seamless offline usage.

For those seeking access to more robust models, embedders, or vector databases, AnythingLLM offers connectivity to over 20 integrated providers to enhance your experience.

Equipped with Ollama integration, AnythingLLM includes a built-in RAG chatbot requiring no additional downloads for a hassle-free setup and complete privacy. Whether it's PDFs, mp3s, or text files - AnythingLLM supports it all!

Furthermore, AnythingLLM boasts a comprehensive developer API for custom integrations and various data source connectors like GitHub and YouTube.

As an MIT Licensed project, AnythingLLM is entirely open-source, allowing for seamless modifications to suit your needs.

For a multi-user environment, AnythingLLM offers a self-hosted Docker image supporting concurrent users. Discover the ultimate RAG-based chatbot solution with AnythingLLM - your one-stop destination for all your chatbot needs.

Companies Are Making AI Skills Mandatory

Performance reviews and hiring now depend on AI proficiency

Meta
Shopify
Microsoft
Duolingo
Klarna
Google
Opendoor
Thomson Reuters
Fiverr
Amazon

Track the Impact of Your AI Usage

Document your productivity gains and build your AI portfolio for performance reviews

Start Tracking Free