Open Source AI
The moment you send a prompt to a hosted assistant, the question and whatever context you pasted with it - code, contracts, a half-finished idea - become someone else's log, retained on terms you don't set and a model you can't pin to a version. The open source options here run the model on hardware you own and wrap it in a chat interface you host, so the conversation stays on your machine, the weights don't change under you overnight, and nothing you type leaves the boundary you control.
Ollama
Run open LLMs locally with a simple CLI, REST API, and model library
Dify
Open-source LLM app development platform for workflows, RAG pipelines, and agent apps
Open WebUI
Self-hosted AI platform for running local and API-backed models offline
Firecrawl
API that scrapes live sites into clean Markdown for AI agents
PaddleOCR
OCR toolkit for turning PDFs and images into structured, LLM-ready JSON and Markdown
LobeChat
Self-hosted AI agent workspace for organizing, scheduling, and reporting on agents 24-7
GPT4All
Private local AI chatbot for desktops and laptops, with no API calls or GPUs required
MinerU
High-accuracy document parsing for PDFs, Office files, images, and web pages into Markdown or JSON
AnythingLLM
Local-first AI app for chatting with documents, agents, and multi-user workspaces