Web-based SEO crawler for website auditing, link analysis, and export without subscription fees
- Stars706
- Forks143
- Open Issues18
MIT
- Python
- JavaScript
- HTML
About LibreCrawl
LibreCrawl is a web-based crawler for SEO analysis and website auditing. It crawls sites and shows details about pages, links, SEO elements, and performance, with a modern interface for multiple concurrent users.
It supports isolated sessions for multiple users, custom CSS styling, browser localStorage persistence, JavaScript rendering for dynamic content, SEO issue detection, and real-time crawling progress. It also includes PageSpeed Insights integration and export to CSV, JSON, or XML.
LibreCrawl is built with Python Flask and offers Standard Mode and Local Mode for personal use or single-user self-hosting. It is free and open source, with a website, API documentation, and a Docker Compose startup path.
Key features
- Multi-tenant crawling with isolated browser sessions
- JavaScript rendering for dynamic content
- SEO issue detection and PageSpeed Insights integration
- Export results as CSV, JSON, or XML
- Custom CSS themes and per-browser settings
Details
- On GitHub since
- 2025
- Platforms
- Web · Docker
- Language
- Python · Flask
- Storage
- Browser localStorage
- Modes
- Standard Mode · Local Mode
- Output
- CSV · JSON · XML