#1
Diskover
Diskover indexes file systems with Elasticsearch to provide fast file search, metadata analytics, and storage visibility across on-prem, NAS, and cloud storage.
Diskover is a data management and analytics platform for unstructured file data that crawls storage, enriches file metadata, and indexes it for fast search and reporting. It is designed to help teams understand what they have, where it lives, and how storage is being used.
Key Features
- Crawls and indexes heterogeneous storage (local file systems, NFS/SMB shares, and other supported sources)
- Elasticsearch-backed indexing for fast file search and filtering
- Storage usage analytics to identify cold data, growth trends, and large consumers
- Duplicate file discovery and wasted-space analysis
- Extensible metadata enrichment via plugins
- Web UI for search, reporting, and operational visibility
Use Cases
- Storage capacity planning and cost optimization by finding cold/unused or duplicate data
- Rapid file discovery and investigation across large shares and mixed storage
- Data hygiene initiatives such as organizing, tagging, and preparing curated datasets for analytics
Limitations and Considerations
- Requires running and maintaining an Elasticsearch cluster for indexing and search
- Crawling very large environments may require tuning and scheduling to manage resource usage
Diskover fits organizations and advanced homelabs that need centralized visibility into file data sprawl and want searchable metadata at scale. It pairs a crawler/indexer with a web interface to turn unstructured storage into actionable insights for cleanup, governance, and operations.
1.7kstars
180forks