Civitai Data Manager

Civitai Data Manager

CLI tool to back up and organize Civitai SafeTensors model metadata

54stars
13forks
Last commit: 5mo ago
Repo age: 2y old

Civitai Data Manager is a lightweight Python command-line tool to locally archive, index, and browse metadata for models in SafeTensors format that originate from Civitai. It processes local model files, fetches corresponding metadata and previews from Civitai, and produces a portable HTML browser plus JSON backups for each model.

Key Features

  • Backup model metadata and SHA256 hashes extracted from SafeTensors files
  • Fetch Civitai model and model-version data and store as JSON per model
  • Optional preview image download and per-image JSON metadata generation
  • Generate an interactive static HTML browser (index and per-model pages) with search and grouping by model type
  • Incremental updates: only process models with newer Civitai timestamps
  • CLI-driven with configuration file support, rate-limiting delays, and processed-files tracking for selective updates

Use Cases

  • Archive and document local collections of Stable Diffusion models (.safetensors) with Civitai metadata
  • Create an offline, browsable catalog of models and previews for curation or sharing within a team
  • Maintain periodic backups of trigger words, tags, and model-version details to recover metadata for removed models

Limitations and Considerations

  • Only supports models in .safetensors format and relies on Civitai model/version endpoints for metadata
  • Not a graphical application; operation is CLI-based and intended for scripted or manual runs
  • Rate-limiting delays are conservative by default and can slow large batches; disabling them may risk API throttling
  • Output is file-based (JSON and static HTML); there is no built-in database backend or server component

Civitai Data Manager is suitable for users who need a simple, reproducible way to back up and browse Civitai model metadata locally. It prioritizes portability, simplicity, and compliance with the official Civitai API usage patterns.

Categories:

Tags:

Tech Stack:

Share:

Similar Services

rclone

rclone

Command-line sync and management tool for cloud and remote storage

55k
4.8k
Last commit: 2d ago

rclone is a CLI tool to sync, copy, mount, and serve files across cloud storage providers and standard protocols like S3, WebDAV, FTP, and SFTP.

Alternative to:
GoodSync
GoodSync
+8
restic

restic

Fast, secure, deduplicating backup tool for files and directories

31.8k
1.7k
Last commit: 1mo ago

Restic is a fast, efficient backup program with encryption, deduplication, snapshots, and multiple storage backends including local, SFTP, REST, and S3-compatible stores.

Alternative to:
Arq Backup
Arq Backup
+15
Duplicati

Duplicati

Encrypted, incremental backups to cloud and remote storage

14.1k
1k
Last commit: 1d ago

Open-source backup client for encrypted, compressed, incremental backups to cloud storage and remote servers via SFTP, WebDAV, and more.

Alternative to:
Duplicacy (Commercial)
Duplicacy (Commercial)
+15
BorgBackup

BorgBackup

Deduplicating backup tool with encryption and compression.

12.9k
811
Last commit: 3d ago

BorgBackup is a deduplicating backup program with authenticated encryption and compression for Unix-like systems.

Alternative to:
BorgBase
BorgBase
+14
Kopia

Kopia

Cross-platform snapshot-based backup tool with encryption and deduplication

12.3k
594
Last commit: 11d ago

Cross-platform backup and restore tool with snapshot-based incremental backups, client-side end-to-end encryption, compression, and deduplication via CLI and GUI.

Alternative to:
Duplicacy (Commercial)
Duplicacy (Commercial)
+15
Duplicacy

Duplicacy

Lock-free deduplicating backup tool with cloud and SFTP storage support

5.6k
349
Last commit: 8mo ago

Cross-platform backup tool with lock-free deduplication, encryption, snapshots, and pruning, supporting local disk, SFTP, and many cloud storage backends.

Alternative to:
Duplicacy (Commercial)
Duplicacy (Commercial)
+15