top | item 38871733

(no title)

rajatarya | 2 years ago

Can you share any dedupe results as you've been running this? How long does it take nightly?

discuss

order

LackOfGravitas|2 years ago

Currently, it takes probably 20-30 minutes to run, which does include all the data deduplication. It was a bit more for the first round, but still under an hour. On my home folder, which is about 1.2 TB and I think around 1.4 million files, the git repository itself is a few hundred MB and the local data store, on a zSTD compressed ZFS data pool on my True NAS server, is around 400 GB. The data deduplication pretty much just tracks with new content, so it works perfectly here for snapshots.