<h1 id="main_header"><a href="/">#metaforcefeed</a></h1> "Bash disinformation campaign."</span> #metaforcefeed " nijotz | You just manage their addictions until they die" Login 1 Pings Submitted by jnerula Take a list of tarballs or other files that are presumed to be the same. Do a block level analysis of each file scanning for duplicate blocks. Build an index of them and replace each file with a reference to various pieces of said index. Or something. In conjunction with nijotz' logpurge.py you could have a pretty awesome little backup solution. Would be neat to maybe incorporate the two? Dunno. I take hourly snapshots of my VPS, and even using logpurge I'm still using a lot of space for no reason. Ideally my tarballs would be deduplicated only into what actually changed. A general list of things that are both open-source and do deduplication: tarsnap ob...