Comments on: Simple Linux BASH script to locate and delete duplicate photos http://mikebeach.org/2012/09/15/simple-linux-bash-script-to-locate-and-delete-duplicate-photos/ Wed, 19 Jun 2013 17:45:14 +0000 hourly 1 By: John http://mikebeach.org/2012/09/15/simple-linux-bash-script-to-locate-and-delete-duplicate-photos/#comment-704 John Sun, 16 Sep 2012 14:03:04 +0000 http://mikebeach.org/?p=5173#comment-704 Interesting, I always enjoy looking at the different ways to attack a problem. I tend to do things more via command line w/ pipes – simply because I hardly ever remember the correct bash syntax.

A different approach (incomplete):

find . -type f -name “*” -exec md5sum {} ; | sort | uniq -d -w 32

This produces a two column output of the hash and filename of one of the duplicates. I assumed “-d” would give me multiple duplicate hits – but it appears to only output one of the dups if there are three or more matches for a single file.

I’d be interested in which file was deleted – possibly relying on the file metadata to determine which one was the original (by date) if applicable. But that would add some more complexity. Your approach seems simple and straightforward to me.

NOTE: Initially I thought rsync would have a feature to prune duplicates, but I couldn’t find one.

]]>