[Discuss] fdupes opposite?

Lionel Widdifield lwiddif-vlug at nexus.spydernet.com
Sat Mar 15 09:06:49 PDT 2008


On Fri, Mar 14, 2008 at 04:21:17PM -0700, Patrick wrote:
> On Fri, 14 Mar 2008 14:34:07 -0700
> Lionel Widdifield wrote:
> 
> > 
> > md5sum `find . -type f` | sort | uniq --check-chars=32 --all-repeated=separate
> > 
> > md5sum `find . -type f` | sort | uniq --check-chars=32 --unique
> 
> Oooh, new toy!  :-)
> 
> Thanks, I hadn't messed with uniq, but that looks a lot cleaner
> [and probably a *lot* faster].  Please forgive my ignorance.


 Found a case where it blows up. Find -exec will eliminate the need for 2G
of RAM to hold the md5sum commandline. Now to set the ulimit for RAM
uasage to a reasonable level. ;)


# md5sum `find "$P"  -type f ` > $T
 find "$P" -type f -exec md5sum "{}" + > $T

 Then again the program is worth every penny it cost.

-- 
   Lionel Widdifield                  [] Spydernet Resources
                                      [] P.O. Box 5412
   lwiddif-sig at spydernet.com          [] Victoria BC, Canada  V8R 6S4  


More information about the Discuss mailing list