FoC Optimization: Duplicate checking - Don't hash everything

DeleteOnClick, EncryptOnClick, FindOnClick, HashOnClick, PatchOnClick, ScrambleOnClick, UndeleteOnClick
fredradford
Enthusiastic
Enthusiastic
Posts: 19
Joined: Thu Apr 10, 2014 7:59 pm

FoC Optimization: Duplicate checking - Don't hash everything

Postby fredradford » Sat Apr 12, 2014 12:11 am

First requested in 2010.

Currently the program hashes all files, because it performs the hash before sorting them by size.
There is a zero percent chance that two files of different size are the same, and a zero percent chance that a file that doesn't haven any other files of the same size is a duplicate.

So hashing a huge file when it is the only one of that size is a waste of time.

Please only hash files that are of the same size.

I just searched for *.iso > 7GB and it took 16 hours to tell me there were no duplicates.

Dave Wilkins
2BrightSparks Staff
2BrightSparks Staff
Posts: 1879
Joined: Thu Jan 04, 2007 10:02 am

Re: FoC Optimization: Duplicate checking - Don't hash everyt

Postby Dave Wilkins » Mon Apr 14, 2014 8:42 am

Thanks for your feedback, which has been passed to the development department for consideration

User avatar
mickyj
2BrightSparks Staff
2BrightSparks Staff
Posts: 906
Joined: Mon Jan 05, 2004 6:51 pm

Re: FoC Optimization: Duplicate checking - Don't hash everyt

Postby mickyj » Tue Apr 15, 2014 7:15 am

Hi, this will be in the next release. If the Only show duplicate files option is enabled then it won't hash obviously unique files, i.e. files that have a unique size.


Return to “OnClick Utilities”



Who is online

Users browsing this forum: No registered users and 2 guests