finding duplicates

Plug-in and third party software discussion.
klarah
Posts: 5
Joined: Mon Aug 18, 2014 12:33 pm

finding duplicates

Postby klarah » Mon Aug 18, 2014 1:01 pm

maybe someone finds this useful:

I created a function for the explorer context menu "finding duplicates", which shows all duplicates of the appropriate file.

For this I created a batchfile "everything_this.bat" in the installation folder of Everything with the following text:

"%~dp0Everything.exe" -search "%~nx1" -filter "Everything"

... which passes the filename to everything.exe.

For creating the context menu entry (with icon) an entry in the registry is needed. The following reg-file did it for me.

Windows Registry Editor Version 5.00

[HKEY_CLASSES_ROOT\AllFilesystemObjects\Shell\find duplicates]
"icon"="C:\\_src\\_utilities\\context_menue\\Everything\\Everything.exe"

[HKEY_CLASSES_ROOT\AllFilesystemObjects\Shell\find duplicates\Command]
@="C:\\_src\\_utilities\\context_menue\\Everything\\everything_this.bat \"%L\""


Only the the paths to "Everything.exe" and to "everything_this.bat" may need to be adapted.

Enjoy.
Klaus

jg5050
Posts: 1
Joined: Mon Feb 02, 2015 6:25 am

Re: finding duplicates

Postby jg5050 » Mon Feb 02, 2015 6:27 am

thanks your the man!

westman
Posts: 1
Joined: Wed May 25, 2011 10:25 am

Re: finding duplicates

Postby westman » Sun Feb 22, 2015 6:39 pm

This is useful and worked great, thanks!
You just follow the manual install directions, right click a file and click on "find duplicates" from resulting right-click menu. Everything pops up w the filename in the search field, with search results already showing. Fast.

reddevil
Posts: 8
Joined: Sun Nov 14, 2010 4:31 pm

Re: finding duplicates

Postby reddevil » Mon Oct 05, 2015 8:52 pm

Thank You.

questorfla
Posts: 6
Joined: Sat Feb 28, 2015 5:11 am

Re: finding duplicates

Postby questorfla » Sun Jan 17, 2016 5:59 pm

I must be missing something and it is probably due to the way I have installed everything in Windows 10.
I am not sure if I need to create some additional directories or if i can simply modify the regedit to match what I have. Everything is installed under "c:\program files" with no additional subdirectories.
I was just now wishing there was a way to use everything to locate and remove duplicates in a manner other than what I am currently doing which is tedious at best.
Manually looking for groupings of the same name, checking to see if they are the same size and removing all but one of each group. I need to do this on multiple folders that each contain several hundred thousand files.
Any advice on the correct statements to enable this feature in everything would be appreciated.

therube
Posts: 1596
Joined: Thu Sep 03, 2009 6:48 pm

Re: finding duplicates

Postby therube » Mon Jan 18, 2016 2:53 pm

1.4 Beta has both dupe: & sizedupe: functions.
(In the Index, you need to index the file size & also enable Fast size sort.)

You can combine them, something like:

> dupe: sizedupe: c: file:

Or even add a size to it:

> dupe: sizedupe: c: file: size:>2MB


Note that that finds file name AND (I believe its an AND) file size duplications - anywhere, not necessarily limited to C:, & also that name AND size are the only qualifications for "duplication", as in files meeting that criteria may not be (byte-by-byte) "duplicates".


Otherwise, I've mentioned a couple duplicate file finding programs here, viewtopic.php?p=5398#p5398. Both AllDup & Duplicate Cleaner are excellent, IMO.

Dorf
Posts: 18
Joined: Mon Feb 25, 2013 6:46 am

Re: finding duplicates

Postby Dorf » Mon Jan 25, 2016 1:11 am

Have you ever seen a de-dupe program that can do this or can think of a way to do this easily?

1 Multiple paths of files to be considered masters.
2 Find duplicates(byte wise) of the masters across multiple paths and delete them, but dont de-dupe within the paths.

therube
Posts: 1596
Joined: Thu Sep 03, 2009 6:48 pm

Re: finding duplicates

Postby therube » Mon Jan 25, 2016 3:53 pm

CloseSpy has the concept of "pools".

AllDup has the concept of "Remove all groups where the files not exist at all source files".
(That is a mouthful. Better way of saying it would be appreciated.)

DuplicateCleaner has the concept of "Scan Against Self" (Y/N).
DuplicateCleaner, in an upcoming (time unknown) version will also have the concept of "protected" (or something like that I think it was).


If I'm understanding, I believe CloneSpy & Duplicate Cleaner may cover what you want.
If I'm understanding AllDup, what it does is to scan everything (all selected directories), & then that particular option would remove files from ... oh, its confusing? But in any case, its method, in this case, would be less efficient then the others.

Download, test safely, experiment & see if they work for you.


Return to “Development, plugins and third party software”