delete

Found a bug in "Everything"? report it here
Post Reply
therube
Posts: 4625
Joined: Thu Sep 03, 2009 6:48 pm

Re: Please increase Heap Size!!!

Post by therube »

> application memory usage to max. >2.8 ... 2.9 GB

Doesn't sound "normal" to me.
How about some information on your system including number & sizes of drives, number of files...
void
Developer
Posts: 15403
Joined: Fri Oct 16, 2009 11:31 pm

Re: Please increase Heap Size!!!

Post by void »

How many support disk size and number of files?
disk size is irrelevant.
Everything supports a maximum of 4 billion files.
This can be less depending on available memory.

Are you using Everything x64?

Please send a dump file if you can reproduce the crash.
void
Developer
Posts: 15403
Joined: Fri Oct 16, 2009 11:31 pm

Re: Please increase Heap Size!!!

Post by void »

Everything (x86) uses roughly 45MB of ram per 1 million files.
Everything (x64) uses roughly 90MB of ram per 1 million files.
This can vary depending on the size of the average filename.

Everything x86:
4 billion files = ~184,320MB
1 milion files = ~45MB
10 milion files = ~450MB
50 milion files = ~2,250MB

Everything x64:
4 billion files = ~368,640MB
1 milion files = ~90MB
10 milion files = ~900MB
50 milion files = ~4,500MB
Reproduce very easy:
1. Please search for all files on your hard disk
2. CTRL+A (select the entire list files)
3. CTRL+Shif+C
4. Paste the editor
Unable to reproduce here (with 2million files).
How many filenames are you trying to copy?
What editor are you pasting into?
Does Everything crash on the copy or the paste?
could you please send a dump file?
therube
Posts: 4625
Joined: Thu Sep 03, 2009 6:48 pm

Re: Please increase Heap Size!!!

Post by therube »

> Internet Explorer

How do you search for files with IE?
Reproduce very easy:
1. Please search for all files on your hard disk
2. CTRL+A (select the entire list files)
3. CTRL+Shif+C
4. Paste the editor
And just what are we looking to reproduce?

A not very efficient operation?

It is not an efficient operation.

> 3. CTRL+Shif+C

What does that do?
Is it different from CTRL+C (Copy)?

And so, the point?


~1.5 M items. Everything x86.
Everything was using ~255 MB, I did not wait for it to finish (the Ctrl+C).
UltraSearch was using ~1.1 GB, I did not wait for it to finish (the Ctrl+C).


In each case, Saving the list was far more efficient, less time consuming.
void
Developer
Posts: 15403
Joined: Fri Oct 16, 2009 11:31 pm

Re: Please increase Heap Size!!!

Post by void »

Do not use CRL +C/+V (Copy/Paste)
because it makes use of a very high physical memory and cause a crash Heap size 25M+ files files
Ah, copying to the clipboard is using way more memory than it needs to, I will fix this for the next update of Everything.
Please write to save all paths to a text file UTF-8?
Please try File -> Export

Change save as type to: Text Files (*.txt)
Filenames are exported as UTF-8.
because incorrect saves, Traditional Chinese, Japanese, Russian, Polish, unicode and special characters.
Copying to the clipboard should be using Unicode (UTF-16).
Exporting is always UTF-8.
void
Developer
Posts: 15403
Joined: Fri Oct 16, 2009 11:31 pm

Re: Please increase Heap Size!!!

Post by void »

Does the problem occur after forcing a rebuild from Tools -> Options -> Indexes -> Force Rebuild?
void
Developer
Posts: 15403
Joined: Fri Oct 16, 2009 11:31 pm

Re: Please increase Heap Size!!!

Post by void »

UTF-8

If possible, please send the first invalid character.
void
Developer
Posts: 15403
Joined: Fri Oct 16, 2009 11:31 pm

Re: Please increase Heap Size!!!

Post by void »

To fix the problem I would need to see the raw binary utf8 stream of the line with this error.
I may also need the filename on disk that has generated this bad utf8 sequence.

Could you please email me the line where this problem is occurring in binary to support@voidtools.com

To create a binary file of a line of text with EmEditor:
  • Open the exported Everything file with EmEditor.
  • When prompted that some charactors cannot be converted, please
  • Check Continue Opening as Current Encoding
  • Check Jump to the first invalid character.
  • Click OK.
  • The cursor the line is on is the line we are interested in.
  • Delete all the lines above and below this one, so you are left with only the one line where the error occurred.
  • From the File menu, click Save as...
  • Select Encoding as Binary (Hexadecimal View)
  • Choose a filename and please send the saved file to support@voidtools.com
  • If possible, please email the filename of the closest matching filename that appears in explorer.
Post Reply