Ignore files option about greyhole HOT 10 CLOSED

Originally from http://code.google.com/p/greyhole/issues/detail?id=39

from greyhole.

Another use case for this feature: restoring files using CrashPlan writes all the files to .cprestoretmpXXX and then renames them when the write is finished. This creates a ton of extra work for greyhole that could be avoided by simply ignoring .cprestoretmp.

To that end, this feature should allow using a regex or shell glob as opposed to just a list of file names or paths.

from greyhole.

Suggested configuration for ignored files:

ignored_files = [0-9A-F]{8}.tmp
ignored_files = .cprestoretmp.*
ignored_files = Thumb.db
ignored_folders = _UNPACK_.*

To implement, Greyhole would ignore all writes, deletes, and renames that have a target that match any of the defined ignored files/folders options. Renames that have a source matching an ignored pattern would still be executed.
Ignored files would stay in the LZ, and thus could increase the size of the LZ for many users. Might want to include the size of the LZ in the output of --stats at some point.

from greyhole.

The configuration makes sense to me. Another way of handling the temporary file use case would be to implement some sort of a "cooldown period". When watching for changes, wait xxx minutes before taking any action. I haven't dug into the code yet, so I don't know if how feasible this is or where it would need to live. In order to have a positive performance impact, I think it would need to live early in the pipeline, probably in the vfs?

from greyhole.

Want to help me test the new feature?

Replace your /usr/bin/greyhole file with this version:
sudo curl -o /usr/bin/greyhole 'https://dl.dropboxusercontent.com/s/r0wav1c3ahxdt27/greyhole-0.9.34?token_hash=AAGyuabLDn90XUneuZVNJQ_tJ8oH_jwo1xzRTOzUDkt7gQ&dl=1' && sudo chmod +x /usr/bin/greyhole

Then change your greyhole.conf, and restart the Greyhole service.

You can see the new default greyhole.conf here:
https://github.com/gboudreau/Greyhole/blob/master/greyhole.example.conf

See the bottom of it for the new options I added.

from greyhole.

Awesome! I've got it downloaded and running, so far so good. Waiting for crashplan to start spamming.

from greyhole.

And it works! Very nice! Thanks much!

Aug 24 19:22:28 6 write: Now working on task ID 1052163: write data1/backup/loki/Volumes/rusty/LaBianca/Master Pictures/2012/08/22/.cprestoretmp598340674630189313
Aug 24 19:22:28 6 write: Ignoring task because it matches the following ignored_files pattern: .cprestoretmp.*

from greyhole.

Should we all download the new greyhole script, or will a new version be
released soon?

On 25/08/2013 00:23, Erik LaBianca wrote:

And it works! Very nice! Thanks much!

Aug 24 19:22:28 6 write: Now working on task ID 1052163: write
data1/backup/loki/Volumes/rusty/LaBianca/Master
Pictures/2012/08/22/.cprestoretmp598340674630189313
Aug 24 19:22:28 6 write: Ignoring task because it matches the
following ignored_files pattern: .cprestoretmp.*

—
Reply to this email directly or view it on GitHub
#2 (comment).

from greyhole.

I'll create a new version (0.9.34) right now. Expect it live in a few minutes.

from greyhole.

Cool, thank you.
On 31/08/2013 02:36, Guillaume Boudreau wrote:

I'll create a new version (0.9.34) right now. Expect it live in a few
minutes.

—
Reply to this email directly or view it on GitHub
#2 (comment).

from greyhole.