danisztls / arbie Goto Github PK

When doing a system backup rsync will fail when trying to sync files without read permissions and don't know of anyway of making ignore those automatically. The currrent workaround is to add those manually to an ignore file. That's just not practical and instead I want to automatically traverse /etc find those and update rsync ignore file.

Alternatively

Find a less fragile alternative to rsync.

Note: Syncing currently is serialized. Shell is not the best language to write a daemon with parallel asynchronous operations and this is a glorified backup script which employs good CLI tools like rclone to make much of the work.

I'm currently not satisfied w/ sync performance. Rclone will by default attempt 3 times to sync to a stream in case of errors. Ideally it would skip to the next stream and move the problematic stream to the end of queue and also skip in case of a low upload rate. When I wrote it it didn't not support multi-streams and this is currently being thinly abstracted by the wrapper script.

• Does Rclone supports a feature similar to multi-streams?
• Improve the syncing wrapper

The later should be a proper daemon running decoupled from the main script and also able to support tools other than Rclone.

One of the goals of making encrypted backups is protecting the user data in the cloud from scanning and leakages. But I'm not a security expert so I can't guarantee that. Much of the trust is placed on gocryptfs.

Secure by obscurity, as in hiding whatever do you use, is tempting as it's a real possibility that an attacker could find an exploit while exploring this repo. But the odds are as low as the odds of one making a return on such time investment.

Cloud storage is not safe as is. And if current trends continues it shouldn't be long until the vulnerability industry reaches retail level.

This script runs locally on the machine and does not require superadmin privileges or open ports. And as I see any vulnerability would require access to the local system or the data in the cloud which is pretty much game over if you are doing nothing.

Is there a tool better than mandown? I want to write a hook to update man pages automatically and if a manual review is needed to remove bad formatted parts I prefer to not have man pages at all as the markdown notes are currently enough. And in the future online documentation might be more useful. Specially for new users evaluating the usefulness of the software.