furier / websync Goto Github PK

Hi,

Is it possible to use the rsync option: --partial-dir ?

(Also: when I want to add a new host, I can't use another port than 22:
For example, if I use the port 222:

Bad port 'umask 077; test -d ~/.ssh || mkdir ~/.ssh ; cat >> ~/.ssh/authorized_keys && (test -x 
/sbin/restorecon && /sbin/restorecon ~/.ssh ~/.ssh/authorized_keys >/dev/null 2>&1 || true)' )

Please add --remove-source-files support. This is the only feature that is holding me back from using your awesome project. Keep up your great work!

Disable Run and Test button while task is in progress

Create default SSH ID from websync web interface if one is not already present.

Mobile optimization would be nice.

I'm trying to access the running instance of my newly installed websync, and nothing is loading in the browser. I'm seeing this error in the console:

Error: [$injector:unpr] http://errors.angularjs.org/1.2.20/$injector/unpr?p0=%24templateRequestProvider%20%3C-%20%24templateRequest%20%3C-%20%24route%20%3C-%20ngViewDirective

Some quick googling lead me to this SO post which indicates that something has happened during mangling/uglification of the app JS, specifically that the injected variable names have been uglified, which breaks Angular DI.

Anyone else experienced this?

I cloned the repo just now, so latest build. Running Ubuntu 14.04, Node v0.10.29, latest install of Gulp and Bower.

Thanks for a cool looking app, keen to try it out!

I've tried on multiple Ubuntu 14.04 servers to get websync running. Everything goes fine until executing 'gulp dist'.

~/websync$ gulp dist
[05:34:20] Using gulpfile ~/websync/gulpfile.js
[05:34:20] Starting 'clean'...
[05:34:20] Finished 'clean' after 6.94 ms
[05:34:20] Starting 'copy-server-to-dist'...
[05:34:20] Finished 'copy-server-to-dist' after 3.01 ms
[05:34:20] Starting 'browserify'...
[05:34:20] Finished 'browserify' after 3.18 ms
[05:34:20] Starting 'html'...
[05:34:20] Finished 'html' after 1.39 ms
[05:34:20] Starting 'css'...
[05:34:20] Finished 'css' after 4.49 ms
[05:34:20] Starting 'fonts'...
[05:34:20] Finished 'fonts' after 600 μs
[05:34:20] Starting 'imagemin'...
[05:34:20] Finished 'imagemin' after 1.67 ms
[05:34:20] Starting 'bower'...
[05:34:20] Finished 'bower' after 395 μs
[05:34:20] Starting 'build'...
[05:34:20] Finished 'build' after 1.53 ms
[05:34:20] Starting 'build-prod'...
[05:34:20] Finished 'build-prod' after 4.28 μs
[05:34:20] Starting 'dist'...
[05:34:20] Finished 'dist' after 4.69 μs
[05:34:20] gulp-imagemin: Minified 0 images (saved 0 B - 0%)

stream.js:94
      throw er; // Unhandled stream error in pipe.
            ^
Broken @import declaration of "toolkit.css"

Attempting to run websync gets this output: (which I'm presuming is related to above)

~/websync/dist$ node server.js 

module.js:340
    throw err;
          ^
Error: Cannot find module './lib/config/config'
    at Function.Module._resolveFilename (module.js:338:15)
    at Function.Module._load (module.js:280:25)
    at Module.require (module.js:364:17)
    at require (module.js:380:17)
    at Object.<anonymous> (/home/michael/websync/dist/server.js:13:14)
    at Module._compile (module.js:456:26)
    at Object.Module._extensions..js (module.js:474:10)
    at Module.load (module.js:356:32)
    at Function.Module._load (module.js:312:12)
    at Function.Module.runMain (module.js:497:10)

I've tried on existing machines and brand new installs.

Currently tests have not kept up with the project and are far far behind and have been down prioritized.

The plan is to create great test suits for both backend and frontend to increase stability and enhance the development process and also increase development speed.

Suggestion

I like the feature of uploading your ssh-key by conventional ssh user-password, but I miss the ability to utilize existing setups when there is already a system managing ssh-keys in place, like keybox for example.
SSH-key generation or a way to display the public key through the webui would also be a nice feature to have.

Here are my node and npm versions:-
$ node -v
v6.2.2

$npm -v
3.5.2

$npm install

[email protected] build-dist /home/ppidugu/Downloads/websync-master
gulp dist

(node:12933) fs: re-evaluating native module sources is not supported. If you are using the graceful-fs module, please update it to a more recent version.
/home/ppidugu/Downloads/websync-master/node_modules/node-sass/lib/index.js:22
throw new Error('libsass bindings not found. Try reinstalling node-sass?');
^

Error: libsass bindings not found. Try reinstalling node-sass?
at getBinding (/home/ppidugu/Downloads/websync-master/node_modules/node-sass/lib/index.js:22:11)
at Object. (/home/ppidugu/Downloads/websync-master/node_modules/node-sass/lib/index.js:188:23)
at Module._compile (module.js:541:32)
at Object.Module._extensions..js (module.js:550:10)
at Module.load (module.js:458:32)
at tryModuleLoad (module.js:417:12)
at Function.Module._load (module.js:409:3)
at Module.require (module.js:468:17)
at require (internal/module.js:20:19)
at Object. (/home/ppidugu/Downloads/websync-master/node_modules/gulp-sass/index.js:3:17)

Hi there,
I'm trying to install Websyc, but when I npm install it, I got the following error:
npm ERR! Error: version not found: [email protected]
npm ERR! at setData (/usr/lib/node_modules/npm/lib/cache/add-named.js:127:12)
npm ERR! at saved (/usr/lib/node_modules/npm/node_modules/npm-registry-client/lib/get.js:167:7)
npm ERR! at /usr/lib/node_modules/npm/node_modules/cmd-shim/node_modules/graceful-fs/polyfills.js:133:7
npm ERR! at Object.oncomplete (fs.js:107:15)
npm ERR! If you need help, you may report this entire log,
npm ERR! including the npm and node versions, at:
npm ERR! http://github.com/npm/npm/issues

npm ERR! System Linux 3.2.0-4-amd64
npm ERR! command "node" "/usr/bin/npm" "install"
npm ERR! cwd /home/karibu/websync
npm ERR! node -v v0.10.29
npm ERR! npm -v 2.0.0-beta.0

Do you have any idea how to solve it?

Thank you

On the "Tasks" view, is it possible to show for each task:

• "Last start" - date/time of latest rsync run attempt start
• "Last Success" date/time of latest successful rsync finish

This way the Tasks view will actually become a report where it will be easy to check:

• that tasks are not missing their schedule
• tasks are finishing successfully
• the time every task takes

Thank you!

Hello,
After installing g++ (could you add it in your help ?)
After a 'make test' i get this error message.

make test
make -C out BUILDTYPE=Release V=1
make[1]: Entering directory /home/syndrael/node/out' make[1]: Nothing to be done forall'.
make[1]: Leaving directory `/home/syndrael/node/out'
ln -fs out/Release/node node
/usr/bin/python tools/test.py --mode=release simple message
=== release test-http-client-timeout-event ===
Path: simple/test-http-client-timeout-event
assert.js:92
throw new assert.AssertionError({
^
AssertionError: 0 == 1
at null._onTimeout (/home/syndrael/node/test/simple/test-http-client-timeout-event.js:55:12)
at Timer.listOnTimeout as ontimeout
Command: out/Release/node /home/syndrael/node/test/simple/test-http-client-timeout-event.js

make: *** [test] Error 1

Could you help me ?
Best regards

$ npm install

[email protected] install /home/luca/websync/node_modules/hiredis
node-gyp rebuild

make: Entering directory /home/luca/websync/node_modules/hiredis/build' CC(target) Release/obj.target/hiredis/deps/hiredis/hiredis.o make: cc: comando non trovato make: *** [Release/obj.target/hiredis/deps/hiredis/hiredis.o] Errore 127 make: Leaving directory /home/luca/websync/node_modules/hiredis/build'
gyp ERR! build error
gyp ERR! stack Error: make failed with exit code: 2
gyp ERR! stack at ChildProcess.onExit (/home/luca/.nvm/versions/node/v8.11.1/lib/node_modules/npm/node_modules/node-gyp/lib/build.js:258:23)
gyp ERR! stack at emitTwo (events.js:126:13)
gyp ERR! stack at ChildProcess.emit (events.js:214:7)
gyp ERR! stack at Process.ChildProcess._handle.onexit (internal/child_process.js:198:12)
gyp ERR! System Linux 3.10.0-693.el7.x86_64
gyp ERR! command "/home/luca/.nvm/versions/node/v8.11.1/bin/node" "/home/luca/.nvm/versions/node/v8.11.1/lib/node_modules/npm/node_modules/node-gyp/bin/node-gyp.js" "rebuild"
gyp ERR! cwd /home/luca/websync/node_modules/hiredis
gyp ERR! node -v v8.11.1
gyp ERR! node-gyp -v v3.6.2
gyp ERR! not ok
npm WARN optional SKIPPING OPTIONAL DEPENDENCY: fsevents@github:pipobscure/fsevents#7dcdf9fa3f8956610fd6f69f72c67bace2de7138 (node_modules/watchify/node_modules/chokidar/node_modules/fsevents):
npm WARN notsup SKIPPING OPTIONAL DEPENDENCY: Unsupported platform for [email protected]: wanted {"os":"darwin","arch":"any"} (current: {"os":"linux","arch":"x64"})
npm WARN [email protected] requires a peer of angular@>=1.3.12 but none is installed. You must install peer dependencies yourself.
npm WARN optional SKIPPING OPTIONAL DEPENDENCY: [email protected] (node_modules/fsevents):
npm WARN notsup SKIPPING OPTIONAL DEPENDENCY: Unsupported platform for [email protected]: wanted {"os":"darwin","arch":"any"} (current: {"os":"linux","arch":"x64"})

npm ERR! code ELIFECYCLE
npm ERR! errno 1
npm ERR! [email protected] install: node-gyp rebuild
npm ERR! Exit status 1
npm ERR!
npm ERR! Failed at the [email protected] install script.
npm ERR! This is probably not a problem with npm. There is likely additional logging output above.

npm ERR! A complete log of this run can be found in:
npm ERR! /home/luca/.npm/_logs/2018-05-10T09_45_07_156Z-debug.log

The live logging is useful, but is there a way to get Websync to save the logs in the back end? Right now they just disappear once I refresh.

Also, is there a way to run it in a web directory (such as /var/www/html/websync) rather than on port 3000?

Using websync between 2 servers, the problem is the remote server is a NAS and rsync is not in the path and it is found in a non-standard location. The option to specify the parameter --rsync-path would be great to solve this case.

Can you please add support for both FTP and FTPS alongside SSH.
Thanks

First of all I want to mention that websync seems to be EXACTLY what I've been searching for quite a while, so it's devastating to find out that it doesn't install in newer ubuntus :(

I'm getting similar errors as what's been reported already :

npm install
363 error Linux 4.4.0-22-generic
364 error argv "/usr/bin/nodejs" "/usr/bin/npm" "install"
365 error node v4.2.6
366 error npm v3.5.2
367 error code ELIFECYCLE
368 error [email protected] install: node-gyp rebuild
368 error Exit status 1
369 error Failed at the [email protected] install script 'node-gyp rebuild'.
369 error Make sure you have the latest version of node.js and npm installed.
369 error If you do, this is most likely a problem with the hiredis package,
369 error not with npm itself.
369 error Tell the author that this fails on your system:
369 error node-gyp rebuild
369 error You can get information on how to open an issue for this project with:
369 error npm bugs hiredis
369 error Or if that isn't available, you can get their info via:
369 error npm owner ls hiredis
369 error There is likely additional logging output above.
370 verbose exit [ 1, true ]

I 've tried to reinstall nodejs and npm a couple of times without making any progress, I've also tried other suggestions found on google but nothing helped. Can't think of anything else to try... Truly grateful if anyone has any ideas :) Thank you.

If a backup fail for disk space unavailable or remote authentication it would be nice to have an email notification.

Because the configuration of the application is not managed through a volume, every time you recreate the container, all configuration is lost. This breaks one of the basics of containerization, and in practicality is just not that great, because I tend to recreate my container when migrating servers or pulling in a new version of the image.

I'm not entirely familiar with websync yet, but there must be some configuration database or file that can be put in a volume.

➜ websync git:(master) gulp
[11:49:22] Using gulpfile ~/websync/gulpfile.js
[11:49:22] Starting 'copy-server-to-dist'...
[11:49:22] Finished 'copy-server-to-dist' after 14 ms
[11:49:22] Starting 'server'...
[11:49:22] Finished 'server' after 15 ms
[11:49:22] Starting 'livereload'...
[11:49:22] Finished 'livereload' after 3.94 ms
[11:49:22] Starting 'watchify'...
[11:49:22] Starting 'html'...
[11:49:22] Finished 'html' after 2.26 ms
[11:49:22] Starting 'css'...
[11:49:22] Finished 'css' after 6.37 ms
[11:49:22] Starting 'fonts'...
[11:49:22] Finished 'fonts' after 2.3 ms
[11:49:22] Starting 'imagemin'...
[11:49:22] Finished 'imagemin' after 2.42 ms
[11:49:22] Starting 'bower'...
[11:49:22] Finished 'bower' after 683 μs
[11:49:22] Starting 'build'...
[11:49:22] Finished 'build' after 1.01 ms
[11:49:22] Live reload server listening on: 35729

/home/parin/websync/node_modules/gulp-concat-css/index.js:55
base: firstFile.base,
^
TypeError: Cannot read property 'base' of null
at Transform._flush (/home/parin/websync/node_modules/gulp-concat-css/index.js:55:22)
at Transform. (/home/parin/websync/node_modules/gulp-concat-css/node_modules/through2/node_modules/readable-stream/lib/_stream_transform.js:135:12)
at Transform.g (events.js:180:16)
at Transform.emit (events.js:117:20)
at finishMaybe (/home/parin/websync/node_modules/gulp-concat-css/node_modules/through2/node_modules/readable-stream/lib/_stream_writable.js:371:12)
at endWritable (/home/parin/websync/node_modules/gulp-concat-css/node_modules/through2/node_modules/readable-stream/lib/_stream_writable.js:378:3)
at Transform.Writable.end (/home/parin/websync/node_modules/gulp-concat-css/node_modules/through2/node_modules/readable-stream/lib/_stream_writable.js:356:5)
at Transform.onend (/home/parin/websync/node_modules/gulp-changed/node_modules/through2/node_modules/readable-stream/lib/_stream_readable.js:523:10)
at Transform.g (events.js:180:16)
at Transform.emit (events.js:117:20)

• Handle paths with spaces
• Handle paths surrounded with single and double quotes
• Handle escaped paths

Add cancel button to cancel tasks in progress

To investigate the problem I logged on to the websync docker container with nsenter, and tried to use the ssh-copy-id command and got the following feedback:

/usr/bin/ssh-copy-id: ERROR: No identities found

Since I rememberd I had generated a ssh key previously, I went looking for it in ~, which resulted in:

-bash: cd: /home/<username>: No such file or directory

hmmm, it sais i'm logged in as root...
/root/.ssh/id_rsa exists but it didn't try to use that id...

Then I tried specifying the key file with the ssh-copy-id command and got another result:

mktemp: failed to create file via template '/home/<username>/.ssh/ssh-copy-id_id.XXXXXXXXXX': No such file or directory
mktemp failed

creating the directories /home/<username>/.ssh/ solved the problem, but this is still a problem that needs to be fixed generally.

Looks like its looking for wsdata.json and instead we have default.wsdata.json

$ node server.js
Express server listening on port 3000 in development mode
{ Error: ENOENT: no such file or directory, open '/home/ppidugu/Downloads/websync-master/wsdata.json'
at Error (native)
errno: -2,
code: 'ENOENT',
syscall: 'open',
path: '/home/ppidugu/Downloads/websync-master/wsdata.json' }

[email protected] build-dist /home/adminlocal/websync
gulp dist

/home/adminlocal/websync/node_modules/gulp-util/node_modules/lodash.template/node_modules/lodash.keys/node_modules/lodash._getnative/index.js:13
/** Used to detect host
^^^^^^^^^^^^^^^^^^^^^^^
SyntaxError: Unexpected token ILLEGAL
at exports.runInThisContext (vm.js:73:16)
at Module._compile (module.js:443:25)
at Object.Module._extensions..js (module.js:478:10)
at Module.load (module.js:355:32)
at Function.Module._load (module.js:310:12)
at Module.require (module.js:365:17)
at require (module.js:384:17)
at Object. (/home/adminlocal/websync/node_modules/gulp-util/node_modules/lodash.template/node_modules/lodash.keys/index.js:9:17)
at Module._compile (module.js:460:26)
at Object.Module._extensions..js (module.js:478:10)

npm ERR! Linux 3.16.0-45-generic

Hello,

it's possible to add "sudo" flag with permit to use --rsync-path="sudo rsync" in the command line ?

npm install command fails with :

 verbose raw, before any munging watchify
 verbose url resolving [ 'https://registry.npmjs.org/', './watchify' ]
 verbose url resolved https://registry.npmjs.org/watchify
 http GET https://registry.npmjs.org/watchify
 ERR! Error: failed to fetch from registry: ejs
 ERR!     at /usr/share/npm/lib/utils/npm-registry-client/get.js:139:12
 ERR!     at cb (/usr/share/npm/lib/utils/npm-registry-client/request.js:31:9)
 ERR!     at Request._callback (/usr/share/npm/lib/utils/npm-registry-client/request.js:136:18)
 ERR!     at Request.callback (/usr/lib/nodejs/request/main.js:119:22)
 ERR!     at Request.<anonymous> (/usr/lib/nodejs/request/main.js:212:58)
 ERR!     at Request.emit (events.js:88:20)
 ERR!     at ClientRequest.<anonymous> (/usr/lib/nodejs/request/main.js:412:12)
 ERR!     at ClientRequest.emit (events.js:67:17)
 ERR!     at HTTPParser.onIncoming (http.js:1261:11)
 ERR!     at HTTPParser.onHeadersComplete (http.js:102:31)
 ERR! You may report this log at:
 ERR!     <http://bugs.debian.org/npm>
 ERR! or use
 ERR!     reportbug --attach /home/<user>/websync/npm-debug.log npm
 ERR! 
 ERR! System Linux 3.10.23-xxxx-std-ipv6-64
 ERR! command "node" "/usr/bin/npm" "install"
 ERR! cwd /home/<user>/websync
 ERR! node -v v0.6.12
 ERR! npm -v 1.1.4
 ERR! message failed to fetch from registry: ejs
 verbose exit [ 1, true ]

username was replaced by

I found this ticket with same error (related to raspberry pi though)
https://bugs.launchpad.net/raspbian/+bug/1480668

How can I install Websync for raspbian 8 pixel, with ARM64 cpu?
I will have one main device with AMD64 cpu and linux os that produce mp4 files and will share them to hundreds of other ARM64 devices and linux os, grouped in 2-30 devices sharing the same LAN/WAN and into these groups there will be subgrups of 2-5 devices sharing the same folders.
Any suggestions?

Hi,

i have tried to install websync on my old debian server.
First of all i have to install many packages like:

sudo npm install -g bower
sudo npm install --global gulp
sudo npm install isarray
sudo npm install core-util-is
sudo npm install inherits
sudo npm install xtend
sudo npm install jshint
sudo npm install map-key

Now if i try to build with gulp build i got the following error:

/opt/websync/node_modules/gulp-concat-css/index.js:55
      base: firstFile.base,
                     ^
TypeError: Cannot read property 'base' of null
    at Transform._flush (/opt/websync/node_modules/gulp-concat-css/index.js:55:22)
    at Transform.<anonymous> (/opt/websync/node_modules/gulp-concat-css/node_modules/through2/node_modules/readable-stream/lib/_stream_transform.js:135:12)
    at Transform.g (events.js:180:16)
    at Transform.emit (events.js:117:20)
    at finishMaybe (/opt/websync/node_modules/gulp-concat-css/node_modules/through2/node_modules/readable-stream/lib/_stream_writable.js:371:12)
    at endWritable (/opt/websync/node_modules/gulp-concat-css/node_modules/through2/node_modules/readable-stream/lib/_stream_writable.js:378:3)
    at Transform.Writable.end (/opt/websync/node_modules/gulp-concat-css/node_modules/through2/node_modules/readable-stream/lib/_stream_writable.js:356:5)
    at Transform.onend (/opt/websync/node_modules/gulp-changed/node_modules/through2/node_modules/readable-stream/lib/_stream_readable.js:523:10)
    at Transform.g (events.js:180:16)
    at Transform.emit (events.js:117:20)

Is there some dependency missing?

Rename app/scripts/Services to app/scripts/services as this currently makes the app crash, because the paths doesn't match up....

Use SSH for remote to remote rsyncing

Example: ssh user@server1 "rsync /files user@server2:/directory"

I want to use websync in an internal network w/o Internet connection.
When I try to open the webinterface it's stuck at "Connecting to cdnjs.cloudflare.com".
A quick look in " websync/app/views/index.html" reveals that at least bootstrap css and awesome font are using web resources.

< link rel="stylesheet" href="//maxcdn.bootstrapcdn.com/bootstrap/3.3.4/css/bootstrap.min.css"> < link rel="stylesheet" href="//maxcdn.bootstrapcdn.com/font-awesome/4.3.0/css/font-awesome.min.css">

Suggested fix: Download all web resources and put them in the project.

Let me know if I am missing something. In particular, I am looking for --delete (for destructive updates of the remote copy), and overall progress ( --info=progress2) instead of --progress (which shows file chunk copy progress).

Why not use websync with :

$ websync

?

Example: Sync on the 5th and 25th of every month

is this working on centos 6 ?

Exporting the cronjob command for use without websync

It would be nice to know the destination's folder size and source folder size from the web interface.

Hi
in my case, i need copy some symlink as a real server. so i want add -L parameters in the command,
but i don't know how to do it. can you guys help on that?
more thanks.

Option to use rsync servers