koreyou / chainerboard Goto Github PK

View Code? Open in Web Editor NEW

3.0 3.0 1.0 928 KB

An unofficial visualization tool for chainer, inspired by tensorboard

License: MIT License

Python 61.08% CSS 0.05% JavaScript 28.08% HTML 10.79%

chainerboard's People

Contributors

Stargazers

Watchers

Forkers

dikorsch

chainerboard's Issues

KeyError in get_events_updates when log was altered

I made a program with custom evaluator which reports metrics at validation_1/topic_match/* (e.g. validation_1/topic_match/f1_9). Loading this log data results in KeyError

INFO:werkzeug:127.0.0.1 - - [02/Sep/2017 11:32:53] "POST /events/updates HTTP/1.1" 500 -
Traceback (most recent call last):
  File "/home/koreyou/.pyenv/versions/2.7.12/envs/abae-chainer/lib/python2.7/site-packages/flask/app.py", line 1997, in __call__
    return self.wsgi_app(environ, start_response)
  File "/home/koreyou/.pyenv/versions/2.7.12/envs/abae-chainer/lib/python2.7/site-packages/flask/app.py", line 1985, in wsgi_app
    response = self.handle_exception(e)
  File "/home/koreyou/.pyenv/versions/2.7.12/envs/abae-chainer/lib/python2.7/site-packages/flask/app.py", line 1540, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/home/koreyou/.pyenv/versions/2.7.12/envs/abae-chainer/lib/python2.7/site-packages/flask/app.py", line 1982, in wsgi_app
    response = self.full_dispatch_request()
  File "/home/koreyou/.pyenv/versions/2.7.12/envs/abae-chainer/lib/python2.7/site-packages/flask/app.py", line 1614, in full_dispatch_request
    rv = self.handle_user_exception(e)
  File "/home/koreyou/.pyenv/versions/2.7.12/envs/abae-chainer/lib/python2.7/site-packages/flask/app.py", line 1517, in handle_user_exception
    reraise(exc_type, exc_value, tb)
  File "/home/koreyou/.pyenv/versions/2.7.12/envs/abae-chainer/lib/python2.7/site-packages/flask/app.py", line 1612, in full_dispatch_request
    rv = self.dispatch_request()
  File "/home/koreyou/.pyenv/versions/2.7.12/envs/abae-chainer/lib/python2.7/site-packages/flask/app.py", line 1598, in dispatch_request
    return self.view_functions[rule.endpoint](**req.view_args)
  File "/home/koreyou/.pyenv/versions/2.7.12/envs/abae-chainer/lib/python2.7/site-packages/chainerboard/app/events.py", line 143, in get_events_updates
    if timeline_handler.events[g].state_hash != states.get(g, ''):
KeyError: u'f1_9'

Refactor histogram

histogram.js, because it is copied from events, has unneeded self.groups.
We can remove self.groups for better readability.

Block update when waiting for the last update

Current implementation does not properly block update even when last call is still being executed.
This causes unexpected behaviour such as multiple plots of same type to appear on screen, etc.

Disconnection retry is not working correctly

Disconnection warning that says:

 Disconnected! Retrying in 0 ...

stays at 0.

chainerboard should notify users that NaN or Infinity exists in the log

chainerboard currently does not handle non-finite values (#2).
Chainerboard should notify or show to user in some way that NaN or Infinity exists in the log.

Does not work well with browser zoom

When used with browser's zoom functionality, the plots scale OK but the pane does not. This stops me from fitting more plots in one row.

add version command to cli

It handy to have version command sometimes.

Non-reproducable OSError: [Errno 2] No such file or directory

chainerboard sometimes give out following error.

INFO:werkzeug:127.0.0.1 - - [15/Aug/2017 14:14:09] "POST /events/updates HTTP/1.1" 200 -
Exception in thread Thread-1:
Traceback (most recent call last):
  File "/home/koreyou/.pyenv/versions/2.7.12/lib/python2.7/threading.py", line 801, in __bootstrap_inner
    self.run()
  File "/home/koreyou/.pyenv/versions/2.7.12/envs/chainerboard/lib/python2.7/site-packages/watchdog/observers/api.py", line 199, in run
    self.dispatch_events(self.event_queue, self.timeout)
  File "/home/koreyou/.pyenv/versions/2.7.12/envs/chainerboard/lib/python2.7/site-packages/watchdog/observers/api.py", line 368, in dispatch_events
    handler.dispatch(event)
  File "/home/koreyou/.pyenv/versions/2.7.12/envs/chainerboard/lib/python2.7/site-packages/watchdog/events.py", line 330, in dispatch
    _method_map[event_type](event)
  File "/home/koreyou/work/chainerboard/chainerboard/watcher.py", line 24, in on_modified
    if os.path.samefile(event.src_path, self._watch_path):
  File "/home/koreyou/.pyenv/versions/2.7.12/envs/chainerboard/lib/python2.7/posixpath.py", line 155, in samefile
    s1 = os.stat(f1)
OSError: [Errno 2] No such file or directory: '/home/koreyou/work/abae-chainer/result/logK5E4nK'

This happened when I am trying to monitor "/home/koreyou/work/abae-chainer/result/log" .

Running the same command sometimes give out the same error but other times not.

Plot fails when there exists 'Infinity' in log json file

python json module encode infinity float value as Infinity, which is not supported in AngularJS

>> json.dumps(float('inf'))
'Infinity'

This causes plotting $http.get to fail because it cannot properly decode Infinity.

Same thing may happen when returning really large float to GET call.

Exception in thread Thread-1:
Traceback (most recent call last):
  File "/home/koreyou/.pyenv/versions/2.7.12/lib/python2.7/threading.py", line 801, in __bootstrap_inner
    self.run()
  File "/home/koreyou/.pyenv/versions/2.7.12/envs/abae-chainer/lib/python2.7/site-packages/watchdog/observers/api.py", line 199, in run
    self.dispatch_events(self.event_queue, self.timeout)
  File "/home/koreyou/.pyenv/versions/2.7.12/envs/abae-chainer/lib/python2.7/site-packages/watchdog/observers/api.py", line 368, in dispatch_events
    handler.dispatch(event)
  File "/home/koreyou/.pyenv/versions/2.7.12/envs/abae-chainer/lib/python2.7/site-packages/watchdog/events.py", line 330, in dispatch
    _method_map[event_type](event)
  File "/home/koreyou/.pyenv/versions/2.7.12/envs/abae-chainer/lib/python2.7/site-package/chainerboard/watcher.py", line 33, in on_modified
    self._on_change(event.src_path)
  File "/home/koreyou/.pyenv/versions/2.7.12/envs/abae-chainer/lib/python2.7/site-packages/chainerboard/watcher.py", line 30, in _on_change
    self._timeline_handler.load(target_path)
  File "/home/koreyou/.pyenv/versions/2.7.12/envs/abae-chainer/lib/python2.7/site-packages/chainerboard/timeline_handler.py", line 351, in load
    with open(path) as fin:

IOError: [Errno 2] No such file or directory: '/home/koreyou/work/abae-chainer/result.beer/logDxz5fE'

I suspect that it somehow detected changes to temporally file created by chainer.

Change log level

Current implementation outputs way too much information. Change default logging level or reduce logging level of those noisy loggers.