chaoss / grimoirelab-kidash Goto Github PK
View Code? Open in Web Editor NEWKidash: A GrimoireLab tool & library to manage Kibana/Kibiter visualizations and dashboards
License: GNU General Public License v3.0
Kidash: A GrimoireLab tool & library to manage Kibana/Kibiter visualizations and dashboards
License: GNU General Public License v3.0
Hi,
I've saved a dashboard from Kibiter 6.1.0-2, using kidash --export. When trying to upload again that dashboard to a new instance of Elasticsearch, I get:
$ kidash --import ~/src/jgbarah-grimoire/overview.json
Traceback (most recent call last):
File "/tmp/gl/bin/kidash", line 77, in <module>
ARGS.data_sources, ARGS.add_vis_studies)
File "/tmp/gl/lib/python3.5/site-packages/kidash/kidash.py", line 703, in import_dashboard
feed_dashboard(dashboard, elastic_url, es_index, data_sources, add_vis_studies)
File "/tmp/gl/lib/python3.5/site-packages/kidash/kidash.py", line 720, in feed_dashboard
dashboard['dashboard']['value'], data_sources, add_vis_studies)
File "/tmp/gl/lib/python3.5/site-packages/kidash/kidash.py", line 230, in import_item_json
item_json = fix_dashboard_heights(item_json)
File "/tmp/gl/lib/python3.5/site-packages/kidash/kidash.py", line 123, in fix_dashboard_heights
if panel['size_y'] == 1:
KeyError: 'size_y'
This is with the most recent kidash, 0.4.2.
Find attached dashboard.json
(as I said, exported from Kibiter via kidash): overview.json.gz
Hi, sorry for the mess.
This is the message we got when I tried installing Kidash on my MacBook Pro during the GrimoireLab call today.
full log: https://gist.github.com/GeorgLink/40c2ad776b0a68dbad0c12bddc884879
abbreviated log below:
MacBook-Air:~ georglink$ . kidash-venv/bin/activate
(kidash-venv) MacBook-Air:~ georglink$ pip3 install kidash
Collecting kidash
Downloading https://files.pythonhosted.org/packages/22/5d/895e6bfa8f42deba8351c6e4a62690398c081802ce31f1f435d950abd85c/kidash-0.4.15-py3-none-any.whl
Collecting python-dateutil (from kidash)
Downloading https://files.pythonhosted.org/packages/d4/70/d60450c3dd48ef87586924207ae8907090de0b306af2bce5d134d78615cb/python_dateutil-2.8.1-py2.py3-none-any.whl (227kB)
|████████████████████████████████| 235kB 2.9MB/s
Collecting grimoirelab-panels>=0.0.7 (from kidash)
Downloading https://files.pythonhosted.org/packages/90/33/d000d450d95696b822f0838ed834fce211dc26f407feb03de64b431b9641/grimoirelab_panels-0.0.44-py3-none-any.whl (281kB)
|████████████████████████████████| 286kB 40.5MB/s
Collecting grimoire-elk>=0.30.18 (from kidash)
Downloading https://files.pythonhosted.org/packages/64/31/982fea1cc2d4750fe99cf4ee8d280891effad8f0b74dc8e49174a2a4a9fd/grimoire_elk-0.63.0-py3-none-any.whl (234kB)
|████████████████████████████████| 235kB 55.9MB/s
Collecting six>=1.5 (from python-dateutil->kidash)
Downloading https://files.pythonhosted.org/packages/65/26/32b8464df2a97e6dd1b656ed26b2c194606c16fe163c695a992b36c11cdf/six-1.13.0-py2.py3-none-any.whl
Collecting perceval-opnfv>=0.1.2 (from grimoire-elk>=0.30.18->kidash)
Downloading https://files.pythonhosted.org/packages/2d/10/320b734d8d2171294e9da3b2214b26c780901f921700369046f023616fd7/perceval_opnfv-0.1.16-py3-none-any.whl
Collecting perceval>=0.9.6 (from grimoire-elk>=0.30.18->kidash)
Downloading https://files.pythonhosted.org/packages/77/e4/20d3a1e4ab71d71c78ff4061ea3efa3e3eea9f7f70dd942fdbac645df0fb/perceval-0.12.24-py3-none-any.whl (183kB)
|████████████████████████████████| 184kB 44.3MB/s
Collecting sortinghat>=0.6.2 (from grimoire-elk>=0.30.18->kidash)
Downloading https://files.pythonhosted.org/packages/aa/5c/a4aeae6cb366e01471a2754f539dd1a1a93a7cda8c9418dfa9ee36a53b6d/sortinghat-0.7.7-py3-none-any.whl (152kB)
|████████████████████████████████| 153kB 62.0MB/s
Collecting redis<=2.10.6,>=2.10.0 (from grimoire-elk>=0.30.18->kidash)
Downloading https://files.pythonhosted.org/packages/3b/f6/7a76333cf0b9251ecf49efff635015171843d9b977e4ffcf59f9c4428052/redis-2.10.6-py2.py3-none-any.whl (64kB)
|████████████████████████████████| 71kB 27.5MB/s
Collecting graal>=0.2.2 (from grimoire-elk>=0.30.18->kidash)
Downloading https://files.pythonhosted.org/packages/d0/bc/fe1f9e45db8229ac616f2f5e98f58f9403219b76d9fb1e4360c4d8722d27/graal-0.2.3-py3-none-any.whl (54kB)
|████████████████████████████████| 61kB 25.5MB/s
Collecting pandas==0.22.0 (from grimoire-elk>=0.30.18->kidash)
Downloading https://files.pythonhosted.org/packages/08/01/803834bc8a4e708aedebb133095a88a4dad9f45bbaf5ad777d2bea543c7e/pandas-0.22.0.tar.gz (11.3MB)
|████████████████████████████████| 11.3MB 14.9MB/s
Installing build dependencies ... error
ERROR: Command errored out with exit status 1:
command: /Users/georglink/kidash-venv/bin/python3 /Users/georglink/kidash-venv/lib/python3.7/site-packages/pip install --ignore-installed --no-user --prefix /private/var/folders/c_/6slmxw9d3pvgx61cm_b_82wc0000gn/T/pip-build-env-oqz8r_qr/overlay --no-warn-script-location --no-binary :none: --only-binary :none: -i https://pypi.org/simple -- wheel setuptools Cython 'numpy==1.9.3; python_version=='"'"'3.5'"'"'' 'numpy==1.12.1; python_version=='"'"'3.6'"'"'' 'numpy==1.13.1; python_version>='"'"'3.7'"'"''
cwd: None
Complete output (4394 lines):
Ignoring numpy: markers 'python_version == "3.5"' don't match your environment
Ignoring numpy: markers 'python_version == "3.6"' don't match your environment
Collecting wheel
Downloading https://files.pythonhosted.org/packages/00/83/b4a77d044e78ad1a45610eb88f745be2fd2c6d658f9798a15e384b7d57c9/wheel-0.33.6-py2.py3-none-any.whl
Collecting setuptools
Downloading https://files.pythonhosted.org/packages/54/28/c45d8b54c1339f9644b87663945e54a8503cfef59cf0f65b3ff5dd17cf64/setuptools-42.0.2-py2.py3-none-any.whl (583kB)
Collecting Cython
Downloading https://files.pythonhosted.org/packages/9b/e6/6e30303d7bc17289411d82276b7338a1781964171c94f5ebe689cbecad4c/Cython-0.29.14-cp37-cp37m-macosx_10_6_intel.macosx_10_9_intel.macosx_10_9_x86_64.macosx_10_10_intel.macosx_10_10_x86_64.whl (2.9MB)
Collecting numpy==1.13.1
Downloading https://files.pythonhosted.org/packages/c0/3a/40967d9f5675fbb097ffec170f59c2ba19fc96373e73ad47c2cae9a30aed/numpy-1.13.1.zip (5.0MB)
Installing collected packages: wheel, setuptools, Cython, numpy
Running setup.py install for numpy: started
Running setup.py install for numpy: still running...
Running setup.py install for numpy: finished with status 'error'
ERROR: Command errored out with exit status 1:
command: /Users/georglink/kidash-venv/bin/python3 -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/private/var/folders/c_/6slmxw9d3pvgx61cm_b_82wc0000gn/T/pip-install-0n5b5oji/numpy/setup.py'"'"'; __file__='"'"'/private/var/folders/c_/6slmxw9d3pvgx61cm_b_82wc0000gn/T/pip-install-0n5b5oji/numpy/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /private/var/folders/c_/6slmxw9d3pvgx61cm_b_82wc0000gn/T/pip-record-fpe78ui0/install-record.txt --single-version-externally-managed --prefix /private/var/folders/c_/6slmxw9d3pvgx61cm_b_82wc0000gn/T/pip-build-env-oqz8r_qr/overlay --compile --install-headers /Users/georglink/kidash-venv/include/site/python3.7/numpy
cwd: /private/var/folders/c_/6slmxw9d3pvgx61cm_b_82wc0000gn/T/pip-install-0n5b5oji/numpy/
Complete output (4372 lines):
Running from numpy source directory.
Note: if you need reliable uninstall behavior, then install
with pip instead of using `setup.py install`:
- `pip install .` (from a git repo or downloaded source
release)
- `pip install numpy` (last NumPy release on PyPi)
blas_opt_info:
blas_mkl_info:
libraries mkl_rt not found in ['/Users/georglink/kidash-venv/lib', '/usr/local/lib', '/usr/lib']
NOT AVAILABLE
blis_info:
libraries blis not found in ['/Users/georglink/kidash-venv/lib', '/usr/local/lib', '/usr/lib']
NOT AVAILABLE
openblas_info:
libraries openblas not found in ['/Users/georglink/kidash-venv/lib', '/usr/local/lib', '/usr/lib']
NOT AVAILABLE
atlas_3_10_blas_threads_info:
Setting PTATLAS=ATLAS
libraries tatlas not found in ['/Users/georglink/kidash-venv/lib', '/usr/local/lib', '/usr/lib']
NOT AVAILABLE
atlas_3_10_blas_info:
libraries satlas not found in ['/Users/georglink/kidash-venv/lib', '/usr/local/lib', '/usr/lib']
NOT AVAILABLE
atlas_blas_threads_info:
Setting PTATLAS=ATLAS
libraries ptf77blas,ptcblas,atlas not found in ['/Users/georglink/kidash-venv/lib', '/usr/local/lib', '/usr/lib']
NOT AVAILABLE
atlas_blas_info:
libraries f77blas,cblas,atlas not found in ['/Users/georglink/kidash-venv/lib', '/usr/local/lib', '/usr/lib']
NOT AVAILABLE
FOUND:
extra_compile_args = ['-msse3', '-I/System/Library/Frameworks/vecLib.framework/Headers']
extra_link_args = ['-Wl,-framework', '-Wl,Accelerate']
define_macros = [('NO_ATLAS_INFO', 3), ('HAVE_CBLAS', None)]
/bin/sh: svnversion: command not found
non-existing path in 'numpy/distutils': 'site.cfg'
/bin/sh: svnversion: command not found
F2PY Version 2
lapack_opt_info:
lapack_mkl_info:
libraries mkl_rt not found in ['/Users/georglink/kidash-venv/lib', '/usr/local/lib', '/usr/lib']
NOT AVAILABLE
openblas_lapack_info:
libraries openblas not found in ['/Users/georglink/kidash-venv/lib', '/usr/local/lib', '/usr/lib']
NOT AVAILABLE
atlas_3_10_threads_info:
Setting PTATLAS=ATLAS
libraries tatlas,tatlas not found in /Users/georglink/kidash-venv/lib
libraries lapack_atlas not found in /Users/georglink/kidash-venv/lib
libraries tatlas,tatlas not found in /usr/local/lib
libraries lapack_atlas not found in /usr/local/lib
libraries tatlas,tatlas not found in /usr/lib
libraries lapack_atlas not found in /usr/lib
<class 'numpy.distutils.system_info.atlas_3_10_threads_info'>
NOT AVAILABLE
atlas_3_10_info:
libraries satlas,satlas not found in /Users/georglink/kidash-venv/lib
libraries lapack_atlas not found in /Users/georglink/kidash-venv/lib
libraries satlas,satlas not found in /usr/local/lib
libraries lapack_atlas not found in /usr/local/lib
libraries satlas,satlas not found in /usr/lib
libraries lapack_atlas not found in /usr/lib
<class 'numpy.distutils.system_info.atlas_3_10_info'>
NOT AVAILABLE
atlas_threads_info:
Setting PTATLAS=ATLAS
libraries ptf77blas,ptcblas,atlas not found in /Users/georglink/kidash-venv/lib
libraries lapack_atlas not found in /Users/georglink/kidash-venv/lib
libraries ptf77blas,ptcblas,atlas not found in /usr/local/lib
libraries lapack_atlas not found in /usr/local/lib
libraries ptf77blas,ptcblas,atlas not found in /usr/lib
libraries lapack_atlas not found in /usr/lib
<class 'numpy.distutils.system_info.atlas_threads_info'>
NOT AVAILABLE
atlas_info:
libraries f77blas,cblas,atlas not found in /Users/georglink/kidash-venv/lib
libraries lapack_atlas not found in /Users/georglink/kidash-venv/lib
libraries f77blas,cblas,atlas not found in /usr/local/lib
libraries lapack_atlas not found in /usr/local/lib
libraries f77blas,cblas,atlas not found in /usr/lib
libraries lapack_atlas not found in /usr/lib
<class 'numpy.distutils.system_info.atlas_info'>
NOT AVAILABLE
FOUND:
extra_compile_args = ['-msse3']
extra_link_args = ['-Wl,-framework', '-Wl,Accelerate']
define_macros = [('NO_ATLAS_INFO', 3), ('HAVE_CBLAS', None)]
/usr/local/Cellar/python/3.7.5/Frameworks/Python.framework/Versions/3.7/lib/python3.7/distutils/dist.py:274: UserWarning: Unknown distribution option: 'define_macros'
warnings.warn(msg)
running install
running build
running config_cc
unifing config_cc, config, build_clib, build_ext, build commands --compiler options
running config_fc
unifing config_fc, config, build_clib, build_ext, build commands --fcompiler options
running build_src
build_src
building py_modules sources
creating build
creating build/src.macosx-10.15-x86_64-3.7
creating build/src.macosx-10.15-x86_64-3.7/numpy
creating build/src.macosx-10.15-x86_64-3.7/numpy/distutils
building library "npymath" sources
customize Gnu95FCompiler
Could not locate executable gfortran
Could not locate executable f95
customize NAGFCompiler
customize AbsoftFCompiler
Could not locate executable f90
Could not locate executable f77
customize IBMFCompiler
Could not locate executable xlf90
Could not locate executable xlf
customize IntelFCompiler
Could not locate executable ifort
Could not locate executable ifc
customize GnuFCompiler
Could not locate executable g77
customize G95FCompiler
Could not locate executable g95
customize PGroupFCompiler
Could not locate executable pgfortran
don't know how to compile Fortran code on platform 'posix'
C compiler: clang -Wno-unused-result -Wsign-compare -Wunreachable-code -fno-common -dynamic -DNDEBUG -g -fwrapv -O3 -Wall -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/System/Library/Frameworks/Tk.framework/Versions/8.5/Headers
---------------------- SNIP --------------------
creating build/temp.macosx-10.15-x86_64-3.7/numpy/random
creating build/temp.macosx-10.15-x86_64-3.7/numpy/random/mtrand
compile options: '-D_FILE_OFFSET_BITS=64 -D_LARGEFILE_SOURCE=1 -D_LARGEFILE64_SOURCE=1 -Inumpy/core/include -Ibuild/src.macosx-10.15-x86_64-3.7/numpy/core/include/numpy -Inumpy/core/src/private -Inumpy/core/src -Inumpy/core -Inumpy/core/src/npymath -Inumpy/core/src/multiarray -Inumpy/core/src/umath -Inumpy/core/src/npysort -I/usr/local/include -I/usr/local/opt/[email protected]/include -I/usr/local/opt/sqlite/include -I/Users/georglink/kidash-venv/include -I/usr/local/Cellar/python/3.7.5/Frameworks/Python.framework/Versions/3.7/include/python3.7m -Ibuild/src.macosx-10.15-x86_64-3.7/numpy/core/src/private -Ibuild/src.macosx-10.15-x86_64-3.7/numpy/core/src/npymath -Ibuild/src.macosx-10.15-x86_64-3.7/numpy/core/src/private -Ibuild/src.macosx-10.15-x86_64-3.7/numpy/core/src/npymath -Ibuild/src.macosx-10.15-x86_64-3.7/numpy/core/src/private -Ibuild/src.macosx-10.15-x86_64-3.7/numpy/core/src/npymath -c'
clang: numpy/random/mtrand/mtrand.c
numpy/random/mtrand/mtrand.c:44374:65: error: too many arguments to function call, expected 3, have 4
return (*((__Pyx_PyCFunctionFast)meth)) (self, args, nargs, NULL);
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ^~~~
/Library/Developer/CommandLineTools/usr/lib/clang/11.0.0/include/stddef.h:105:16: note: expanded from macro 'NULL'
# define NULL ((void*)0)
^~~~~~~~~~
numpy/random/mtrand/mtrand.c:44793:21: error: no member named 'exc_type' in 'struct _ts'
*type = tstate->exc_type;
~~~~~~ ^
numpy/random/mtrand/mtrand.c:44794:22: error: no member named 'exc_value' in 'struct _ts'; did you mean 'curexc_value'?
*value = tstate->exc_value;
^~~~~~~~~
curexc_value
/usr/local/Cellar/python/3.7.5/Frameworks/Python.framework/Versions/3.7/include/python3.7m/pystate.h:240:15: note: 'curexc_value' declared here
PyObject *curexc_value;
^
numpy/random/mtrand/mtrand.c:44795:19: error: no member named 'exc_traceback' in 'struct _ts'; did you mean 'curexc_traceback'?
*tb = tstate->exc_traceback;
^~~~~~~~~~~~~
curexc_traceback
/usr/local/Cellar/python/3.7.5/Frameworks/Python.framework/Versions/3.7/include/python3.7m/pystate.h:241:15: note: 'curexc_traceback' declared here
PyObject *curexc_traceback;
^
numpy/random/mtrand/mtrand.c:44802:24: error: no member named 'exc_type' in 'struct _ts'
tmp_type = tstate->exc_type;
~~~~~~ ^
numpy/random/mtrand/mtrand.c:44803:25: error: no member named 'exc_value' in 'struct _ts'; did you mean 'curexc_value'?
tmp_value = tstate->exc_value;
^~~~~~~~~
curexc_value
/usr/local/Cellar/python/3.7.5/Frameworks/Python.framework/Versions/3.7/include/python3.7m/pystate.h:240:15: note: 'curexc_value' declared here
PyObject *curexc_value;
^
numpy/random/mtrand/mtrand.c:44804:22: error: no member named 'exc_traceback' in 'struct _ts'; did you mean 'curexc_traceback'?
tmp_tb = tstate->exc_traceback;
^~~~~~~~~~~~~
curexc_traceback
/usr/local/Cellar/python/3.7.5/Frameworks/Python.framework/Versions/3.7/include/python3.7m/pystate.h:241:15: note: 'curexc_traceback' declared here
PyObject *curexc_traceback;
^
numpy/random/mtrand/mtrand.c:44805:13: error: no member named 'exc_type' in 'struct _ts'
tstate->exc_type = type;
~~~~~~ ^
numpy/random/mtrand/mtrand.c:44806:13: error: no member named 'exc_value' in 'struct _ts'; did you mean 'curexc_value'?
tstate->exc_value = value;
^~~~~~~~~
curexc_value
/usr/local/Cellar/python/3.7.5/Frameworks/Python.framework/Versions/3.7/include/python3.7m/pystate.h:240:15: note: 'curexc_value' declared here
PyObject *curexc_value;
^
numpy/random/mtrand/mtrand.c:44807:13: error: no member named 'exc_traceback' in 'struct _ts'; did you mean 'curexc_traceback'?
tstate->exc_traceback = tb;
^~~~~~~~~~~~~
curexc_traceback
/usr/local/Cellar/python/3.7.5/Frameworks/Python.framework/Versions/3.7/include/python3.7m/pystate.h:241:15: note: 'curexc_traceback' declared here
PyObject *curexc_traceback;
^
numpy/random/mtrand/mtrand.c:44862:24: error: no member named 'exc_type' in 'struct _ts'
tmp_type = tstate->exc_type;
~~~~~~ ^
numpy/random/mtrand/mtrand.c:44863:25: error: no member named 'exc_value' in 'struct _ts'; did you mean 'curexc_value'?
tmp_value = tstate->exc_value;
^~~~~~~~~
curexc_value
/usr/local/Cellar/python/3.7.5/Frameworks/Python.framework/Versions/3.7/include/python3.7m/pystate.h:240:15: note: 'curexc_value' declared here
PyObject *curexc_value;
^
numpy/random/mtrand/mtrand.c:44864:22: error: no member named 'exc_traceback' in 'struct _ts'; did you mean 'curexc_traceback'?
tmp_tb = tstate->exc_traceback;
^~~~~~~~~~~~~
curexc_traceback
/usr/local/Cellar/python/3.7.5/Frameworks/Python.framework/Versions/3.7/include/python3.7m/pystate.h:241:15: note: 'curexc_traceback' declared here
PyObject *curexc_traceback;
^
numpy/random/mtrand/mtrand.c:44865:13: error: no member named 'exc_type' in 'struct _ts'
tstate->exc_type = local_type;
~~~~~~ ^
numpy/random/mtrand/mtrand.c:44866:13: error: no member named 'exc_value' in 'struct _ts'; did you mean 'curexc_value'?
tstate->exc_value = local_value;
^~~~~~~~~
curexc_value
/usr/local/Cellar/python/3.7.5/Frameworks/Python.framework/Versions/3.7/include/python3.7m/pystate.h:240:15: note: 'curexc_value' declared here
PyObject *curexc_value;
^
numpy/random/mtrand/mtrand.c:44867:13: error: no member named 'exc_traceback' in 'struct _ts'; did you mean 'curexc_traceback'?
tstate->exc_traceback = local_tb;
^~~~~~~~~~~~~
curexc_traceback
/usr/local/Cellar/python/3.7.5/Frameworks/Python.framework/Versions/3.7/include/python3.7m/pystate.h:241:15: note: 'curexc_traceback' declared here
PyObject *curexc_traceback;
^
16 errors generated.
numpy/random/mtrand/mtrand.c:44374:65: error: too many arguments to function call, expected 3, have 4
return (*((__Pyx_PyCFunctionFast)meth)) (self, args, nargs, NULL);
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ^~~~
/Library/Developer/CommandLineTools/usr/lib/clang/11.0.0/include/stddef.h:105:16: note: expanded from macro 'NULL'
# define NULL ((void*)0)
^~~~~~~~~~
numpy/random/mtrand/mtrand.c:44793:21: error: no member named 'exc_type' in 'struct _ts'
*type = tstate->exc_type;
~~~~~~ ^
numpy/random/mtrand/mtrand.c:44794:22: error: no member named 'exc_value' in 'struct _ts'; did you mean 'curexc_value'?
*value = tstate->exc_value;
^~~~~~~~~
curexc_value
/usr/local/Cellar/python/3.7.5/Frameworks/Python.framework/Versions/3.7/include/python3.7m/pystate.h:240:15: note: 'curexc_value' declared here
PyObject *curexc_value;
^
numpy/random/mtrand/mtrand.c:44795:19: error: no member named 'exc_traceback' in 'struct _ts'; did you mean 'curexc_traceback'?
*tb = tstate->exc_traceback;
^~~~~~~~~~~~~
curexc_traceback
/usr/local/Cellar/python/3.7.5/Frameworks/Python.framework/Versions/3.7/include/python3.7m/pystate.h:241:15: note: 'curexc_traceback' declared here
PyObject *curexc_traceback;
^
numpy/random/mtrand/mtrand.c:44802:24: error: no member named 'exc_type' in 'struct _ts'
tmp_type = tstate->exc_type;
~~~~~~ ^
numpy/random/mtrand/mtrand.c:44803:25: error: no member named 'exc_value' in 'struct _ts'; did you mean 'curexc_value'?
tmp_value = tstate->exc_value;
^~~~~~~~~
curexc_value
/usr/local/Cellar/python/3.7.5/Frameworks/Python.framework/Versions/3.7/include/python3.7m/pystate.h:240:15: note: 'curexc_value' declared here
PyObject *curexc_value;
^
numpy/random/mtrand/mtrand.c:44804:22: error: no member named 'exc_traceback' in 'struct _ts'; did you mean 'curexc_traceback'?
tmp_tb = tstate->exc_traceback;
^~~~~~~~~~~~~
curexc_traceback
/usr/local/Cellar/python/3.7.5/Frameworks/Python.framework/Versions/3.7/include/python3.7m/pystate.h:241:15: note: 'curexc_traceback' declared here
PyObject *curexc_traceback;
^
numpy/random/mtrand/mtrand.c:44805:13: error: no member named 'exc_type' in 'struct _ts'
tstate->exc_type = type;
~~~~~~ ^
numpy/random/mtrand/mtrand.c:44806:13: error: no member named 'exc_value' in 'struct _ts'; did you mean 'curexc_value'?
tstate->exc_value = value;
^~~~~~~~~
curexc_value
/usr/local/Cellar/python/3.7.5/Frameworks/Python.framework/Versions/3.7/include/python3.7m/pystate.h:240:15: note: 'curexc_value' declared here
PyObject *curexc_value;
^
numpy/random/mtrand/mtrand.c:44807:13: error: no member named 'exc_traceback' in 'struct _ts'; did you mean 'curexc_traceback'?
tstate->exc_traceback = tb;
^~~~~~~~~~~~~
curexc_traceback
/usr/local/Cellar/python/3.7.5/Frameworks/Python.framework/Versions/3.7/include/python3.7m/pystate.h:241:15: note: 'curexc_traceback' declared here
PyObject *curexc_traceback;
^
numpy/random/mtrand/mtrand.c:44862:24: error: no member named 'exc_type' in 'struct _ts'
tmp_type = tstate->exc_type;
~~~~~~ ^
numpy/random/mtrand/mtrand.c:44863:25: error: no member named 'exc_value' in 'struct _ts'; did you mean 'curexc_value'?
tmp_value = tstate->exc_value;
^~~~~~~~~
curexc_value
/usr/local/Cellar/python/3.7.5/Frameworks/Python.framework/Versions/3.7/include/python3.7m/pystate.h:240:15: note: 'curexc_value' declared here
PyObject *curexc_value;
^
numpy/random/mtrand/mtrand.c:44864:22: error: no member named 'exc_traceback' in 'struct _ts'; did you mean 'curexc_traceback'?
tmp_tb = tstate->exc_traceback;
^~~~~~~~~~~~~
curexc_traceback
/usr/local/Cellar/python/3.7.5/Frameworks/Python.framework/Versions/3.7/include/python3.7m/pystate.h:241:15: note: 'curexc_traceback' declared here
PyObject *curexc_traceback;
^
numpy/random/mtrand/mtrand.c:44865:13: error: no member named 'exc_type' in 'struct _ts'
tstate->exc_type = local_type;
~~~~~~ ^
numpy/random/mtrand/mtrand.c:44866:13: error: no member named 'exc_value' in 'struct _ts'; did you mean 'curexc_value'?
tstate->exc_value = local_value;
^~~~~~~~~
curexc_value
/usr/local/Cellar/python/3.7.5/Frameworks/Python.framework/Versions/3.7/include/python3.7m/pystate.h:240:15: note: 'curexc_value' declared here
PyObject *curexc_value;
^
numpy/random/mtrand/mtrand.c:44867:13: error: no member named 'exc_traceback' in 'struct _ts'; did you mean 'curexc_traceback'?
tstate->exc_traceback = local_tb;
^~~~~~~~~~~~~
curexc_traceback
/usr/local/Cellar/python/3.7.5/Frameworks/Python.framework/Versions/3.7/include/python3.7m/pystate.h:241:15: note: 'curexc_traceback' declared here
PyObject *curexc_traceback;
^
16 errors generated.
error: Command "clang -Wno-unused-result -Wsign-compare -Wunreachable-code -fno-common -dynamic -DNDEBUG -g -fwrapv -O3 -Wall -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/System/Library/Frameworks/Tk.framework/Versions/8.5/Headers -D_FILE_OFFSET_BITS=64 -D_LARGEFILE_SOURCE=1 -D_LARGEFILE64_SOURCE=1 -Inumpy/core/include -Ibuild/src.macosx-10.15-x86_64-3.7/numpy/core/include/numpy -Inumpy/core/src/private -Inumpy/core/src -Inumpy/core -Inumpy/core/src/npymath -Inumpy/core/src/multiarray -Inumpy/core/src/umath -Inumpy/core/src/npysort -I/usr/local/include -I/usr/local/opt/[email protected]/include -I/usr/local/opt/sqlite/include -I/Users/georglink/kidash-venv/include -I/usr/local/Cellar/python/3.7.5/Frameworks/Python.framework/Versions/3.7/include/python3.7m -Ibuild/src.macosx-10.15-x86_64-3.7/numpy/core/src/private -Ibuild/src.macosx-10.15-x86_64-3.7/numpy/core/src/npymath -Ibuild/src.macosx-10.15-x86_64-3.7/numpy/core/src/private -Ibuild/src.macosx-10.15-x86_64-3.7/numpy/core/src/npymath -Ibuild/src.macosx-10.15-x86_64-3.7/numpy/core/src/private -Ibuild/src.macosx-10.15-x86_64-3.7/numpy/core/src/npymath -c numpy/random/mtrand/mtrand.c -o build/temp.macosx-10.15-x86_64-3.7/numpy/random/mtrand/mtrand.o -MMD -MF build/temp.macosx-10.15-x86_64-3.7/numpy/random/mtrand/mtrand.o.d" failed with exit status 1
----------------------------------------
ERROR: Command errored out with exit status 1: /Users/georglink/kidash-venv/bin/python3 -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/private/var/folders/c_/6slmxw9d3pvgx61cm_b_82wc0000gn/T/pip-install-0n5b5oji/numpy/setup.py'"'"'; __file__='"'"'/private/var/folders/c_/6slmxw9d3pvgx61cm_b_82wc0000gn/T/pip-install-0n5b5oji/numpy/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /private/var/folders/c_/6slmxw9d3pvgx61cm_b_82wc0000gn/T/pip-record-fpe78ui0/install-record.txt --single-version-externally-managed --prefix /private/var/folders/c_/6slmxw9d3pvgx61cm_b_82wc0000gn/T/pip-build-env-oqz8r_qr/overlay --compile --install-headers /Users/georglink/kidash-venv/include/site/python3.7/numpy Check the logs for full command output.
WARNING: You are using pip version 19.2.3, however version 19.3.1 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
----------------------------------------
ERROR: Command errored out with exit status 1: /Users/georglink/kidash-venv/bin/python3 /Users/georglink/kidash-venv/lib/python3.7/site-packages/pip install --ignore-installed --no-user --prefix /private/var/folders/c_/6slmxw9d3pvgx61cm_b_82wc0000gn/T/pip-build-env-oqz8r_qr/overlay --no-warn-script-location --no-binary :none: --only-binary :none: -i https://pypi.org/simple -- wheel setuptools Cython 'numpy==1.9.3; python_version=='"'"'3.5'"'"'' 'numpy==1.12.1; python_version=='"'"'3.6'"'"'' 'numpy==1.13.1; python_version>='"'"'3.7'"'"'' Check the logs for full command output.
WARNING: You are using pip version 19.2.3, however version 19.3.1 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
(kidash-venv) MacBook-Air:~ georglink$ MacBook-Air:~ georglink$ . kidash-venv/bin/activate
-bash: MacBook-Air:~: command not found
(kidash-venv) MacBook-Air:~ georglink$ (kidash-venv) MacBook-Air:~ georglink$ pip3 install kidash
-bash: syntax error near unexpected token `MacBook-Air:~'
(kidash-venv) MacBook-Air:~ georglink$
I successfully installed kidash but when i use kidash --help
,i got a error:
Traceback (most recent call last):
File "/usr/local/bin/kidash", line 4, in
import('pkg_resources').run_script('kidash==0.4.21', 'kidash')
File "/usr/local/lib/python3.6/dist-packages/pkg_resources/init.py", line 651, in run_script
self.require(requires)[0].run_script(script_name, ns)
File "/usr/local/lib/python3.6/dist-packages/pkg_resources/init.py", line 1438, in run_script
.format(**locals()),
pkg_resources.ResolutionError: Script 'scripts/kidash' not found in metadata at '/usr/local/lib/python3.6/dist-packages/kidash-0.4.21.dist-info'
how to solve it?
In the README, I don't see any documentation about how to export a panel I've created.
From kidash --help
, I get this:
usage: usage: kidash [options]
Import or Export a Kibana Dashboard
optional arguments:
-h, --help show this help message and exit
-e ELASTIC_URL, --elastic_url ELASTIC_URL
Host with elastic search(default:
http://127.0.0.1:9200)
--elastic_url-enrich ELASTIC_URL_ENRICH
Host with elastic search and enriched indexes
--dashboard DASHBOARD
Kibana dashboard id to export
--export EXPORT_FILE file with the dashboard exported
--import IMPORT_FILE file with the dashboard to be imported
--kibana KIBANA_INDEX
Kibana index name (.kibana default)
--list list available dashboards
-g, --debug
--data-sources DATA_SOURCES [DATA_SOURCES ...]
Data sources to be included
--add-vis-studies Include visualizations for studies
After Kibana 6.1 the .kibana
index, in which all information related to index patterns, dashboards, visualization and searches is stored, it is not created by Kibana until it is needed. When Kibana creates this .kibana index it includes some templates in it in order to control how the mappings are created.
kidash for importing a dashboard load all the data in the .kibana
index. If it does not exists, it is created by Elasticsearch with the first load of data into it by kidash. But it is not created with the templates that Kibana needs, so this .kibana
index won't work as expected and for example, index patterns won't work.
In order to fix this issue, kidash must check if .kibana
index exists in versions >= 6.1 and if not, it must create it, before any import. To create this index using Kibana, the Kibana REST API can be used as described by one of the Kibana core developers here.
I've created a panel in CHAOSS dashboard, but I am not able of exporting it.
This is what I've tried and what I've got:
$ kidash -e https://chaoss.biterg.io:9200 --dashboard 3f4bf390-b29a-11e8-bbe5-d99a6d067cbc --export C_jbc.json
2018-09-10 10:34:38,168 Retrying (Retry(total=20, connect=20, read=8, redirect=5, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x7f6198bf9f28>: Failed to establish a new connection: [Errno 111] Connection refused',)': /
$kidash -e https://bitergia:************@chaoss.biterg.io:9200 --dashboard 3f4bf390-b29a-11e8-bbe5-d99a6d067cbc --export C_jbc.json
2018-09-10 10:36:18,816 Retrying (Retry(total=20, connect=20, read=8, redirect=5, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x7f60d7ee8f28>: Failed to establish a new connection: [Errno 111] Connection refused',)': /
Even kidash -e ... --list
gives a Connection refused
error.
Am I doing something wrong or is there a bug here?
The documentation at https://github.com/chaoss/grimoirelab-kidash/blob/master/README.md is not up-to-date.
It should contain at least the basic command to export and import dashboards, something like:
Export a dashboard
kidash -g -e <elasticsearch-url> --dashboard <dashboard-id>* --export <local-file-path>
example: kidash -g -e https://admin:admin@localhost:9200 --dashboard overview --export overview.json
The <dashboard-id> is visible in the URL of dashboard.
Import a dashboard
kidash -g -e <elasticsearch-url>:<port> --import <local-file-path>
example: kidash -g -e https://admin:admin@localhost:9200 --import ./overview.json
Elasticsearch and Kibana versions I'm using from opendistro which was suggested in chaoss/grimoirelab-sirmordred#491
I'm running a docker-compose setup with following images.
amazon/opendistro-for-elasticsearch:1.11.0
amazon/opendistro-for-elasticsearch-kibana:1.11.0
bitergia/mordred:grimoirelab-0.2.50
$ utils/micro.py --panels --cfg /home/bitergia/conf/setup.cfg --debug
[2020-11-05 12:25:45,036 - root - DEBUG] - Debug mode activated
[2020-11-05 12:25:45,036 - sirmordred.config - DEBUG] - Reading conf files
[2020-11-05 12:25:45,036 - sirmordred.config - DEBUG] - Reading conf files: /home/bitergia/conf/setup.cfg
[2020-11-05 12:25:45,108 - urllib3.connectionpool - DEBUG] - Starting new HTTPS connection (1): elasticsearch:443
[2020-11-05 12:25:45,149 - urllib3.connectionpool - DEBUG] - https://elasticsearch:443 "GET / HTTP/1.1" 200 528
[2020-11-05 12:25:45,152 - urllib3.connectionpool - DEBUG] - Starting new HTTPS connection (1): elasticsearch:443
[2020-11-05 12:25:45,216 - urllib3.connectionpool - DEBUG] - https://elasticsearch:443 "GET /.kibana HTTP/1.1" 200 4675
[2020-11-05 12:25:45,219 - urllib3.connectionpool - DEBUG] - Starting new HTTP connection (1): kibana:5601
[2020-11-05 12:25:46,518 - urllib3.connectionpool - DEBUG] - http://kibana:5601 "POST /api/kibana/settings/defaultIndex HTTP/1.1" 200 183
[2020-11-05 12:25:47,651 - urllib3.connectionpool - DEBUG] - http://kibana:5601 "POST /api/kibana/settings/timepicker:timeDefaults HTTP/1.1" 200 183
[2020-11-05 12:25:47,652 - sirmordred.task_panels - INFO] - Kibiter settings configured!
[2020-11-05 12:25:47,653 - sirmordred.task_panels - INFO] - Dashboard panels, visualizations: uploading...
[2020-11-05 12:25:47,653 - kidash.kidash - DEBUG] - Reading panels JSON file: /root/grimoirelab-sirmordred/src/grimoirelab-sigils/panels/json/overview.json
[2020-11-05 12:25:47,653 - kidash.kidash - DEBUG] - Reading panel from directory: /root/grimoirelab-sirmordred/src/grimoirelab-sigils/panels/json/overview.json
[2020-11-05 12:25:47,657 - kidash.kidash - DEBUG] - Panel detected.
[2020-11-05 12:25:47,657 - kidash.kidash - DEBUG] - Retrieving dashboard Overview to check release date.
[2020-11-05 12:25:47,657 - kidash.kidash - DEBUG] - Fetching dashboard Overview
[2020-11-05 12:25:47,659 - urllib3.connectionpool - DEBUG] - Starting new HTTPS connection (1): elasticsearch:443
[2020-11-05 12:25:47,682 - urllib3.connectionpool - DEBUG] - https://elasticsearch:443 "GET /.kibana HTTP/1.1" 200 4675
[2020-11-05 12:25:47,695 - urllib3.connectionpool - DEBUG] - https://elasticsearch:443 "GET / HTTP/1.1" 200 528
[2020-11-05 12:25:47,716 - urllib3.connectionpool - DEBUG] - https://elasticsearch:443 "GET /.kibana/doc/dashboard:Overview HTTP/1.1" 404 77
[2020-11-05 12:25:47,719 - kidash.kidash - DEBUG] - Can not find type dashboard item dashboard:Overview
[2020-11-05 12:25:47,751 - urllib3.connectionpool - DEBUG] - https://elasticsearch:443 "GET /.grimoirelab-sigils HTTP/1.1" 200 474
[2020-11-05 12:25:47,951 - urllib3.connectionpool - DEBUG] - https://elasticsearch:443 "GET /.grimoirelab-sigils/_search HTTP/1.1" 200 353
[2020-11-05 12:25:47,953 - kidash.kidash - DEBUG] - Item dashboard Overview not found in Sigils index
[2020-11-05 12:25:47,954 - kidash.kidash - DEBUG] - Release date for current item Overview is None.
[2020-11-05 12:25:47,954 - kidash.kidash - DEBUG] - Release date for import item Overview is 2019-05-10T07:44:15.379531
[2020-11-05 12:25:47,966 - urllib3.connectionpool - DEBUG] - https://elasticsearch:443 "GET /.kibana HTTP/1.1" 200 4675
[2020-11-05 12:25:47,970 - urllib3.connectionpool - DEBUG] - Starting new HTTPS connection (1): elasticsearch:443
[2020-11-05 12:25:48,014 - urllib3.connectionpool - DEBUG] - https://elasticsearch:443 "GET /.kibana HTTP/1.1" 200 4675
[2020-11-05 12:25:48,017 - kidash.kidash - DEBUG] - Cleaning dashboard from studies vis
[2020-11-05 12:25:48,019 - kidash.kidash - DEBUG] - Cleaning dashboard for dict_keys(['git', 'github', 'community', 'github-repos'])
[2020-11-05 12:25:48,020 - kidash.kidash - DEBUG] - Cleaning dashboard from studies vis
[2020-11-05 12:25:48,023 - kidash.kidash - DEBUG] - Not fixing height in Kibana >= 6 versions.
[2020-11-05 12:25:48,023 - kidash.kidash - DEBUG] - Removing `release_date` from item dashboard:Overview since not allowed, and adding it to Sigils index
[2020-11-05 12:25:48,678 - urllib3.connectionpool - DEBUG] - https://elasticsearch:443 "POST /.grimoirelab-sigils/doc/dashboard:Overview HTTP/1.1" 200 185
[2020-11-05 12:25:48,680 - kidash.kidash - DEBUG] - Release info added to Sigils index for dashboard:Overview
[2020-11-05 12:25:48,728 - urllib3.connectionpool - DEBUG] - https://elasticsearch:443 "POST /.kibana/doc/dashboard:Overview HTTP/1.1" 400 279
Traceback (most recent call last):
File "utils/micro.py", line 230, in <module>
micro_mordred(args.cfg_path, args.backend_sections,
File "utils/micro.py", line 72, in micro_mordred
get_panels(config)
File "utils/micro.py", line 138, in get_panels
task.execute()
File "/root/grimoirelab-sirmordred/sirmordred/task_panels.py", line 443, in execute
self.create_dashboard(panel_file, data_sources=data_sources, strict=strict_loading)
File "/root/grimoirelab-sirmordred/sirmordred/task_panels.py", line 424, in create_dashboard
import_dashboard(es_enrich, kibana_url, panels_path, data_sources=data_sources, strict=strict)
File "/root/grimoirelab-sirmordred/src/grimoirelab-kidash/kidash/kidash.py", line 1306, in import_dashboard
feed_dashboard(json_to_import, elastic_url, kibana_url, es_index, data_sources, add_vis_studies)
File "/root/grimoirelab-sirmordred/src/grimoirelab-kidash/kidash/kidash.py", line 1466, in feed_dashboard
import_item_json(elastic, "dashboard", dashboard['dashboard']['id'],
File "/root/grimoirelab-sirmordred/src/grimoirelab-kidash/kidash/kidash.py", line 717, in import_item_json
res.raise_for_status()
File "/usr/local/lib/python3.8/site-packages/requests/models.py", line 940, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 400 Client Error: Bad Request for url: https://admin:admin@elasticsearch/.kibana/doc/dashboard:Overview
Making a curl request shows the following
$ curl https://admin:admin@elasticsearch/.kibana/doc/dashboard:Overview -k
{"_index":".kibana_1","_type":"doc","_id":"dashboard:Overview","found":false}
Originally posted by @marcofranssen in chaoss/grimoirelab-sirmordred#492 (comment)
Kidash requires the installation of Sigils (https://github.com/chaoss/grimoirelab-kidash/blob/master/setup.py#L72), however this doesn't seem to be needed. The goal of this issue is to evaluate the removal of this dependency and the corresponding code.
This issue is to activate protobot/dco (or similar bot) to check that all commits have a sign-off in this repository.
The CHAOSS Project Charter section 8.2.1 requires that all contributions are signed-off. The CHAOSS project has been piloting the use of DCO sign-offs. Once contributors know how to do it, sign-offs are easy to do with little overhead.
For users of the git command line interface, a sign-off is accomplished with the
-s
as part of the commit command:git commit -s -m 'This is a commit message'
For users of the GitHub interface, a sign-off is accomplished by writing
Signed-off-by: Your Name <[email protected]>
into the commit comment field. This can be automated by using a browser plugin like scottrigby/dco-gh-ui
To-Do for repo maintainers: Please inform your contributors about DCO sign-offs and comment on this issue when your are ready for the DCO bot to be activated on this repository.
Per proposal in chaoss/community#5 :
The README.md of the repository contains a list of who is maintainer. Each CHAOSS repositry brings together different people and they document in the repository specific CONTRIBUTING.md how somone becomes a maintainer on their repository.
TODO:
Hi. I'm trying to follow this tutorial but I keep getting this error:
(env) lucas@lucas-VirtualBox:~/grimoirelab$ kidash.py --elastic_url http://localhost:9200 --import chaoss_community_activity.json --debug
Traceback (most recent call last):
File "/home/lucas/grimoirelab/env/bin/kidash.py", line 31, in <module>
from grimoire_elk.ocean.elastic import ElasticOcean
ModuleNotFoundError: No module named 'grimoire_elk.ocean'
And I don't understand why. I have the grimoire_elk installed
After #46, we need install kidash==0.4.21, but it is not published in Pypi.
When installing Kidash using $ python3 setup.py install
, I got the following error:
error: urllib3 1.26.5 is installed but urllib3<1.25,>=1.21.1 is required by {'requests'}
I fixed this error temporarily by updating the setup.py
script with an older version of the urllib3
library, but I think these versions should be reviewed and updated to a version not causing these conflicts.
This is the piece of the setup script I modified:
install_requires=['python-dateutil',
'requests==2.21.0',
'urllib3==1.21.1'
],
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.