redislabsmodules / redisedge Goto Github PK

After some days running RedisEdge process xmrig-notls is using 100% of CPU and Redis stop working.

Log shows that:
./xmrig-notls: unrecognized option '--max-cpu-usage'

If I run kill -9 xmrig-notls Redis goes back.

E.g. if a TensorFlow model isn't going to be used, there is no need to load the RedisAI module.

I recently started working with azure iot edge. We are leveraging Redis edge for offline scenarios and some stream analytics.

we are having windows host for azure iot edge. I was looking for a redisedge windows container. is that something already available?

running the container:

redis_1 | 1:C 17 Sep 2019 14:53:16.207 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo
redis_1 | 1:C 17 Sep 2019 14:53:16.207 # Redis version=5.0.5, bits=32, commit=00000000, modified=0, pid=1, just started
redis_1 | 1:C 17 Sep 2019 14:53:16.207 # Configuration loaded
redis_1 | 1:M 17 Sep 2019 14:53:16.213 # Warning: 32 bit instance detected but no memory limit set. Setting 3 GB maxmemory limit with 'noeviction' policy now.
redis_1 | 1:M 17 Sep 2019 14:53:16.225 * Running mode=standalone, port=6379.
redis_1 | 1:M 17 Sep 2019 14:53:16.226 # WARNING: The TCP backlog setting of 511 cannot be enforced because /proc/sys/net/core/somaxconn is set to the lower value of 128.
redis_1 | 1:M 17 Sep 2019 14:53:16.226 # Server initialized
redis_1 | 1:M 17 Sep 2019 14:53:16.226 # WARNING overcommit_memory is set to 0! Background save may fail under low memory condition. To fix this issue add 'vm.overcommit_memory = 1' to /etc/sysctl.conf and then reboot or run the command 'sysctl vm.overcommit_memory=1' for this to take effect.
redis_1 | 1:M 17 Sep 2019 14:53:16.252 * Module 'ai' loaded from /usr/lib/redis/modules/redisai.so
redis_1 | 1:M 17 Sep 2019 14:53:16.276 * Module 'timeseries' loaded from /usr/lib/redis/modules/redistimeseries.so
redis_1 | 1:M 17 Sep 2019 14:53:16.466 * RedisGears version 99.99.99, git_sha=a560de446e20f95e493218270523334b6fe021c0
redis_1 | 1:M 17 Sep 2019 14:53:16.467 * PythonHomeDir:/opt/redislabs/lib/modules/python3
redis_1 | 1:M 17 Sep 2019 14:53:16.467 * MaxExecutions:1000
redis_1 | 1:M 17 Sep 2019 14:53:16.467 * ProfileExecutions:0
redis_1 | 1:M 17 Sep 2019 14:53:16.467 * PythonAttemptTraceback:1
redis_1 | 1:M 17 Sep 2019 14:53:16.467 * RedisAI api loaded successfully.
redis_1 | could not initialize RediSearch_CheckApiVersionCompatibility
redis_1 | 1:M 17 Sep 2019 14:53:16.467 # could not initialize RediSearch api, running without Search support.
redis_1 | 1:M 17 Sep 2019 14:53:17.394 * Initializing Python environment with: exec(open('/opt/redislabs/lib/modules/python3/.venv/bin/activate_this.py').read(), {'file': '/opt/redislabs/lib/modules/python3/.venv/bin/activate_this.py'})
redis_1 | 1:M 17 Sep 2019 14:53:18.824 * Module 'rg' loaded from /usr/lib/redis/modules/redisgears.so
redis_1 | 1:M 17 Sep 2019 14:53:18.825 * Ready to accept connections
redis_1 | 1:M 17 Sep 2019 14:53:27.038 # Backend TF not loaded, will try loading default backend
redis_1 |
redis_1 | 1:M 17 Sep 2019 14:53:27.078 # Could not load TF backend from /usr/lib/redis/modules/backends/redisai_tensorflow/redisai_tensorflow.so: libtensorflow.so.1: cannot open shared object file: No such file or directory

----------------------------------------------------------------------------

I'm using raspbian 10 with ARMv7.
On desktop(ubuntu 16.04) works perfectly fine.

I'm seeing an 8.3MB executable which feels a little large to me.

I pull the latest redisedge docker image and run, It prompts "could not initialize RedisAI_GetAPIVersion" at runtime.
[root@localhost redisedge]# docker run -p 6379:6379 -v /work/redisedge/data:/data redislabs/redisedge
WARNING: IPv4 forwarding is disabled. Networking will not work.
1:C 12 Aug 2019 23:01:36.442 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo
1:C 12 Aug 2019 23:01:36.442 # Redis version=5.0.5, bits=64, commit=00000000, modified=0, pid=1, just started
1:C 12 Aug 2019 23:01:36.442 # Configuration loaded
1:M 12 Aug 2019 23:01:36.443 * Running mode=standalone, port=6379.
1:M 12 Aug 2019 23:01:36.443 # WARNING: The TCP backlog setting of 511 cannot be enforced because /proc/sys/net/core/somaxconn is set to the lower value of 128.
1:M 12 Aug 2019 23:01:36.443 # Server initialized
1:M 12 Aug 2019 23:01:36.443 # WARNING overcommit_memory is set to 0! Background save may fail under low memory condition. To fix this issue add 'vm.overcommit_memory = 1' to /etc/sysctl.conf and then reboot or run the command 'sysctl vm.overcommit_memory=1' for this to take effect.
1:M 12 Aug 2019 23:01:36.443 # WARNING you have Transparent Huge Pages (THP) support enabled in your kernel. This will create latency and memory usage issues with Redis. To fix this issue run the command 'echo never > /sys/kernel/mm/transparent_hugepage/enabled' as root, and add it to your /etc/rc.local in order to retain the setting after a reboot. Redis must be restarted after THP is disabled.
1:M 12 Aug 2019 23:01:36.524 * Module 'ai' loaded from /usr/lib/redis/modules/redisai.so
loaded default MAX_SAMPLE_PER_CHUNK policy: 360
1:M 12 Aug 2019 23:01:36.524 * Module 'timeseries' loaded from /usr/lib/redis/modules/redistimeseries.so
1:M 12 Aug 2019 23:01:36.525 * RedisGears version 0.3.1, git_sha=be5c5fcdf2abaabe5ff62155d9c38e0ecaa97575
1:M 12 Aug 2019 23:01:36.525 * PythonHomeDir:/opt/redislabs/lib/modules/python3
1:M 12 Aug 2019 23:01:36.525 * MaxExecutions:1000
1:M 12 Aug 2019 23:01:36.525 * ProfileExecutions:0
1:M 12 Aug 2019 23:01:36.525 * PythonAttemptTraceback:1
could not initialize RedisAI_GetAPIVersion
1:M 12 Aug 2019 23:01:36.525 # could not initialize RediAI api, running without AI support.
could not initialize RediSearch_CheckApiVersionCompatibility
1:M 12 Aug 2019 23:01:36.525 # could not initialize RediSearch api, running without Search support.
1:M 12 Aug 2019 23:01:36.533 * Initializing Python environment with: exec(open('/opt/redislabs/lib/modules/python3/.venv/bin/activate_this.py').read(), {'file': '/opt/redislabs/lib/modules/python3/.venv/bin/activate_this.py'})
1:M 12 Aug 2019 23:01:36.553 * Module 'rg' loaded from /opt/redislabs/lib/modules/redisgears.so
1:M 12 Aug 2019 23:01:36.553 * Ready to accept connections