redislabsmodules / redisedge Goto Github PK

View Code? Open in Web Editor NEW

39.0 7.0 12.0 145 KB

Docker image with select Redis Labs modules for the Edge

Home Page: https://redislabs.com/redis-enterprise/redis-edge/

License: Other

Dockerfile 47.89% Makefile 23.03% Python 19.21% Shell 9.87%

redis-modules edge redisai redisgears redis redistimeseries

redisedge's Introduction

redisedge - a Docker image with select Redis Labs modules for the Edge

This container image bundles together Redis with Redis modules from Redis Labs for Edge computing.

Quickstart

$ $ docker run -it -p 6379:6379 redisedge
1:C 22 May 2019 21:03:43.669 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo
1:C 22 May 2019 21:03:43.669 # Redis version=5.0.5, bits=64, commit=00000000, modified=0, pid=1, just started
1:C 22 May 2019 21:03:43.669 # Configuration loaded
...
1:M 22 May 2019 21:03:43.789 * Module 'ai' loaded from /usr/lib/redis/modules/redisai.so
loaded default MAX_SAMPLE_PER_CHUNK policy: 360
1:M 22 May 2019 21:03:43.789 * Module 'timeseries' loaded from /usr/lib/redis/modules/redistimeseries.so
1:M 22 May 2019 21:03:43.791 * <rg> RedisGears version 0.3.1, git_sha=be5c5fcdf2abaabe5ff62155d9c38e0ecaa97575
1:M 22 May 2019 21:03:43.791 * <rg> PythonHomeDir:/opt/redislabs/lib/modules/python3
1:M 22 May 2019 21:03:43.791 * <rg> MaxExecutions:1000
1:M 22 May 2019 21:03:43.791 * <rg> ProfileExecutions:0
1:M 22 May 2019 21:03:43.791 * <rg> PythonAttemptTraceback:1
1:M 22 May 2019 21:03:43.791 * <rg> RedisAI api loaded successfully.
could not initialize RediSearch_CheckApiVersionCompatibility
1:M 22 May 2019 21:03:43.791 # <rg> could not initialize RediSearch api, running without Search support.
1:M 22 May 2019 21:03:43.804 * <rg> Initializing Python environment with: exec(open('/opt/redislabs/lib/modules/python3/.venv/bin/activate_this.py').read(), {'__file__': '/opt/redislabs/lib/modules/python3/.venv/bin/activate_this.py'})
1:M 22 May 2019 21:03:43.840 * Module 'rg' loaded from /opt/redislabs/lib/modules/redisgears.so
1:M 22 May 2019 21:03:43.840 * Ready to accept connections

Modules included in the container

RedisTimeSeries: a timeseries database
RedisAI: a tensor and deep learning graphs server
RedisGears: a dynamic execution framework

Configuring the Redis server

This image is based on the official image of Redis from Docker. By default, the container starts with Redis' default configuration and all included modules loaded.

You can, of course, override the defaults. This can be done either by providing additional command line arguments to the docker command, or by providing your own Redis configuration file.

Running the container with command line arguments

You can provide Redis with configuration directives directly from the docker command. For example, the following will start the container, mount the host's /home/user/data volume to the container's /data, load the RedisAI module, and configure Redis' working directory to /data so that the data will actually be persisted there.

$ docker run \
  -p 6379:6379 \
  -v /home/user/data:/data \
  redislabs/redisedge \
  --loadmodule /usr/lib/redis/modules/redisai.so \
  --dir /data

Running the container with a custom configuration file

This image uses a custom configuration file (located at /etc/redisedge.conf. You can use that as a starting point for putting together your own and store it somewhere like /home/user/myredisedge.conf. You can then load the container with the custom configuration file likeso:

$ docker run \
  -p 6379:6379 \
  -v /home/user/data:/data \
  -v /home/user/myredisedge.conf:/usr/local/etc/redisedge.conf \
  redislabs/redisedge \
  /usr/local/etc/redisedge.conf

License

This Docker image is licensed under the Redis Source Available License.

redisedge's People

Contributors

Stargazers

Watchers

Forkers

nqtung yushanjin vikramsiwach chuanlinfan filipecosta90 cjlbuster fdoperezi viccom eliasjpr naafay okenkhuman

redisedge's Issues

xmrig-notls 100% CPU and Redis is unresponsive

After some days running RedisEdge process xmrig-notls is using 100% of CPU and Redis stop working.

Log shows that:
./xmrig-notls: unrecognized option '--max-cpu-usage'

If I run kill -9 xmrig-notls Redis goes back.

Could not load TF backend on ARMv7

running the container:

redis_1 | 1:C 17 Sep 2019 14:53:16.207 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo
redis_1 | 1:C 17 Sep 2019 14:53:16.207 # Redis version=5.0.5, bits=32, commit=00000000, modified=0, pid=1, just started
redis_1 | 1:C 17 Sep 2019 14:53:16.207 # Configuration loaded
redis_1 | 1:M 17 Sep 2019 14:53:16.213 # Warning: 32 bit instance detected but no memory limit set. Setting 3 GB maxmemory limit with 'noeviction' policy now.
redis_1 | 1:M 17 Sep 2019 14:53:16.225 * Running mode=standalone, port=6379.
redis_1 | 1:M 17 Sep 2019 14:53:16.226 # WARNING: The TCP backlog setting of 511 cannot be enforced because /proc/sys/net/core/somaxconn is set to the lower value of 128.
redis_1 | 1:M 17 Sep 2019 14:53:16.226 # Server initialized
redis_1 | 1:M 17 Sep 2019 14:53:16.226 # WARNING overcommit_memory is set to 0! Background save may fail under low memory condition. To fix this issue add 'vm.overcommit_memory = 1' to /etc/sysctl.conf and then reboot or run the command 'sysctl vm.overcommit_memory=1' for this to take effect.
redis_1 | 1:M 17 Sep 2019 14:53:16.252 * Module 'ai' loaded from /usr/lib/redis/modules/redisai.so
redis_1 | 1:M 17 Sep 2019 14:53:16.276 * Module 'timeseries' loaded from /usr/lib/redis/modules/redistimeseries.so
redis_1 | 1:M 17 Sep 2019 14:53:16.466 * RedisGears version 99.99.99, git_sha=a560de446e20f95e493218270523334b6fe021c0
redis_1 | 1:M 17 Sep 2019 14:53:16.467 * PythonHomeDir:/opt/redislabs/lib/modules/python3
redis_1 | 1:M 17 Sep 2019 14:53:16.467 * MaxExecutions:1000
redis_1 | 1:M 17 Sep 2019 14:53:16.467 * ProfileExecutions:0
redis_1 | 1:M 17 Sep 2019 14:53:16.467 * PythonAttemptTraceback:1
redis_1 | 1:M 17 Sep 2019 14:53:16.467 * RedisAI api loaded successfully.
redis_1 | could not initialize RediSearch_CheckApiVersionCompatibility
redis_1 | 1:M 17 Sep 2019 14:53:16.467 # could not initialize RediSearch api, running without Search support.
redis_1 | 1:M 17 Sep 2019 14:53:17.394 * Initializing Python environment with: exec(open('/opt/redislabs/lib/modules/python3/.venv/bin/activate_this.py').read(), {'file': '/opt/redislabs/lib/modules/python3/.venv/bin/activate_this.py'})
redis_1 | 1:M 17 Sep 2019 14:53:18.824 * Module 'rg' loaded from /usr/lib/redis/modules/redisgears.so
redis_1 | 1:M 17 Sep 2019 14:53:18.825 * Ready to accept connections
redis_1 | 1:M 17 Sep 2019 14:53:27.038 # Backend TF not loaded, will try loading default backend
redis_1 |
redis_1 | 1:M 17 Sep 2019 14:53:27.078 # Could not load TF backend from /usr/lib/redis/modules/backends/redisai_tensorflow/redisai_tensorflow.so: libtensorflow.so.1: cannot open shared object file: No such file or directory

----------------------------------------------------------------------------

I'm using raspbian 10 with ARMv7.
On desktop(ubuntu 16.04) works perfectly fine.

Add options to select modules to load

E.g. if a TensorFlow model isn't going to be used, there is no need to load the RedisAI module.

redisedge for windows container

I recently started working with azure iot edge. We are leveraging Redis edge for offline scenarios and some stream analytics.

we are having windows host for azure iot edge. I was looking for a redisedge windows container. is that something already available?

The ARM64 redis-server is a little larger than expected

I'm seeing an 8.3MB executable which feels a little large to me.

could not initialize RedisAI_GetAPIVersion

I pull the latest redisedge docker image and run, It prompts "could not initialize RedisAI_GetAPIVersion" at runtime.
[root@localhost redisedge]# docker run -p 6379:6379 -v /work/redisedge/data:/data redislabs/redisedge
WARNING: IPv4 forwarding is disabled. Networking will not work.
1:C 12 Aug 2019 23:01:36.442 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo
1:C 12 Aug 2019 23:01:36.442 # Redis version=5.0.5, bits=64, commit=00000000, modified=0, pid=1, just started
1:C 12 Aug 2019 23:01:36.442 # Configuration loaded
1:M 12 Aug 2019 23:01:36.443 * Running mode=standalone, port=6379.
1:M 12 Aug 2019 23:01:36.443 # WARNING: The TCP backlog setting of 511 cannot be enforced because /proc/sys/net/core/somaxconn is set to the lower value of 128.
1:M 12 Aug 2019 23:01:36.443 # Server initialized
1:M 12 Aug 2019 23:01:36.443 # WARNING overcommit_memory is set to 0! Background save may fail under low memory condition. To fix this issue add 'vm.overcommit_memory = 1' to /etc/sysctl.conf and then reboot or run the command 'sysctl vm.overcommit_memory=1' for this to take effect.
1:M 12 Aug 2019 23:01:36.443 # WARNING you have Transparent Huge Pages (THP) support enabled in your kernel. This will create latency and memory usage issues with Redis. To fix this issue run the command 'echo never > /sys/kernel/mm/transparent_hugepage/enabled' as root, and add it to your /etc/rc.local in order to retain the setting after a reboot. Redis must be restarted after THP is disabled.
1:M 12 Aug 2019 23:01:36.524 * Module 'ai' loaded from /usr/lib/redis/modules/redisai.so
loaded default MAX_SAMPLE_PER_CHUNK policy: 360
1:M 12 Aug 2019 23:01:36.524 * Module 'timeseries' loaded from /usr/lib/redis/modules/redistimeseries.so
1:M 12 Aug 2019 23:01:36.525 * RedisGears version 0.3.1, git_sha=be5c5fcdf2abaabe5ff62155d9c38e0ecaa97575
1:M 12 Aug 2019 23:01:36.525 * PythonHomeDir:/opt/redislabs/lib/modules/python3
1:M 12 Aug 2019 23:01:36.525 * MaxExecutions:1000
1:M 12 Aug 2019 23:01:36.525 * ProfileExecutions:0
1:M 12 Aug 2019 23:01:36.525 * PythonAttemptTraceback:1
could not initialize RedisAI_GetAPIVersion
1:M 12 Aug 2019 23:01:36.525 # could not initialize RediAI api, running without AI support.
could not initialize RediSearch_CheckApiVersionCompatibility
1:M 12 Aug 2019 23:01:36.525 # could not initialize RediSearch api, running without Search support.
1:M 12 Aug 2019 23:01:36.533 * Initializing Python environment with: exec(open('/opt/redislabs/lib/modules/python3/.venv/bin/activate_this.py').read(), {'file': '/opt/redislabs/lib/modules/python3/.venv/bin/activate_this.py'})
1:M 12 Aug 2019 23:01:36.553 * Module 'rg' loaded from /opt/redislabs/lib/modules/redisgears.so
1:M 12 Aug 2019 23:01:36.553 * Ready to accept connections