misp / x_old_misp_docker Goto Github PK

MISP Docker (XME edition)

Shell 98.06% Dockerfile 1.94%

x_old_misp_docker's Introduction

Hello potential user/contributor

This project is outside of the main MISP umbrella and does not have much community traction/use. As such it has not seen any love in a long time. This also means using the code in this repository is not recommended for users new to MISP.

Alternatives to this repository may be

Be aware that general issues in this repository will most likely not be acted upon - however, pull requests are mostly welcome.

MISP Docker

The files in this repository are used to create a Docker container running a MISP ("Malware Information Sharing Platform") instance.

I rewrote the Docker file to split the components in multiple containers (which is more in the philosophy of Docker). Therefore there is no longer a Dockerfile in the root directory.

The MISP container needs at least a MySQL container to store the data. By default it listen to port 443 and port 80, which is redirected to 443.

The build is based on Ubuntu and will install all the required components, using the INSTALL script provided in the MISP repository.

Using the Install script has the advantage that we can rely on a tested installation routine which is maintained and kept up to date. The amount of custom work to be done in the Dockerfile and run.sh files is limited to the necessary to make MISP container compliant.

The following configuration steps are performed automatically:

Reconfiguration of the base URL in config.php
Generation of a new salt in config.php
Generation of a self-signed certificate
Optimization of the PHP environment (php.ini) to match the MISP recommended values
Creation of the MySQL database
Generation of the admin PGP key
Installation of misp modules

Building your image

Fetch files

$ git clone https://github.com/MISP/misp-docker
$ cd misp-docker
# Copy template.env to .env (on the root directory) and edit the environment variables at .env file
$ cp template.env .env
$ vi .env

Build the containers

$ docker-compose build
or
$ docker-compose -f docker-compose.yml build

Run containers

$ docker-compose up
or
$ docker-compose -f docker-compose.yml up

x_old_misp_docker's People

Contributors

Stargazers

Watchers

Forkers

arnydo grem25 dlee35 txdpscs floatingghost irenad miroka96 dafal abderem johnofsaints rets66 cyhook sgnls darshanparab yaleman vulnerabivoro sherifeldeeb oxeeql steveclement offgithub thesimplestuff nadaj v0idc0de attackgithub moshemal pe3zx jakubd ramzez001 equ1n0x93 far-light challs yabeow cah-ron-varghese umbraesoulsbane remg427 swarajd icepaule marcredhat c0denician gzhaocn xyrodileas pimmytrousers sts0mrg0 kortho sixcom cybermaggedon milesflo digimetrica viliusdidit freddyfernando stevengoossensb ci-soc lorenzobaesso asc6 itzdan jscoupreman walt1998 15012700225 5l1v3r1 marcelosz nizq kpipertest53 dantedevil89 sycophantic dmeulen mdulce18 ltnicles c0a3bd tdefise helinko hilt86 dekoder vwvvw cudeso kzajac-ims attoegg gmocorreamartinez phat3 ckane aziizz evayiyang rkoconnor extra2000 viris p1nk-p0nk ekmixon mentalburden callieguenther joker72655561 fritterhoff digitalarche yoan-arley atomebr d-demirci rh-isac greenmind-sec code-printer rpnull ktb-jcm mpryc

x_old_misp_docker's Issues

Internal Error first page on new build

I had this running previously. I just pulled the newest and updated the docker-compose with everything I need. When it starts up, only page is Errors. I have tried to find the error and can't find the issue anywhere. Watching misp_web during attempted access shows no errors. Everything is expected as far as components start up. No errors during build or startup.

host not found in upstream "misp-web"

When running

docker-compose -f docker-compose-nginx.yml up

proxy    | nginx: [emerg] host not found in upstream "misp-web" in /etc/nginx/conf.d/default.conf:18
proxy exited with code 1

MISP behind Traefik

Hi,
I'm trying to serve MISP using Traefik as reverse proxy, but I can't seem to get it to work.
When I try to connect to https://test.local/misp I'm redirected to https://test/

This is my docker-compose.yml:

version: '3'

networks:
  proxy:
    external: true
  internal:
    external: false


services:
  web:
    build: web
    depends_on:
      - db
    container_name: misp_web
    image: misp:latest
    restart: unless-stopped
    volumes:
      - /dev/urandom:/dev/random
      - ${DATA_DIR}/web:/var/www/MISP
    environment:
      - MYSQL_HOST=db
      - MYSQL_DATABASE=${MYSQL_DATABASE}
      - MYSQL_USER=${MYSQL_USER}
      - MYSQL_PASSWORD=${MYSQL_PASSWORD}
      - MISP_ADMIN_EMAIL=${MISP_ADMIN_EMAIL}
      - MISP_ADMIN_PASSPHRASE=${MISP_ADMIN_PASSPHRASE}
      - MISP_BASEURL=${MISP_BASEURL}
      - POSTFIX_RELAY_HOST=${POSTFIX_RELAY_HOST}
      - TIMEZONE=${TIMEZONE}
    labels:
      - traefik.backend = misp
      - traefik.frontend.rule=Host:test.local;PathPrefixStrip:/misp
      - traefik.docker.network=proxy
      - traefik.port=443
    networks:
      - internal
      - proxy

  db:
    container_name: misp_db
    image: mysql/mysql-server:5.7
    restart: unless-stopped
    volumes:
      - ${DATA_DIR}/db:/var/lib/mysql
    environment:
      - MYSQL_DATABASE=${MYSQL_DATABASE}
      - MYSQL_USER=${MYSQL_USER}
      - MYSQL_PASSWORD=${MYSQL_PASSWORD}
      - MYSQL_ROOT_PASSWORD=${MYSQL_ROOT_PASSWORD}

and this is my .env :

MYSQL_DATABASE=misp
MYSQL_USER=misp
MYSQL_PASSWORD=misp
MYSQL_ROOT_PASSWORD=misp

[email protected]
MISP_ADMIN_PASSPHRASE=admin
MISP_BASEURL=test.local/misp

POSTFIX_RELAY_HOST=relay.fqdn
TIMEZONE=Europe/Rome

DATA_DIR=./data

Can someone help me?

Internal Server Error

2019-05-20 11:38:38 Error: [MissingConnectionException] Database connection "Mysql" is missing, or could not be created.
Exception Attributes: array (
'class' => 'Mysql',
'message' => 'SQLSTATE[HY000] [2002] No such file or directory',
'enabled' => true,

anyone is familiar with that?

Unable to list modules

Hi!

I'm trying to access the http://<host>/modules endpoint but get a

"error": "Something went wrong, no response from misp_modules."

Is there something I need to enable in order to have it running?

Cheers

Live Dashboard missing

Hi,
I'm trying this image and it's very handly and easy to install.
By the way I'd like to use also the LiveDashboard, but it seems it's not here.

Is there a way to create another container/image with the dashboard?

I tried to install it both inside the image and also outside as a separate container but it seems MISP didn't spawn on port 50000 and dashboard can't see logs

Could not install postfix on dockercontainer

I run into issue when i try to docker-compose build out of the fresh repo on a CentOS host

setting myhostname: c7b9b729660b.blahblah.io.
setting alias maps
setting alias database
mailname is not a fully qualified domain name.  Not changing /etc/mailname.
setting destinations: $myhostname, c7b9b729660b, localhost.localdomain, , localhost
setting relayhost:
setting mynetworks: 127.0.0.0/8 [::ffff:127.0.0.0]/104 [::1]/128
setting mailbox_size_limit: 0
setting recipient_delimiter: +
setting inet_interfaces: all
setting inet_protocols: all
/etc/aliases does not exist, creating it.
WARNING: /etc/aliases exists, but does not have a root alias.

Postfix is now set up with a default configuration.  If you need to make
changes, edit
/etc/postfix/main.cf (and others) as needed.  To view Postfix configuration
values, see postconf(1).

After modifying main.cf, be sure to run '/etc/init.d/postfix reload'.

Running newaliases
newaliases: warning: valid_hostname: misplaced delimiter: c7b9b729660b.blahblah.io.
newaliases: fatal: file /etc/postfix/main.cf: parameter myhostname: bad parameter value: c7b9b729660b.blahblah.io.
dpkg: error processing package postfix (--configure):
 subprocess installed post-installation script returned error exit status 75
Processing triggers for libc-bin (2.23-0ubuntu10) ...
Processing triggers for systemd (229-4ubuntu21.5) ...
Errors were encountered while processing:
 postfix
E: Sub-process /usr/bin/dpkg returned an error code (1)
ERROR: Service 'misp-web' failed to build: The command '/bin/sh -c apt-get install -y postfix' returned a non-zero code: 100

I removed the postfix installation and it worked.
Do i need postfix?

How to Update MISP Docker Images/Container

How can one update the images and containers without loosing past data, I tried updating it from the web Interface but it is not working.

move to docker-compose v 3.7

Why not upgrading docker-compose file version

Initial build failes

I just attempted to build version 3e62c9d but it fails step 52:

Step 52/147 : RUN php -r "if (hash_file('sha384', 'composer-setup.php') === 'a5c698ffe4b8e849a443b120cd5ba38043260d5c4023dbf93e1558871f1f07f58274fc6f4c93bcfd858c6bd0775cd8d1') { echo 'Installer verified'; } else { echo 'Installer corrupt'; unlink('composer-setup.php'); } echo PHP_EOL;"
 ---> Running in 58a0783ef7ab
Installer corrupt
Removing intermediate container 58a0783ef7ab
 ---> e62f527096d9
Step 53/147 : RUN php composer-setup.php
 ---> Running in 99c652af7faa
Could not open input file: composer-setup.php
ERROR: Service 'web' failed to build: The command '/bin/sh -c php composer-setup.php' returned a non-zero code: 1

DockerFile error / RUN php composer.phar install

When i try to build with docker-compose -f "misp/docker-compose.yml up -d --build", i got an error on step 48 : RUN php composer.phar install --ignore-platform-reqs

Loading composer repositories with package information
Updating dependencies (including require-dev)

                                                                                           
  [ErrorException]                                                                         
  "continue" targeting switch is equivalent to "break". Did you mean to use "continue 2"?  
                                                                                           

install [--prefer-source] [--prefer-dist] [--dry-run] [--dev] [--no-dev] [--no-custom-installers] [--no-autoloader] [--no-scripts] [--no-progress] [--no-suggest] [-v|vv|vvv|--verbose] [-o|--optimize-autoloader] [-a|--classmap-authoritative] [--ignore-platform-reqs] [--] [<packages>]...

I added this code into Dockerfile before using php composer.phar

# FIX COMPOSER
RUN php -r "copy('https://getcomposer.org/installer', 'composer-setup.php');"
RUN php -r "if (hash_file('sha384', 'composer-setup.php') === '48e3236262b34d30969dca3c37281b3b4bbe3221bda826ac6a9a62d6444cdb0dcd0615698a5cbe587c3f0fe57a54d8f5') { echo 'Installer verified'; } else { echo 'Installer corrupt'; unlink('composer-setup.php'); } echo PHP_EOL;"
RUN php composer-setup.php
RUN php -r "unlink('composer-setup.php');"
# END FIX

I found this code here : PHP 7.3 breaks composer with continue/targeting error

Building from scratch results in "An Internal Error Has Occurred." if MYSQL_DATABASE is changed

Trying to build the docker images via docker-compose build produces a MISP instance that displays "An Internal Error Has Occurred.".
The db and web containers are running and the passwords seem to work (logging in with the defined db user and pw on the db container works as intended).
I did, however, find the following lines in the mysqld.log:

2019-07-13T07:08:02.232121Z 8 [Note] Access denied for user 'mispusr'@'%' to database 'misp'

It seems something does not respect the MYSQL_DATABASE variable, as I have renamed the DB to something different (on both, the db and the web container).

Edit: Leaving all environment vars untouched produces a running image. Changing any of them results in "An Internal Error Has Occured".

Environment:

Built on Debian 9 (stretch)
MySQL Docker Image 5.7.26-1.1.11
misp-docker checked out on 12.07.2019 (commit b1cb415)
docker-compose version 1.24.1, build 4667896b
Docker version 18.09.7, build 2d0083d

PPA for PHP no longer active

in web/Dockerfile, there is this PPA
add-apt-repository -y ppa:ondrej/php && apt-get update

but it no longer available. What PPA should be used as replacement?

TT

this is a great project, thanks for all the suports of you.

No Dockerfile in the git

Hi,
Received below error when following instruction in the Readme.md

padisetu@hostname001:/MISP> git clone https://github.com/MISP/misp-docker
Cloning into 'misp-docker'...
remote: Counting objects: 88, done.
remote: Total 88 (delta 0), reused 0 (delta 0), pack-reused 88
Unpacking objects: 100% (88/88), done.
padisetu@hostname001:/MISP> cd misp-docker/
padisetu@hostname001:~/MISP/misp-docker> docker build -t misp .
unable to prepare context: unable to evaluate symlinks in Dockerfile path: lstat /home/padisetu/MISP/misp-docker/Dockerfile: no such file or directory

Can you help with instructions to install this docker image?
Thanks
Uma

misp-proxy - HTTPS request redirect to HTTP response

Hi,

I'm trying to configure misp-proxy to ensure all is transmited securely using https.
However, if you make a https request, it always respondes with http page. For example:

httpS://localhost redirects to http://localhost/users/login
httpS://localhost/users/logout redirects to http://localhost/users/login
...

One https request gets an http redirection.

I appreciate any help.

Thanks.

cannot build under CentOS7

Php mysql plugin missing

I build the image without errors but the following error shows up

Error: [MissingConnectionException] Database connection "Mysql" is missing, or could not be created. Exception Attributes: array ( 'class' => 'Mysql', 'message' => 'Selected driver is not enabled', 'enabled' => false, )

It can be fixed by installing php7.3-mysql and restarting the container
Should this be added in the Dockerfile too or does the script need to be updated?

OpenCV Python Lib - Dependency Missing

Following was experienced during building of docker MISP inside ubuntu/bionic.

Collecting opencv-python==4.4.0.44 (from -r REQUIREMENTS (line 56))
  Downloading https://files.pythonhosted.org/packages/38/a9/cd39fd25df434b5d9451dc266c12b72f68282a2b9bd5d7b4aa2d57d6c20e/opencv-python-4.4.0.44.tar.gz (88.9MB)
    Complete output from command python setup.py egg_info:
    Traceback (most recent call last):
      File "<string>", line 1, in <module>
      File "/tmp/pip-build-fcrux1i_/opencv-python/setup.py", line 9, in <module>
        import skbuild
    ModuleNotFoundError: No module named 'skbuild'

After some troubleshooting, adding the following resolves this missing dependency;

pip3 install --upgrade pip setuptools wheel && \
pip3 install scikit-build && \    
pip3 install opencv-python && \

Build fails at Step 50/147: RUN php -r "if (hash_file('sha384 ...

Error:
/bin/sh: 1: Syntax error: Unterminated quoted string
ERROR: Service 'web' failed to build: The command '/bin/sh -c php -r "if (hash_file('sha384', 'composer-setup.php') === '48e3236262b34d30969dca3c37281b3b4bbe3221bda826ac6a9$' returned a non-zero code: 2

FULL docker build output: https://pastebin.com/raw/GqHv8xAL

License?

Hi!

We'd like to use this and contribute improvements, but I'm unable to find any license associated with this content.

A brief reading of the repo is that the content here derives from this repository which itself derived from an original that I can't find.

Can you help by figuring this out by adding a license to this repository's content?

Build failed due to incorrect hash in web/Dockerfile

Ran through the build a few times. Found the error to be with the hash of the file. Pulled the compose file down locally and ran a hash of it. Checked the hash against their docs, it matches up. The new hash is a5c698ffe4b8e849a443b120cd5ba38043260d5c4023dbf93e1558871f1f07f58274fc6f4c93bcfd858c6bd0775cd8d1

Once I corrected the hash in step 51/144, installation completed correctly.

Problem building containers

HI,

I had problem while i was building the containers.

I resolved it by adding to " web/Dockerfile" file commands attached below before install python-cybox:
RUN pip install --upgrade pip
RUn pip install --upgrade setuptools

Regards,

Increase RAM and CPU

I would like to increase specs for the MISP container as it is starting to feel sluggish. Is there any way how to increase RAM and CPU and all to get the most out of my system?

missing python-dateutil

Hello MISP-team,

1st, thanks for the great work you're doing. I love MISP. :-)

While having trouble using the docker file, I found that I had to add python-dateutil at line 43 to be installed with apt in the web/Dockerfile to install and run correctly.

Maybe you'd like to verify and adjust accordingly.

Cheers
Marcus

python module SocketIO-client fails to build due to invalid character in readme.rst causing cascading failures

Collecting socketio-client==0.5.6
  Downloading socketIO-client-0.5.6.tar.gz (12 kB)
    ERROR: Command errored out with exit status 1:
     command: /usr/bin/python3 -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-rd82duxw/socketio-client/setup.py'"'"'; __file__='"'"'/tmp/pip-install-rd82duxw/socketio-client/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info --egg-base /tmp/pip-pip-egg-info-3x1qteoz
         cwd: /tmp/pip-install-rd82duxw/socketio-client/
    Complete output (7 lines):
    Traceback (most recent call last):
      File "<string>", line 1, in <module>
      File "/tmp/pip-install-rd82duxw/socketio-client/setup.py", line 6, in <module>
        README = open(os.path.join(here, 'README.rst')).read()
      File "/usr/lib/python3.6/encodings/ascii.py", line 26, in decode
        return codecs.ascii_decode(input, self.errors)[0]
    UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 5786: ordinal not in range(128)
    ----------------------------------------
ERROR: Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output.

Jörgen (line 159 of README.rst)

The above error occurs on a completely clean ubuntu 18 LTS install, using the repo's build script with sane values in the variables of the script. I think, as it turns out, its a name in the credits:

invisibleroads/socketIO-client@a42704e#diff-88b99bb28683bd5b7e3a204826ead112R159

Problem building the web image - lxml fails to compile

When I try to build the images with docker-compose build it errors out with the following message.

Building lxml version 4.4.1.
Building without Cython.
Using build configuration of libxslt 1.1.28
ERROR: /usr/bin/xslt-config: 1: /usr/bin/xslt-config: xml2-config: not found

** make sure the development packages of libxml2 and libxslt are installed **

Compile failed: command 'x86_64-linux-gnu-gcc' failed with exit status 1
error: Setup script exited with error: command 'x86_64-linux-gnu-gcc' failed with exit status 1
ERROR: Service 'web' failed to build: The command '/bin/sh -c python setup.py install' returned a non-zero code: 1

It seems that the correct development libraries are being installed via the Dockerfile. I'm currently troubleshooting it, to my best availability, but thought I'd open an issue here in case it's an known issue?

firstboot runs everytime

Because of this line:
https://github.com/MISP/misp-docker/blob/master/web/run.sh#L137

First boot will run everytime.

Is this intended?

If it's not, could cook up a PR that simply checks for the presence of the .gnupg folder to run firstboot.

misp-modules missing dependancies

misp-modules doesn't start due to missing dependencies.

Output when attempting to start manually:

$ sudo docker exec -ti misp_web /bin/bash
root@be6bd314f95b:/var/www/MISP# cd /opt/misp-modules/
root@be6bd314f95b:/opt/misp-modules# sudo -u www-data misp-modules -s -l 127.0.0.1
Unable to find zbar shared library
2020-02-25 01:13:35,723 - misp-modules - INFO - Launch MISP modules server from package.
INFO:misp-modules:Launch MISP modules server from package.
2020-02-25 01:13:35,727 - misp-modules - INFO - Helper loaded cache
INFO:misp-modules:Helper loaded cache
2020-02-25 01:13:35,727 - misp-modules - INFO - Unable to load MISP modules from package.
INFO:misp-modules:Unable to load MISP modules from package.

Additional errors are identified when running misp-modules without -s:

# sudo -u www-data misp-modules -l 127.0.0.1
Unable to find zbar shared library
...
2020-02-25 01:13:46,395 - misp-modules - WARNING - MISP modules ocr_enrich failed due to libSM.so.6: cannot open shared object file: No such file or directory
WARNING:misp-modules:MISP modules ocr_enrich failed due to libSM.so.6: cannot open shared object file: No such file or directory
...
2020-02-25 01:13:47,388 - misp-modules - WARNING - MISP modules qrcode failed due to Unable to find zbar shared library
WARNING:misp-modules:MISP modules qrcode failed due to Unable to find zbar shared library
...
2020-02-25 01:13:47,651 - misp-modules - WARNING - MISP modules ransomcoindb failed due to No module named 'expansion._ransomcoindb'
WARNING:misp-modules:MISP modules ransomcoindb failed due to No module named 'expansion._ransomcoindb'
...
2020-02-25 01:13:47,793 - misp-modules - WARNING - MISP modules email_import failed due to Unable to import URLObject, pyfaup missing
WARNING:misp-modules:MISP modules email_import failed due to Unable to import URLObject, pyfaup missing

Issue with run.sh replacement of baseurl

run.sh doesn't replacing baseurl, as default value is 'http://misp'

Modified the sed command as shown below

Existing Command:
sed -ie "s/'baseurl' => '',/'baseurl' => '$MISP_BASEURL sfd',/" /var/www/MISP/app/Config/config.php

Replacement Command:
sed -ie "s/'baseurl' => '.*',/'baseurl' => '$MISP_BASEURL sfd',/" /var/www/MISP/app/Config/config.php

Unable to Login

Hello!

Even though I modified the MISP_ADMIN_PASSPHRASE variable, I was not able to login using the password specified there.

Instead the default credentials were working (taken from this issue: MISP/MISP#2602):
[email protected]:admin

This could be connected to the password requirements, which seem very complex to me and make it even hard to change the password after a successful login.

Please add this issue at least to the readme.

BR,
Miroka

Splitting out DB to separate container?

Is there any reason why the DB can't be split in to a separate container?

MISP cannot connect to MySQL database

Hi,

When bringing up the suite through docker-compose up I am hitting the wall with error message from MISP:

│misp-web    | ERROR 1045 (28000): Access denied for user 'misp'@'172.18.0.3' (using password: YES)

I've tried privileges flushing as it was when Dockerfile was still available in @xme repo, however I cannot even login to mysql database using:

docker exec -ti misp-db mysql -p

or:

docker exec -ti misp-db mysql -u root -p

Did anyone also have such problem?

run.sh doesn't work

https://github.com/MISP/misp-docker/blob/ac4734d077d0d7c6ff2e6cf61d83c5a9e006a6de/web/run.sh#L125

There is an errant quote on that line which causes an error when the container starts

/run.sh: line 141: unexpected EOF while looking for matching `"'

Unable to import exported MISP events as XML

I recently updated the MISP project from 2.4.105 to 2.4.120 and I am unable to import the exported events as it is showing the following error:
2020-02-18 06:00:26 Error: [XmlException] Xml cannot be read.
Request URL: /events/add_misp_export
Stack Trace:
#0 /var/www/MISP/app/Lib/cakephp/lib/Cake/Utility/Xml.php(107): Xml::_loadXml('<?xml version="...', Array)
#1 /var/www/MISP/app/Controller/EventsController.php(3194): Xml::build('<?xml version="...')
#2 /var/www/MISP/app/Controller/EventsController.php(2135): EventsController->_addMISPExportFile('xml', false, '1')
#3 [internal function]: EventsController->add_misp_export()
#4 /var/www/MISP/app/Lib/cakephp/lib/Cake/Controller/Controller.php(499): ReflectionMethod->invokeArgs(Object(EventsController), Array)
#5 /var/www/MISP/app/Lib/cakephp/lib/Cake/Routing/Dispatcher.php(193): Controller->invokeAction(Object(CakeRequest))
#6 /var/www/MISP/app/Lib/cakephp/lib/Cake/Routing/Dispatcher.php(167): Dispatcher->_invoke(Object(EventsController), Object(CakeRequest))
#7 /var/www/MISP/app/webroot/index.php(92): Dispatcher->dispatch(Object(CakeRequest), Object(CakeResponse))
#8 {main}

I have changed buffer memory and max upload to 5G for now in the php.ini file.
Can anyone help me?
Thank you in advance.

misp-modules REQUIREMENTS Empty

Line 157 of web/Dockerfile results in an empty REQUIREMENTS file.

RUN cat REQUIREMENTS | sed 's/aiohttp==3.4.4/aiohttp/g' > REQUIREMENTS

Should be:

RUN sed -i 's/aiohttp==3.4.4/aiohttp/g' REQUIREMENTS

Unfortunately it looks like the current REQUIREMENTS is broken so this results in a failed build.

This appears to be resolved in #51

MiSP dockerized fails with automatic update

It appears that the update feature of MiSP in the misp-docker containers is broken.

Error appears on the UI as below:

It is traced to the following line in the docker container script: https://github.com/MISP/misp-docker/blob/6cdefed757ade8bac0cf989301fde1ebb104ecef/web/Dockerfile#L52

branch command returns:

root@misp:/var/www/MISP# git branch
* (HEAD detached at v2.4.116)
  2.4

Thanks in advance

Redis does not start

Redis does not start since 7c10e68. On the docker-compose console I see:

misp_web | 2020-01-10 08:48:56,927 INFO exited: redis-server (exit status 1; not expected)
misp_web | 2020-01-10 08:48:57,928 INFO gave up: redis-server entered FATAL state, too many start retries too quickly

In /var/log/redis/redis-server.log I see

231:M 10 Jan 09:50:17.552 # Creating Server TCP listening socket ::1:6379: bind: Cannot assign requested address

At first I thought it must be a local networking problem, but it went away again when I rolled back to the previous commit.

Error generating pgp key

After running docker-compose up, I keep getting pgp key generation errors for the misp_web container. Any thoughts on how to remedy the situation?

misp_web |
misp_web | Current default time zone: 'Etc/UTC'
misp_web | Local time is now: Thu Jan 23 22:21:40 UTC 2020.
misp_web | Universal Time is now: Thu Jan 23 22:21:40 UTC 2020.
misp_web |
misp_web | Creating MySQL database
misp_web | MYSQL_PASSWORD is set to 'misp'
misp_web | mysql: [Warning] Using a password on the command line interface can be insecure.
misp_web | Connected to database successfully!
misp_web | Database misp available
misp_web | Creating MISP configuration files
misp_web | Fixing the MISP base URL (localhost) ...
misp_web | Creating admin GnuPG key
misp_web | Generating admin PGP key ... (please be patient, we need some entropy)
misp_web | gpg: Generating a basic OpenPGP key
misp_web | gpg: agent_genkey failed: End of file
misp_web | gpg: key generation failed: End of file
misp_web | gpg: Done
misp_web exited with code 2

This sequence will just loop until I kill the process with Ctrl+C, and checking container status with docker ps indicates that the container is just continually restarting itself. It doesn't stay up long enough for me to attach a terminal and attempt to debug or execute the pgp key generation manually.

MISP latest Updates

Hello!

I have performed a environment with MISP using Docker Compose, but MISP version is 2.4.113.

How can I update to latest version of MISP using Docker Compose without affecting my configuration on the environment?

Thanks!

Unable to build MISP Web Service

lsb_release unable to find inside the focal ubuntu image that leads in unsuccessful exit and builds faulty docker image.

error in RUN php composer-setup.php

execute docker-compose build，the error is：

image

import importlib.util errors durring docker-podman/podman-compose

Both podman-compose and docker-compose when building.
the end of the error shows
"ModuleNotFoundError: No module named 'importlib.util'". I don't know if this is due to the install script and pip or the dockerfile, though.

I tried this on both Arch and Fedora 33. Each error in the same way for both files and both compose programs.

Full error:
Collecting importlib==1.0.4 Downloading importlib-1.0.4.zip (7.1 kB) ERROR: Command errored out with exit status 1: command: /usr/bin/python3 -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-t1b_apna/importlib_f13137b278354d878dc0c6584f5de5c2/setup.py'"'"'; __file__='"'"'/tmp/pip-install-t1b_apna/importlib_f13137b278354d878dc0c6584f5de5c2/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info --egg-base /tmp/pip-pip-egg-info-vqfdkasu cwd: /tmp/pip-install-t1b_apna/importlib_f13137b278354d878dc0c6584f5de5c2/ Complete output (11 lines): Traceback (most recent call last): File "<string>", line 1, in <module> File "/usr/local/lib/python3.6/dist-packages/setuptools/__init__.py", line 10, in <module> import distutils.core File "/usr/lib/python3.6/distutils/core.py", line 16, in <module> from distutils.dist import Distribution File "/usr/lib/python3.6/distutils/dist.py", line 19, in <module> from distutils.util import check_environ, strtobool, rfc822_escape File "/usr/lib/python3.6/distutils/util.py", line 9, in <module> import importlib.util ModuleNotFoundError: No module named 'importlib.util' ---------------------------------------- ERROR: Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output. ERROR: Service 'web' failed to build : The command '/bin/sh -c cd misp-modules && pip3 install --upgrade pip setuptools wheel && pip3 install scikit-build && pip3 install opencv-python && pip3 install -I -r REQUIREMENTS && pip3 install -I . && echo "sudo -u www-data misp-modules -s -l 127.0.0.1 &" >>/etc/rc.local' returned a non-zero code: 1

Does the random device need to be mapped?

I was trying to run this docker-compose on my Mac and everything worked fine except for one minor hiccup.

I had to comment out this line:
- /dev/urandom:/dev/random

This makes gpg throw an error and everything seems to work fine without it. I'm very much a docker beginner so I could be mistaken but wouldn't it make sense for docker to provide a random device without having to explicitly map one from the host platform?

/run.sh: no such file or directory": unknown

We are having issues since the recent code changes. Bringing up a new box to deploy this on to, we are getting the following error when it tries to start up misp_web.

Recreating misp_web ... error
Recreating misp_db ... done
Recreating proxy ... done

ERROR: for misp_web Cannot start service web: OCI runtime create failed: container_linux.go:349: starting container process caused "exec: "/run.sh": stat /run.sh: no such file or directory": unknown

ERROR: for web Cannot start service web: OCI runtime create failed: container_linux.go:349: starting container process caused "exec: "/run.sh": stat /run.sh: no such file or directory": unknown
ERROR: Encountered errors while bringing up the project.

build fails because of pear install errors

Error while building on CentOS7 (functool32)

First of all, thanks for the great work.
I'm trying to build a new MISP instance on CentOS 7.
While running, an error occurred and build has been stopped.

Followings are error logs:

----------------------------------------

Command "python setup.py egg_info" failed with error code 1 in /tmp/pip-build-rb6t6cd_/functools32/
You are using pip version 8.1.1, however version 19.0.3 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
ERROR: Service 'web' failed to build: The command '/bin/sh -c pip3 install -I -r REQUIREMENTS' returned a non-zero code: 1

PEAR Server has been down.

Hi,
Error message exists in line 98, 99 because pear.php.net has been down; therefore, packages can't be downloaded.

User who want to try to use misp-docker are suggest to

Download source code of "Crypt_GPG" and "Net_GeoIP" from GitHub
Modify the Dockerfile in ./web to build those packages using $ pear package.

Initial Build

I am having problems with getting the containers to build.
Loading composer repositories with package information

[Composer\Downloader\TransportException]
The "https://packagist.org/packages.json" file could not be downloaded: SSL operation failed with code 1. OpenSSL Error messages:
error:1408F10B:SSL routines:ssl3_get_record:wrong version number
Failed to enable crypto
failed to open stream: operation failed

Any help on this would be great.

Working MISP image with less layers, ubuntu:bionic, external redis, docker-compose, etc

Can be found here (WIP):

https://github.com/Podictive/MISP-docker

If people are interested, I can submit this as a pull request here. 90% of the image is still based on the install instructions here, but for me it wasn't working. So I spend more than a few hours to get it working again, and then decided to update it a bit and remove some dependencies.

Unfortunately due to github -> gitlab -> github moving around some of the git-history got mangled :(