ibm / powerai Goto Github PK

This repo contains ancillary information used to assist users of IBM Watson Machine Learning Community Edition. This repo will contain How To's, Readme's, Dockerfiles, etc. that can be consumed by users looking to get started.

License: BSD 2-Clause "Simplified" License

HTML 18.12% Shell 50.82% Python 23.39% Perl 1.56% Batchfile 0.15% C 0.60% R 0.01% Makefile 0.19% C++ 5.16%

powerai's Introduction

Powerai

This repo contains ancillary and supplemental information used to assist users of Watson Machine Learning Community Edition (WML CE). This repo will continue to expand to contain How To's, Readme's, Dockerfiles, examples etc. that can be consumed by users looking to get started using our various features in WML CE.

Watson Machine Learning CE can be found at: https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda/

Examples

This directory contains examples of how to use certain features in WML CE as well as supplementary material for related blogs. The directory currently includes:

tensorflow_large_model_supprt - Some example models enabled with TFLMSv2
tensorflow_serving - A TensorFlow Serving example
tfs-tftrt-example - A TensorRT example using TensorFlow Serving
xgboost - Examples for XGBoost

Vision

CLI API documentation for IBM PowerAI Vision

conda-recipes

This directory holds conda recipes for the PowerAI supplementary channel. There is no support for these recipes or the supplementary channel. Community contributions will be considered. The supplementary channel is located on anaconda.org at https://anaconda.org/powerai/

powerai's People

Contributors

Stargazers

Watchers

powerai's Issues

support for h5py in powerai (ppc64le)

I was trying to install torchmeta as I outlined here #269 but now I am getting I cannot install h5py. Is it possible to request support for it? Or point me to the version I need to be compatible with powerai 1.7.0 in a ppc64le architecture?

(my_new_env) [miranda9@hal-login ~]$ pip install torchmeta==1.3.1
Collecting torchmeta==1.3.1
  Using cached torchmeta-1.3.1-py3-none-any.whl (144 kB)
Requirement already satisfied: requests in ./.conda/envs/my_new_env/lib/python3.7/site-packages (from torchmeta==1.3.1) (2.22.0)
Requirement already satisfied: torchvision<0.6.0,>=0.4.0 in ./.conda/envs/my_new_env/lib/python3.7/site-packages (from torchmeta==1.3.1) (0.4.2)
Requirement already satisfied: torch<1.5.0,>=1.3.0 in ./.conda/envs/my_new_env/lib/python3.7/site-packages (from torchmeta==1.3.1) (1.3.1)
Processing ./.cache/pip/wheels/87/f5/ad/9f04a48453875e8054c19f9fe3f50cbbe0c09b956835555019/Pillow-6.2.2-cp37-cp37m-linux_ppc64le.whl
Requirement already satisfied: numpy>=1.14.0 in ./.conda/envs/my_new_env/lib/python3.7/site-packages (from torchmeta==1.3.1) (1.17.4)
Requirement already satisfied: tqdm>=4.0.0 in ./.conda/envs/my_new_env/lib/python3.7/site-packages (from torchmeta==1.3.1) (4.36.1)
Collecting h5py~=2.9.0
  Using cached h5py-2.9.0.tar.gz (287 kB)
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in ./.conda/envs/my_new_env/lib/python3.7/site-packages (from requests->torchmeta==1.3.1) (3.0.4)
Requirement already satisfied: certifi>=2017.4.17 in ./.conda/envs/my_new_env/lib/python3.7/site-packages (from requests->torchmeta==1.3.1) (2020.6.20)
Requirement already satisfied: urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 in ./.conda/envs/my_new_env/lib/python3.7/site-packages (from requests->torchmeta==1.3.1) (1.25.10)
Requirement already satisfied: idna<2.9,>=2.5 in ./.conda/envs/my_new_env/lib/python3.7/site-packages (from requests->torchmeta==1.3.1) (2.8)
Requirement already satisfied: six in ./.conda/envs/my_new_env/lib/python3.7/site-packages (from torchvision<0.6.0,>=0.4.0->torchmeta==1.3.1) (1.13.0)
Building wheels for collected packages: h5py
  Building wheel for h5py (setup.py) ... error
  ERROR: Command errored out with exit status 1:
   command: /home/miranda9/.conda/envs/my_new_env/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-bpmeop26/h5py/setup.py'"'"'; __file__='"'"'/tmp/pip-install-bpmeop26/h5py/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-ccg1oj0n
       cwd: /tmp/pip-install-bpmeop26/h5py/
  Complete output (1321 lines):
  running bdist_wheel
  running build
  running build_py
  creating build
  creating build/lib.linux-ppc64le-3.7
  creating build/lib.linux-ppc64le-3.7/h5py
  copying h5py/__init__.py -> build/lib.linux-ppc64le-3.7/h5py
  copying h5py/h5py_warnings.py -> build/lib.linux-ppc64le-3.7/h5py
  copying h5py/highlevel.py -> build/lib.linux-ppc64le-3.7/h5py
  copying h5py/ipy_completer.py -> build/lib.linux-ppc64le-3.7/h5py
  copying h5py/version.py -> build/lib.linux-ppc64le-3.7/h5py
  creating build/lib.linux-ppc64le-3.7/h5py/_hl
  copying h5py/_hl/__init__.py -> build/lib.linux-ppc64le-3.7/h5py/_hl
  copying h5py/_hl/attrs.py -> build/lib.linux-ppc64le-3.7/h5py/_hl
  copying h5py/_hl/base.py -> build/lib.linux-ppc64le-3.7/h5py/_hl
  copying h5py/_hl/compat.py -> build/lib.linux-ppc64le-3.7/h5py/_hl
  copying h5py/_hl/dataset.py -> build/lib.linux-ppc64le-3.7/h5py/_hl
  copying h5py/_hl/datatype.py -> build/lib.linux-ppc64le-3.7/h5py/_hl
  copying h5py/_hl/dims.py -> build/lib.linux-ppc64le-3.7/h5py/_hl
  copying h5py/_hl/files.py -> build/lib.linux-ppc64le-3.7/h5py/_hl
  copying h5py/_hl/filters.py -> build/lib.linux-ppc64le-3.7/h5py/_hl
  copying h5py/_hl/group.py -> build/lib.linux-ppc64le-3.7/h5py/_hl
  copying h5py/_hl/selections.py -> build/lib.linux-ppc64le-3.7/h5py/_hl
  copying h5py/_hl/selections2.py -> build/lib.linux-ppc64le-3.7/h5py/_hl
  copying h5py/_hl/vds.py -> build/lib.linux-ppc64le-3.7/h5py/_hl
  creating build/lib.linux-ppc64le-3.7/h5py/tests
  copying h5py/tests/__init__.py -> build/lib.linux-ppc64le-3.7/h5py/tests
  copying h5py/tests/common.py -> build/lib.linux-ppc64le-3.7/h5py/tests
  creating build/lib.linux-ppc64le-3.7/h5py/tests/old
  copying h5py/tests/old/__init__.py -> build/lib.linux-ppc64le-3.7/h5py/tests/old
  copying h5py/tests/old/test_attrs.py -> build/lib.linux-ppc64le-3.7/h5py/tests/old
  copying h5py/tests/old/test_attrs_data.py -> build/lib.linux-ppc64le-3.7/h5py/tests/old
  copying h5py/tests/old/test_base.py -> build/lib.linux-ppc64le-3.7/h5py/tests/old
  copying h5py/tests/old/test_dataset.py -> build/lib.linux-ppc64le-3.7/h5py/tests/old
  copying h5py/tests/old/test_datatype.py -> build/lib.linux-ppc64le-3.7/h5py/tests/old
  copying h5py/tests/old/test_dimension_scales.py -> build/lib.linux-ppc64le-3.7/h5py/tests/old
  copying h5py/tests/old/test_file.py -> build/lib.linux-ppc64le-3.7/h5py/tests/old
  copying h5py/tests/old/test_file_image.py -> build/lib.linux-ppc64le-3.7/h5py/tests/old
  copying h5py/tests/old/test_group.py -> build/lib.linux-ppc64le-3.7/h5py/tests/old
  copying h5py/tests/old/test_h5.py -> build/lib.linux-ppc64le-3.7/h5py/tests/old
  copying h5py/tests/old/test_h5d_direct_chunk_write.py -> build/lib.linux-ppc64le-3.7/h5py/tests/old
  copying h5py/tests/old/test_h5f.py -> build/lib.linux-ppc64le-3.7/h5py/tests/old
  copying h5py/tests/old/test_h5p.py -> build/lib.linux-ppc64le-3.7/h5py/tests/old
  copying h5py/tests/old/test_h5t.py -> build/lib.linux-ppc64le-3.7/h5py/tests/old
  copying h5py/tests/old/test_objects.py -> build/lib.linux-ppc64le-3.7/h5py/tests/old
  copying h5py/tests/old/test_selections.py -> build/lib.linux-ppc64le-3.7/h5py/tests/old
  copying h5py/tests/old/test_slicing.py -> build/lib.linux-ppc64le-3.7/h5py/tests/old
  creating build/lib.linux-ppc64le-3.7/h5py/tests/hl
  copying h5py/tests/hl/__init__.py -> build/lib.linux-ppc64le-3.7/h5py/tests/hl
  copying h5py/tests/hl/test_attribute_create.py -> build/lib.linux-ppc64le-3.7/h5py/tests/hl
  copying h5py/tests/hl/test_dataset_getitem.py -> build/lib.linux-ppc64le-3.7/h5py/tests/hl
  copying h5py/tests/hl/test_dataset_swmr.py -> build/lib.linux-ppc64le-3.7/h5py/tests/hl
  copying h5py/tests/hl/test_datatype.py -> build/lib.linux-ppc64le-3.7/h5py/tests/hl
  copying h5py/tests/hl/test_deprecation.py -> build/lib.linux-ppc64le-3.7/h5py/tests/hl
  copying h5py/tests/hl/test_dims_dimensionproxy.py -> build/lib.linux-ppc64le-3.7/h5py/tests/hl
  copying h5py/tests/hl/test_file.py -> build/lib.linux-ppc64le-3.7/h5py/tests/hl
  copying h5py/tests/hl/test_filters.py -> build/lib.linux-ppc64le-3.7/h5py/tests/hl
  copying h5py/tests/hl/test_threads.py -> build/lib.linux-ppc64le-3.7/h5py/tests/hl
  creating build/lib.linux-ppc64le-3.7/h5py/tests/hl/test_vds
  copying h5py/tests/hl/test_vds/__init__.py -> build/lib.linux-ppc64le-3.7/h5py/tests/hl/test_vds
  copying h5py/tests/hl/test_vds/test_highlevel_vds.py -> build/lib.linux-ppc64le-3.7/h5py/tests/hl/test_vds
  copying h5py/tests/hl/test_vds/test_lowlevel_vds.py -> build/lib.linux-ppc64le-3.7/h5py/tests/hl/test_vds
  copying h5py/tests/hl/test_vds/test_virtual_source.py -> build/lib.linux-ppc64le-3.7/h5py/tests/hl/test_vds
  running build_ext
  Autodetected HDF5 1.10.2
  ********************************************************************************
                         Summary of the h5py configuration
  
      Path to HDF5: None
      HDF5 Version: '1.10.2'
       MPI Enabled: False
  Rebuild Required: True
  
  ********************************************************************************
  Executing api_gen rebuild of defs
  Executing cythonize()
  [ 1/22] Cythonizing /tmp/pip-install-bpmeop26/h5py/h5py/_conv.pyx
  /tmp/pip-install-bpmeop26/h5py/.eggs/Cython-0.29.21-py3.7.egg/Cython/Compiler/Main.py:369: FutureWarning: Cython directive 'language_level' not set, using 2 for now (Py2). This will change in a later release! File: /tmp/pip-install-bpmeop26/h5py/h5py/_conv.pxd
    tree = Parsing.p_module(s, pxd, full_module_name)

...

  /home/miranda9/.conda/envs/my_new_env/lib/python3.7/site-packages/numpy/core/include/numpy/npy_1_7_deprecated_api.h:17:2: warning: #warning "Using deprecated NumPy API, disable it with " "#define NPY_NO_DEPRECATED_API NPY_1_7_API_VERSION" [-Wcpp]
   #warning "Using deprecated NumPy API, disable it with " \
    ^
  In file included from /tmp/pip-install-bpmeop26/h5py/h5py/defs.c:654:0:
  /tmp/pip-install-bpmeop26/h5py/h5py/api_compat.h:27:18: fatal error: hdf5.h: No such file or directory
   #include "hdf5.h"
                    ^
  compilation terminated.
  error: command 'gcc' failed with exit status 1
  ----------------------------------------
  ERROR: Failed building wheel for h5py
  Running setup.py clean for h5py
Failed to build h5py
DEPRECATION: Could not build wheels for h5py which do not use PEP 517. pip will fall back to legacy 'setup.py install' for these. pip 21.0 will remove support for this functionality. A possible replacement is to fix the wheel build issue reported above. You can find discussion regarding this at https://github.com/pypa/pip/issues/8368.
Installing collected packages: Pillow, h5py, torchmeta
  Attempting uninstall: Pillow
    Found existing installation: Pillow 7.1.2
    Uninstalling Pillow-7.1.2:
      Successfully uninstalled Pillow-7.1.2
  Attempting uninstall: h5py
    Found existing installation: h5py 2.8.0
    Uninstalling h5py-2.8.0:
      Successfully uninstalled h5py-2.8.0
    Running setup.py install for h5py ... error
    ERROR: Command errored out with exit status 1:
     command: /home/miranda9/.conda/envs/my_new_env/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-bpmeop26/h5py/setup.py'"'"'; __file__='"'"'/tmp/pip-install-bpmeop26/h5py/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-hlwpfooj/install-record.txt --single-version-externally-managed --compile --install-headers /home/miranda9/.conda/envs/my_new_env/include/python3.7m/h5py


... 

    copying h5py/tests/hl/test_vds/test_lowlevel_vds.py -> build/lib.linux-ppc64le-3.7/h5py/tests/hl/test_vds
    copying h5py/tests/hl/test_vds/test_virtual_source.py -> build/lib.linux-ppc64le-3.7/h5py/tests/hl/test_vds
    running build_ext
    Autodetected HDF5 1.10.2
    ********************************************************************************
                           Summary of the h5py configuration
    
        Path to HDF5: None
        HDF5 Version: '1.10.2'
         MPI Enabled: False
    Rebuild Required: True
    
    ********************************************************************************
    Executing cythonize()
    [ 1/22] Cythonizing /tmp/pip-install-bpmeop26/h5py/h5py/_conv.pyx
    /tmp/pip-install-bpmeop26/h5py/.eggs/Cython-0.29.21-py3.7.egg/Cython/Compiler/Main.py:369: FutureWarning: Cython directive 'language_level' not set, using 2 for now (Py2). This will change in a later release! File: /tmp/pip-install-bpmeop26/h5py/h5py/_conv.pxd


...

    warning: h5py/api_types_hdf5.pxd:730:6: 'H5Z_ERROR_EDC' redeclared
    warning: h5py/api_types_hdf5.pxd:731:6: 'H5Z_DISABLE_EDC' redeclared
    warning: h5py/api_types_hdf5.pxd:732:6: 'H5Z_ENABLE_EDC' redeclared
    warning: h5py/api_types_hdf5.pxd:733:6: 'H5Z_NO_EDC' redeclared
    building 'h5py.defs' extension
    creating build/temp.linux-ppc64le-3.7
    creating build/temp.linux-ppc64le-3.7/tmp
    creating build/temp.linux-ppc64le-3.7/tmp/pip-install-bpmeop26
    creating build/temp.linux-ppc64le-3.7/tmp/pip-install-bpmeop26/h5py
    creating build/temp.linux-ppc64le-3.7/tmp/pip-install-bpmeop26/h5py/h5py
    gcc -pthread -B /home/miranda9/.conda/envs/my_new_env/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -DH5_USE_16_API -I./h5py -I/tmp/pip-install-bpmeop26/h5py/lzf -I/opt/local/include -I/usr/local/include -I/home/miranda9/.conda/envs/my_new_env/lib/python3.7/site-packages/numpy/core/include -I/home/miranda9/.conda/envs/my_new_env/include/python3.7m -c /tmp/pip-install-bpmeop26/h5py/h5py/defs.c -o build/temp.linux-ppc64le-3.7/tmp/pip-install-bpmeop26/h5py/h5py/defs.o
    In file included from /home/miranda9/.conda/envs/my_new_env/lib/python3.7/site-packages/numpy/core/include/numpy/ndarraytypes.h:1830:0,
                     from /home/miranda9/.conda/envs/my_new_env/lib/python3.7/site-packages/numpy/core/include/numpy/ndarrayobject.h:12,
                     from /home/miranda9/.conda/envs/my_new_env/lib/python3.7/site-packages/numpy/core/include/numpy/arrayobject.h:4,
                     from /tmp/pip-install-bpmeop26/h5py/h5py/api_compat.h:26,
                     from /tmp/pip-install-bpmeop26/h5py/h5py/defs.c:654:
    /home/miranda9/.conda/envs/my_new_env/lib/python3.7/site-packages/numpy/core/include/numpy/npy_1_7_deprecated_api.h:17:2: warning: #warning "Using deprecated NumPy API, disable it with " "#define NPY_NO_DEPRECATED_API NPY_1_7_API_VERSION" [-Wcpp]
     #warning "Using deprecated NumPy API, disable it with " \
      ^
    In file included from /tmp/pip-install-bpmeop26/h5py/h5py/defs.c:654:0:
    /tmp/pip-install-bpmeop26/h5py/h5py/api_compat.h:27:18: fatal error: hdf5.h: No such file or directory
     #include "hdf5.h"
                      ^
    compilation terminated.
    error: command 'gcc' failed with exit status 1
    ----------------------------------------
  Rolling back uninstall of h5py
  Moving to /home/miranda9/.conda/envs/my_new_env/lib/python3.7/site-packages/h5py
   from /home/miranda9/.conda/envs/my_new_env/lib/python3.7/site-packages/~5py
  Moving to /home/miranda9/.conda/envs/my_new_env/lib/python3.7/site-packages/h5py-2.8.0-py3.7.egg-info
   from /home/miranda9/.conda/envs/my_new_env/lib/python3.7/site-packages/~5py-2.8.0-py3.7.egg-info
ERROR: Command errored out with exit status 1: /home/miranda9/.conda/envs/my_new_env/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-bpmeop26/h5py/setup.py'"'"'; __file__='"'"'/tmp/pip-install-bpmeop26/h5py/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-hlwpfooj/install-record.txt --single-version-externally-managed --compile --install-headers /home/miranda9/.conda/envs/my_new_env/include/python3.7m/h5py Check the logs for full command output.

switch from spectrum mpi to openmpi

Do you provide any documentation about switching from spectrum mpi to openmpi installed in powerai 1.6:

https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda/

Detectron2 build for ppc64le with Pytorch 1.14

Hello,

@hartb please include Detectron2 on the powerai channel. Please find bellow instruction to get this build with Pytorch 1.14

conda config --prepend channels https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access/ conda install pytorch=1.4.0=23447.g18a1a27 cudatoolkit-dev gxx_linux-ppc64le=7 gcc_linux-ppc64le=7

git clone https://github.com/facebookresearch/detectron2.git python -m pip wheel -e detectron2

Thank you,
FM

Where is tensorflow lib?

Hi,
I'm trying this image on POWER https://hub.docker.com/r/ibmcom/powerai/
In Dockerfile:
FROM ibmcom/powerai:1.5.3-all-ubuntu16.04-py3

Once activated the tensorflow packages while launching a container, where is tensorflow lib located to which I can do import tensorflow as tf in Python code within the container?

[recipe request] tf object detection API

Hello, it would be helpful to have the TF Object Detection API:

Name of package: tf_object_detection
URL of package source code: https://github.com/tensorflow/models/tree/master/research/object_detection
License of package: Apache License 2.0 (at least tf/models)
List of package dependencies: Not known
Short description of package and use case(s): One of our (research) partners is using this API in their current setup and evaluating ppc64le HW

Conda-forge feedstock is available if that helps:
https://github.com/conda-forge/tf_object_detection-feedstock

Thanks a lot for your efforts!

[recipe-request] Tensor2tensor

Name of package: Tensor2tensor
URL of package source code: https://github.com/tensorflow/tensor2tensor
License of package: Apache-2
List of package dependencies:

install_requires=[
        'bz2file',
        'dopamine-rl',
        'flask',
        'future',
        'gevent',
        'gin-config',
        'google-api-python-client',
        'gunicorn',
        'gym',
        'h5py',
        'kfac',
        'mesh-tensorflow',
        'numpy',
        'oauth2client',
        'opencv-python',
        'Pillow',
        'pypng',
        'requests',
        'scipy',
        'six',
        'sympy',
        'tensorflow-datasets',
        'tensorflow-probability',
        'tqdm',
    ],
    extras_require={
        'tensorflow': ['tensorflow>=1.13.1'],
        'tensorflow_gpu': ['tensorflow-gpu>=1.13.1'],
        'tensorflow-hub': ['tensorflow-hub>=0.1.1'],
        'tests': [
            'absl-py',
            'pytest>=3.8.0',
            'mock',
            'pylint',
            'jupyter',
            'gsutil',
            'matplotlib',
            # Need atari extras for Travis tests, but because gym is already in
            # install_requires, pip skips the atari extras, so we instead do an
            # explicit pip install gym[atari] for the tests.
            # 'gym[atari]',
        ],
        'trax': [
            'jax',
            'jaxlib',
        ],
        'allen': ['Pillow==5.1.0', 'pandas==0.23.0'],
    },

Short description of package and use case(s):
Library of deep learning models and datasets designed to make deep learning more accessible and accelerate ML research.

Folks who would also like to see this package in the supplementary channel, please thumbs-up so the developers can know which requests to prioritize.

Spectrum MPI license in container

I'm trying to use a powerai derived container on an IBM AC922 (power9, RHEL7) that includes mpi4py in its conda environment for use with Spectrum MPI. Specifically, I'm using this container: docker run --name spectrum-mpi4py -it --env LICENSE=yes ibmcom/powerai:1.6.2-pytorch-ubuntu18.04-py36

However, I'm experiencing license errors when trying to use mpi related functionality inside the container, even with basic C based MPI programs. The commands below generated the error in c_mpi_hello_error.txt. The license script referenced by the error, accept_spectrum_mpi_license.sh, is not in the container.

# apt-get update && apt-get install -y build-essential cmake
...
$ find / -type f -name 'accept_spectrum_mpi_license.sh' 2> /dev/null | wc -l
0
$ export IBM_SPECTRUM_MPI_LICENSE_ACCEPT=yes
$ wget https://raw.githubusercontent.com/huyle333/mpi-hello-world/master/mpi_hello_world.c
$ mpicc mpi_hello_world.c
$ mpirun -n 2 a.out

Separately, the container's conda environment (wmlce) pulls a build targeting mpich/openmpi, despite the default environment using Spectrum MPI:

$ conda info mpi4py 2>/dev/null | grep -i mpich | wc -l
4
$ conda info mpi4py 2>/dev/null | grep -i openmpi | wc -l
4
$ conda info mpi4py 2>/dev/null | grep -i sp | wc -l
0
...
$ conda list | grep spectrum
spectrum-mpi              10.03              622.gfc88b70    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda

Building mpi4py from source using the Spectrum MPI headers works, but I get that same license error when trying to run it.

Finally, merely attempting to get additional info regarding this MPI implementation using ompi_info generated the errors in ompi_info.txt.

Support for Pytorch 1.0?

I saw that the only version of Pytorch currently supported in the docker images are 0.4.0 and 0.4.1. Is there any way a 1.0 build can be supported?

I've tried installing from source and it is a massive headache using powerpc as opposed to another linux machine.

Spectrum MPI is no longer included

The Docker Hub Overview for PowerAI lists SMPI as a component to the images:
https://hub.docker.com/r/ibmcom/powerai/

I tried several tags for 1.6.0, but none of them includes the SMPI, or any MPI.

Can we have SMPI back? My ORNL clients relies on SMPI to scale up their application on Summit.

Thanks!

[recipe request] paccmann

Name of package: PaccMann
URL of package source code: https://github.com/drugilsberg/paccmann
License of package: MIT
List of package dependencies:

numpy >= 1.14.3
  tensorflow == 1.14.0
  tensor2tensor >= 1.10.0
  plac >= 0.9.6

Short description of package and use case(s):
 a package for drug sensitivity prediction and is the core component of the repo.

Folks who would also like to see this package in the supplementary channel, please thumbs-up so the developers can know which requests to prioritize.

DoWhy

Name of package: DoWhy
URL of package source code: https://github.com/microsoft/dowhy/
License of package: Apache-2

DoWhy is a Python library for causal inference that supports explicit modeling and testing of causal assumptions. DoWhy is based on a unified language for causal inference, combining causal graphical models and potential outcomes frameworks.

List of package dependencies:

- matplotlib >=3.0
- networkx >=2.0
- numpy >=1.15
- pandas
- pydot >=1.4
- python
- scikit-learn
- scipy
- sympy >=1.4

Can't install python packages with either pip or conda during Docker build

Hi,
I've been trying to build a Docker image on an IBM power9 server using ibmcom/powerai:1.6.0-all-ubuntu18.04-py3 as a base.
I've tried adding python packages using both pip and conda but neither one works, and I'm at a loss. It's hard to find answers by googling the errors since not many use the ppc64le architecture, so any help you can give me would be greatly appreciated.
Thank you.

Below is my Dockerfile for installing packages with conda, which during build hangs with the message:
"Solving environment: ...working... "

`FROM ibmcom/powerai:1.6.0-all-ubuntu18.04-py3

ENV USER_NAME pwrai
ENV WORK_DIR /home/${USER_NAME}/microDL

RUN ["/bin/bash", "-c", "cd /opt/anaconda3/bin && source activate base && IBM_POWERAI_LICENSE_ACCEPT=yes ./accept-powerai-license.sh" ]

RUN sudo /bin/ln -sf /bin/bash /bin/sh

RUN sudo apt-get update && sudo apt-get install -yq --no-install-recommends
software-properties-common &&
add-apt-repository universe
RUN echo 'debconf debconf/frontend select Noninteractive' | debconf-set-selections
&& sudo apt-get update && sudo apt-get install -yq --no-install-recommends
build-essential
apt-utils
libcupti-dev
ca-certificates
cmake
libfreetype6-dev
wget
git
pkg-config
tmux
graphviz
vim

RUN sudo apt-get clean &&
sudo apt-get autoremove &&
sudo rm -rf /var/lib/apt/lists/*

ENV PATH /opt/anaconda3/bin:${PATH}
RUN sudo ln -s /opt/anaconda3/etc/profile.d/conda.sh /etc/profile.d/conda.sh
ADD conda_environment_docker.yml /tmp/conda.yml
RUN conda update -n base -c defaults --override-channels conda &&
conda env create --file=/tmp/conda.yml &&
conda install tensorflow-gpu==1.13.1 &&
conda activate micro_dl

WORKDIR ${WORK_DIR}
ENV PYTHONPATH ${WORK_DIR}
RUN sudo chown ${USER_NAME} ${WORK_DIR}
RUN sudo chgrp ${USER_NAME} ${WORK_DIR}

EXPOSE 8888 6006`

PyTorch ppc64le

Hello,
I'm trying to run the latest version of PyTorch on a ppc64le architecture. From here https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access, I managed to get access to the binaries for PyTorch 1.5 but some newer functionalities are still lacking.

When do you plan to have a new release of powerai with more up to date packages?

Or otherwise, can you provide some help for compiling PyTorch from source for ppc64le? Following the readme from https://github.com/pytorch/pytorch

conda install astunparse numpy ninja pyyaml mkl mkl-include setuptools cmake cffi typing_extensions future six requests dataclasses

gives the following error

PackagesNotFoundError: The following packages are not available from current channels:

  - mkl-include
  - mkl

cupy and horovod cannot be installed into the same powerai 1.6 environment due to compiler incompatibilities

I'm getting this error for pip install cupy with powerai 1.6:

Collecting cupy
  Using cached https://files.pythonhosted.org/packages/cd/d6/532e5da87f3b513cd0b98bcbf9a58fb6758598039944c42cb93d13b71a5f/cupy-5.4.0.tar.gz
    Complete output from command python setup.py egg_info:
    Options: {'package_name': 'cupy', 'long_description': None, 'wheel_libs': [], 'no_rpath': False, 'profile': False, 'linetrace': False, 'annotate': False, 'no_cuda': False}
    
    -------- Configuring Module: cuda --------
    cc1plus: warning: command line option '-Wstrict-prototypes' is valid for C/ObjC but not for C++
    cc1plus: warning: command line option '-Wstrict-prototypes' is valid for C/ObjC but not for C++
    /data/gpfs/Users/j0541825/anaconda3/envs/powerai.1.6/bin/../lib/gcc/powerpc64le-conda_cos7-linux-gnu/7.3.0/../../../../powerpc64le-conda_cos7-linux-gnu/bin/ld: cannot find -lcuda
    collect2: error: ld returned 1 exit status
    Cannot build a stub file.
    Original error: command '/data/gpfs/Users/j0541825/anaconda3/envs/powerai.1.6/bin/powerpc64le-conda_cos7-linux-gnu-c++' failed with exit status 1
    
    ************************************************************
    * CuPy Configuration Summary                               *
    ************************************************************
    
    Build Environment:
      Include directories: ['/data/gpfs/Users/j0541825/anaconda3/envs/powerai.1.6/include']
      Library directories: ['/data/gpfs/Users/j0541825/anaconda3/envs/powerai.1.6/lib64', '/data/gpfs/Users/j0541825/anaconda3/envs/powerai.1.6/lib']
      nvcc command       : ['/data/gpfs/Users/j0541825/anaconda3/envs/powerai.1.6/bin/nvcc']
    
    Environment Variables:
      CFLAGS          : -mcpu=power8 -mtune=power8 -mpower8-fusion -mpower8-vector -ftree-vectorize -fPIC -fstack-protector-strong -fno-plt -O3 -pipe
      LDFLAGS         : -Wl,-O2 -Wl,--sort-common -Wl,--as-needed -Wl,-z,relro -Wl,-z,now
      LIBRARY_PATH    : (none)
      CUDA_PATH       : (none)
      NVTOOLSEXT_PATH : (none)
      NVCC            : (none)
    
    Modules:
      cuda      : No
        -> Cannot link libraries: ['cublas', 'cuda', 'cudart', 'cufft', 'curand', 'cusparse', 'nvrtc']
        -> Check your LDFLAGS environment variable.
    
    ERROR: CUDA could not be found on your system.
    Please refer to the Installation Guide for details:
    https://docs-cupy.chainer.org/en/stable/install.html
    
    ************************************************************
    
    Traceback (most recent call last):
      File "<string>", line 1, in <module>
      File "/tmp/pip-install-f62gddrq/cupy/setup.py", line 120, in <module>
        ext_modules = cupy_setup_build.get_ext_modules()
      File "/tmp/pip-install-f62gddrq/cupy/cupy_setup_build.py", line 588, in get_ext_modules
        extensions = make_extensions(arg_options, compiler, use_cython)
      File "/tmp/pip-install-f62gddrq/cupy/cupy_setup_build.py", line 384, in make_extensions
        raise Exception('Your CUDA environment is invalid. '
    Exception: Your CUDA environment is invalid. Please check above error log.
    
    ----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in /tmp/pip-install-f62gddrq/cupy/

[recipe request] imageai

Name of package: imageai
License of package: MIT
URL of package source code:

https://github.com/OlafenwaMoses/ImageAI

List of package dependencies: (everything is already installed)

Python 3.5.1 (and later versions) (Support for Python 2.7 coming soon)
Tensorflow 1.4.0 (and later versions)
OpenCV
Keras 2.x
Requirement already satisfied: matplotlib (3.0.3)
Requirement already satisfied: pillow (5.3.0)
Requirement already satisfied: scipy (1.1.0)
Requirement already satisfied: h5py (2.8.0)
Requirement already satisfied: numpy (1.14.5)
Requirement already satisfied: cycler>=0.10 (0.10.0)
Requirement already satisfied: kiwisolver>=1.0.1 (1.0.1)
Requirement already satisfied: pyparsing!=2.0.4,!=2.1.2,!=2.1.6,>=2.0.1 (2.3.1)
Requirement already satisfied: python-dateutil>=2.1 (2.8.0)
Requirement already satisfied: six (1.12.0)
Requirement already satisfied: setuptools (40.8.0)

Short description of package:

ImageAI is an easy to use Computer Vision Python library that empowers developers to easily integrate state-of-the-art Artificial Intelligence features into their new and existing applications and systems. It implements several relevant algorithms such as DenseNet for classification. It is based on TensorFlow. It also implements object detection models.

Use cases:

ImageAI provides API to train new image recognition models on new image datasets for custom use cases. It also provides implementations to integrate and deploy the custom image recognition models

In our case, we would use the two features (classification and object detection) for car claim analysis. Object detection would be used on car damages.

NB: This project is leaded in the frame of tests on powerAI cluster, leaded by Guilhaume Leroy-Meline in IBM France.

horovod in powerai 1.6.2, error occurs with hvd.init()

Hi,
Try to install Horovod with PyTorch based on powerai image following official tutorial, error occurs when try to hvd.init(). Is there any material on how to set up DDL_OPTIONS to use ddl? Thanks

code

import horovod.torch as hvd
hvd.init()
[2020-06-11 03:01:22.297540: W horovod/common/ops/ddl_operations.cc:105] DDL backend has been deprecated. Please, start using the NCCL backend by building Horovod with 'HOROVOD_GPU_ALLREDUCE=NCCL HOROVOD_GPU_BROADCAST=NCCL'.
terminate called after throwing an instance of 'std::logic_error'
what(): DDL_OPTIONS env variable needs to be set to use DDL.
Aborted (core dumped)`

I also tried to set up env variable for DDL_OPTIONS with export DDL_OPTIONS=DDL it produce another error

import horovod.torch as hvd
hvd.init()
[2020-06-11 03:14:33.814715: W horovod/common/ops/ddl_operations.cc:105] DDL backend has been deprecated. Please, start using the NCCL backend by building Horovod with 'HOROVOD_GPU_ALLREDUCE=NCCL HOROVOD_GPU_BROADCAST=NCCL'.
E 03:14:33.814 634 652 DDL:86 ] ill-formated option :[DDL]
terminate called after throwing an instance of 'std::system_error'
what(): Resource deadlock avoided
Aborted (core dumped)
`

powerai cudatoolkit 10.1 doesn't allow profiling

This is an issue affecting CUDA 10.1 defaulting to requiring administrator access to use the nvprof tool.[1,2]. Is it possible package a version of cudatool kit added to powerAI that will allow profiling?

Many thanks.

[1] https://developer.nvidia.com/nvidia-development-tools-solutions-err-nvgpuctrperm-NsightCompute
[2] https://devtalk.nvidia.com/default/topic/1049421/visual-profiler-and-nvprof/nvprof-warning-the-user-does-not-have-permission-to-profile-on-the-target-device-/

Code example for video inference.

Hello everyone,

I have tensorrt optimized yolov5 engine but I could not run the inference on a video. I checked your doInference() function but does not match with the one that I used for inference. Since I have little knowledge about cuda programming I did not understand the code. Have you got any reference for using yolo engine on a video.

BEST REGARDS

ibm-cos-sdk-python

Request the recipe for https://github.com/ibm/ibm-cos-sdk-python.git be included in the powerai channel.

Clients use the ibm_botocore and ibm_boto3 to access objects in the IBM Cloud Object Store.

mpi4py support

Hello,

I support an IBM AC922 system with InfiniBand, Spectrum MPI, and the xl compiler. We rely on PowerAI for delivering customizable python environments backed by an ecosystem of pre-tuned machine learning packages. We were recently asked to support mpi4py and I have been unable to compile it in a conda environment. It will compile with the system python, so xl and spectrum seem to be configured fine - issues only arise in a conda environment. I'd appreciate any help.

Thanks,
Greg

$ conda config --show

add_anaconda_token: True
add_pip_as_python_dependency: True
aggressive_update_packages:
  - ca-certificates
  - certifi
  - openssl
allow_conda_downgrades: False
allow_cycles: True
allow_non_channel_urls: False
allow_softlinks: False
always_copy: False
always_softlink: False
always_yes: None
anaconda_upload: None
auto_activate_base: True
auto_stack: 0
auto_update_conda: False
bld_path: 
changeps1: True
channel_alias: https://conda.anaconda.org
channel_priority: strict
channels:
  - https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda/
  - defaults
client_ssl_cert: None
client_ssl_cert_key: None
clobber: False
conda_build: {}
create_default_packages: []
croot: /home/03076/gzynda/conda-bld
custom_channels:
  pkgs/main: https://repo.anaconda.com
  pkgs/r: https://repo.anaconda.com
  pkgs/pro: https://repo.anaconda.com
custom_multichannels:
  defaults: 
    - https://repo.anaconda.com/pkgs/main
    - https://repo.anaconda.com/pkgs/r
  local: 
debug: False
default_channels:
  - https://repo.anaconda.com/pkgs/main
  - https://repo.anaconda.com/pkgs/r
default_python: 3.7
default_threads: 4
deps_modifier: not_set
dev: False
disallowed_packages: []
download_only: False
dry_run: False
enable_private_envs: False
env_prompt: ({default_env}) 
envs_dirs:
  - /scratch/03076/gzynda/conda_local/envs
  - /scratch/apps/conda/4.8.3/envs
  - /home/03076/gzynda/.conda/envs
error_upload_url: https://conda.io/conda-post/unexpected-error
execute_threads: 4
extra_safety_checks: False
force: False
force_32bit: False
force_reinstall: False
force_remove: False
ignore_pinned: False
json: False
local_repodata_ttl: 1
migrated_channel_aliases: []
migrated_custom_channels: {}
non_admin_enabled: True
notify_outdated_conda: True
offline: False
override_channels_enabled: True
path_conflict: clobber
pinned_packages: []
pip_interop_enabled: False
pkgs_dirs:
  - /scratch/03076/gzynda/conda_local/pkgs
  - /scratch/apps/conda/4.8.3/pkgs
proxy_servers: {}
quiet: False
remote_backoff_factor: 1
remote_connect_timeout_secs: 9.15
remote_max_retries: 3
remote_read_timeout_secs: 60.0
repodata_fns:
  - current_repodata.json
  - repodata.json
repodata_threads: 4
report_errors: None
restore_free_channel: False
rollback_enabled: True
root_prefix: /scratch/apps/conda/4.8.3
safety_checks: warn
sat_solver: pycosat
separate_format_cache: False
shortcuts: True
show_channel_urls: None
solver_ignore_timestamps: False
ssl_verify: True
subdir: linux-ppc64le
subdirs:
  - linux-ppc64le
  - noarch
target_prefix_override: 
track_features: []
unsatisfiable_hints: True
unsatisfiable_hints_check_depth: 2
update_modifier: update_specs
use_index_cache: False
use_local: False
use_only_tar_bz2: False
verbosity: 0
verify_threads: 4
whitelist_channels: []

$ conda create -n pai17 python=3 powerai=1.7

Collecting package metadata (current_repodata.json): done
Solving environment: failed with repodata from current_repodata.json, will retry with next repodata source.
Collecting package metadata (repodata.json): done
Solving environment: done

## Package Plan ##

  environment location: /scratch/03076/gzynda/conda_local/envs/pai17

  added / updated specs:
    - powerai=1.7
    - python=3


The following NEW packages will be INSTALLED:

  _libgcc_mutex      pkgs/main/linux-ppc64le::_libgcc_mutex-0.1-main
  _py-xgboost-mutex  ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::_py-xgboost-mutex-1.0-gpu_645.ge505a9a
  _pytorch_select    ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::_pytorch_select-2.0-gpu_21940.g1a3a219
  _tflow_select      ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::_tflow_select-2.1.0-gpu_929.g59c9804
  absl-py            pkgs/main/linux-ppc64le::absl-py-0.8.1-py37_0
  apex               ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::apex-0.1.0_1.7.0-py37_662.gb1ba068
  astor              pkgs/main/linux-ppc64le::astor-0.8.0-py37_0
  atomicwrites       pkgs/main/noarch::atomicwrites-1.4.0-py_0
  attrs              pkgs/main/noarch::attrs-19.3.0-py_0
  blas               pkgs/main/linux-ppc64le::blas-1.0-openblas
  bokeh              pkgs/main/linux-ppc64le::bokeh-1.4.0-py37_0
  boost              pkgs/main/linux-ppc64le::boost-1.67.0-py37_4
  brotlipy           pkgs/main/linux-ppc64le::brotlipy-0.7.0-py37h7b6447c_1000
  bzip2              pkgs/main/linux-ppc64le::bzip2-1.0.8-h7b6447c_0
  c-ares             pkgs/main/linux-ppc64le::c-ares-1.15.0-h7b6447c_1001
  ca-certificates    pkgs/main/linux-ppc64le::ca-certificates-2020.6.24-0
  caffe              ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::caffe-1.0_1.7.0-5247.g03f78fb
  caffe-base         ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::caffe-base-1.0_1.7.0-gpu_py37_5247.g03f78fb
  cairo              pkgs/main/linux-ppc64le::cairo-1.14.12-h8948797_3
  certifi            pkgs/main/linux-ppc64le::certifi-2020.6.20-py37_0
  cffi               pkgs/main/linux-ppc64le::cffi-1.12.3-py37h2e261b9_0
  chardet            pkgs/main/linux-ppc64le::chardet-3.0.4-py37_1003
  click              pkgs/main/linux-ppc64le::click-7.0-py37_0
  cloudpickle        pkgs/main/noarch::cloudpickle-1.2.2-py_0
  coverage           pkgs/main/linux-ppc64le::coverage-4.5.4-py37h7b6447c_0
  cryptography       pkgs/main/linux-ppc64le::cryptography-2.9.2-py37h1ba5d50_0
  cudatoolkit        ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::cudatoolkit-10.2.89-680.g0f7a43a
  cudnn              ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::cudnn-7.6.5_10.2-650.g338a052
  cxxfilt            ibmdl/export/pub/software/server/ibm-ai/conda/noarch::cxxfilt-0.2.0-py_622.gbc2955e
  cycler             pkgs/main/linux-ppc64le::cycler-0.10.0-py37_0
  cytoolz            pkgs/main/linux-ppc64le::cytoolz-0.10.1-py37h7b6447c_0
  dask               pkgs/main/noarch::dask-2.9.2-py_0
  dask-core          pkgs/main/noarch::dask-core-2.9.2-py_0
  dask-cuda          ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::dask-cuda-0.11.0-py37_630.g2290d8e
  dask-xgboost       ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::dask-xgboost-0.1.9-py37_647.g2eb49b6
  ddl                ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::ddl-1.5.1-py37_1364.ged89432
  ddl-tensorflow     ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::ddl-tensorflow-1.5.1-py37_1073.g105e407
  decorator          pkgs/main/noarch::decorator-4.4.2-py_0
  distributed        pkgs/main/noarch::distributed-2.9.3-py_0
  ffmpeg             pkgs/main/linux-ppc64le::ffmpeg-4.2.2-h20bf706_0
  fontconfig         pkgs/main/linux-ppc64le::fontconfig-2.13.0-h9420a91_0
  freeglut           pkgs/main/linux-ppc64le::freeglut-3.0.0-hf484d3e_5
  freetype           pkgs/main/linux-ppc64le::freetype-2.9.1-h8a8886c_0
  fsspec             pkgs/main/noarch::fsspec-0.7.4-py_0
  future             pkgs/main/linux-ppc64le::future-0.17.1-py37_0
  gast               pkgs/main/linux-ppc64le::gast-0.2.2-py37_0
  gflags             ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::gflags-2.2.2-1679.g1bcb8ab
  giflib             pkgs/main/linux-ppc64le::giflib-5.1.4-h14c3975_1
  glib               pkgs/main/linux-ppc64le::glib-2.63.1-h5a9c865_0
  glog               ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::glog-0.3.5-1668.g110e904
  gmp                pkgs/main/linux-ppc64le::gmp-6.1.2-h7f7056e_2
  gnutls             pkgs/main/linux-ppc64le::gnutls-3.6.5-h71b1129_1002
  google-pasta       ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::google-pasta-0.1.8-py37_622.gd00f35a
  graphite2          pkgs/main/linux-ppc64le::graphite2-1.3.14-h23475e2_0
  graphsurgeon       ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::graphsurgeon-0.4.1-py37_697.g9922bde
  grpcio             pkgs/main/linux-ppc64le::grpcio-1.16.1-py37hf8bcb03_1
  h5py               pkgs/main/linux-ppc64le::h5py-2.8.0-py37h8d01980_0
  harfbuzz           pkgs/main/linux-ppc64le::harfbuzz-1.8.8-hffaf4a1_0
  hdf5               pkgs/main/linux-ppc64le::hdf5-1.10.2-hba1933b_1
  heapdict           pkgs/main/noarch::heapdict-1.0.1-py_0
  horovod            ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::horovod-0.19.0-py37_1105.g5e1e5d1
  hypothesis         pkgs/main/linux-ppc64le::hypothesis-3.59.1-py37h39e3cac_0
  icu                pkgs/main/linux-ppc64le::icu-58.2-he6710b0_3
  idna               pkgs/main/linux-ppc64le::idna-2.8-py37_0
  imageio            pkgs/main/noarch::imageio-2.9.0-py_0
  importlib-metadata pkgs/main/linux-ppc64le::importlib-metadata-1.7.0-py37_0
  importlib_metadata pkgs/main/noarch::importlib_metadata-1.7.0-0
  jasper             pkgs/main/linux-ppc64le::jasper-2.0.14-h07fcdf6_1
  jinja2             pkgs/main/noarch::jinja2-2.11.2-py_0
  joblib             pkgs/main/linux-ppc64le::joblib-0.13.2-py37_0
  jpeg               pkgs/main/linux-ppc64le::jpeg-9b-hcb7ba68_2
  keras-applications pkgs/main/noarch::keras-applications-1.0.8-py_1
  keras-preprocessi~ pkgs/main/noarch::keras-preprocessing-1.1.0-py_1
  kiwisolver         pkgs/main/linux-ppc64le::kiwisolver-1.2.0-py37hfd86e86_0
  lame               pkgs/main/linux-ppc64le::lame-3.100-h7b6447c_0
  ld_impl_linux-ppc~ pkgs/main/linux-ppc64le::ld_impl_linux-ppc64le-2.33.1-h0f24833_7
  leveldb            pkgs/main/linux-ppc64le::leveldb-1.20-hf484d3e_1
  libboost           pkgs/main/linux-ppc64le::libboost-1.67.0-h46d08c1_4
  libedit            pkgs/main/linux-ppc64le::libedit-3.1.20191231-h14c3975_1
  libffi             pkgs/main/linux-ppc64le::libffi-3.2.1-hf62a594_5
  libgcc-ng          pkgs/main/linux-ppc64le::libgcc-ng-8.2.0-h822a55f_1
  libgfortran-ng     pkgs/main/linux-ppc64le::libgfortran-ng-7.3.0-h822a55f_1
  libglu             pkgs/main/linux-ppc64le::libglu-9.0.0-hf484d3e_1
  libopenblas        pkgs/main/linux-ppc64le::libopenblas-0.3.6-h5a2b251_1
  libopencv          ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::libopencv-3.4.8-py37_784.g5a642ca
  libopus            pkgs/main/linux-ppc64le::libopus-1.3.1-h7b6447c_0
  libpng             pkgs/main/linux-ppc64le::libpng-1.6.36-hbc83047_0
  libprotobuf        ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::libprotobuf-3.8.0-634.g08dc819
  libstdcxx-ng       pkgs/main/linux-ppc64le::libstdcxx-ng-8.2.0-h822a55f_1
  libtiff            pkgs/main/linux-ppc64le::libtiff-4.1.0-h2733197_1
  libuuid            pkgs/main/linux-ppc64le::libuuid-1.0.3-h1bed415_2
  libvpx             pkgs/main/linux-ppc64le::libvpx-1.7.0-hf484d3e_0
  libwebp            pkgs/main/linux-ppc64le::libwebp-1.0.1-h8e7db2f_0
  libxcb             pkgs/main/linux-ppc64le::libxcb-1.14-h7b6447c_0
  libxgboost-base    ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::libxgboost-base-0.90-gpu_645.ge505a9a
  libxml2            pkgs/main/linux-ppc64le::libxml2-2.9.10-he19cac6_1
  llvmlite           pkgs/main/linux-ppc64le::llvmlite-0.31.0-py37hd408876_0
  lmdb               pkgs/main/linux-ppc64le::lmdb-0.9.22-hf484d3e_1
  locket             pkgs/main/linux-ppc64le::locket-0.2.0-py37_1
  lz4-c              pkgs/main/linux-ppc64le::lz4-c-1.9.2-he6710b0_0
  markdown           pkgs/main/linux-ppc64le::markdown-3.1.1-py37_0
  markupsafe         pkgs/main/linux-ppc64le::markupsafe-1.1.1-py37h7b6447c_0
  matplotlib         pkgs/main/linux-ppc64le::matplotlib-3.0.3-py37h5429711_0
  mock               pkgs/main/linux-ppc64le::mock-3.0.5-py37_0
  more-itertools     pkgs/main/noarch::more-itertools-8.4.0-py_0
  msgpack-python     pkgs/main/linux-ppc64le::msgpack-python-1.0.0-py37hfd86e86_1
  nccl               ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::nccl-2.5.6-645.g51c2e94
  ncurses            pkgs/main/linux-ppc64le::ncurses-6.2-he6710b0_1
  nettle             pkgs/main/linux-ppc64le::nettle-3.4.1-hbb512f6_0
  networkx           pkgs/main/noarch::networkx-2.3-py_0
  ninja              pkgs/main/linux-ppc64le::ninja-1.9.0-py37hfd86e86_0
  nomkl              pkgs/main/linux-ppc64le::nomkl-3.0-0
  numactl            ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::numactl-2.0.12-628.gb5e1afd
  numba              pkgs/main/linux-ppc64le::numba-0.47.0-py37h962f231_0
  numpy              pkgs/main/linux-ppc64le::numpy-1.17.4-py37hd5be1e1_0
  numpy-base         pkgs/main/linux-ppc64le::numpy-base-1.17.4-py37h2f8d375_0
  olefile            pkgs/main/linux-ppc64le::olefile-0.46-py37_0
  onnx               ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::onnx-1.6.0-py37_671.g75d3229
  openblas           pkgs/main/linux-ppc64le::openblas-0.3.6-1
  openblas-devel     pkgs/main/linux-ppc64le::openblas-devel-0.3.6-1
  opencv             ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::opencv-3.4.8-py37_784.g5a642ca
  openh264           pkgs/main/linux-ppc64le::openh264-2.1.0-hd408876_0
  openssl            pkgs/main/linux-ppc64le::openssl-1.1.1g-h7b6447c_0
  opt_einsum         pkgs/main/noarch::opt_einsum-3.1.0-py_0
  packaging          pkgs/main/noarch::packaging-20.4-py_0
  pai4sk             ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::pai4sk-1.6.0-py37_1156.g99299fc
  pandas             pkgs/main/linux-ppc64le::pandas-1.0.5-py37h0573a6f_0
  partd              pkgs/main/noarch::partd-1.1.0-py_0
  pciutils           ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::pciutils-3.6.2-627.g804ec60
  pcre               pkgs/main/linux-ppc64le::pcre-8.44-he6710b0_0
  pillow             pkgs/main/linux-ppc64le::pillow-7.1.2-py37haac5956_0
  pip                pkgs/main/linux-ppc64le::pip-20.1.1-py37_1
  pixman             pkgs/main/linux-ppc64le::pixman-0.40.0-h7b6447c_0
  pluggy             pkgs/main/linux-ppc64le::pluggy-0.13.1-py37_0
  powerai            ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::powerai-1.7.0-679.g5b5a006
  powerai-license    ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::powerai-license-1.7.0-778.g91a0fd9
  powerai-release    ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::powerai-release-1.7.0-627.g1c389a2
  powerai-tools      ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::powerai-tools-1.7.0-623.g843ad38
  protobuf           ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::protobuf-3.8.0-py37_642.gdc7b773
  psutil             pkgs/main/linux-ppc64le::psutil-5.6.7-py37h7b6447c_0
  py                 pkgs/main/noarch::py-1.9.0-py_0
  py-boost           pkgs/main/linux-ppc64le::py-boost-1.67.0-py37h04863e7_4
  py-opencv          ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::py-opencv-3.4.8-py37_784.g5a642ca
  py-xgboost-base    ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::py-xgboost-base-0.90-gpu_py37_645.ge505a9a
  py-xgboost-gpu     ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::py-xgboost-gpu-0.90-645.ge505a9a
  pycparser          pkgs/main/noarch::pycparser-2.20-py_2
  pynvml             ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::pynvml-8.0.3-py37_618.g443d2aa
  pyopenssl          pkgs/main/noarch::pyopenssl-19.1.0-py_1
  pyparsing          pkgs/main/noarch::pyparsing-2.4.7-py_0
  pysocks            pkgs/main/linux-ppc64le::pysocks-1.7.1-py37_1
  pytest             pkgs/main/linux-ppc64le::pytest-4.4.2-py37_0
  python             pkgs/main/linux-ppc64le::python-3.7.7-ha29dc6b_0_cpython
  python-dateutil    pkgs/main/noarch::python-dateutil-2.8.1-py_0
  python-lmdb        pkgs/main/linux-ppc64le::python-lmdb-0.98-py37he6710b0_0
  pytorch            ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::pytorch-1.3.1-21940.g1a3a219
  pytorch-base       ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::pytorch-base-1.3.1-gpu_py37_21940.g1a3a219
  pytz               pkgs/main/noarch::pytz-2020.1-py_0
  pywavelets         pkgs/main/linux-ppc64le::pywavelets-1.1.1-py37h7b6447c_0
  pyyaml             pkgs/main/linux-ppc64le::pyyaml-5.3.1-py37h7b6447c_1
  readline           pkgs/main/linux-ppc64le::readline-8.0-h7b6447c_0
  requests           pkgs/main/linux-ppc64le::requests-2.22.0-py37_1
  scikit-image       pkgs/main/linux-ppc64le::scikit-image-0.15.0-py37he6710b0_0
  scikit-learn       pkgs/main/linux-ppc64le::scikit-learn-0.22.1-py37h22eb022_0
  scipy              pkgs/main/linux-ppc64le::scipy-1.3.1-py37he2b7bc3_0
  setuptools         pkgs/main/linux-ppc64le::setuptools-49.2.0-py37_0
  simsearch          ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::simsearch-1.6.0-py37_882.ga3f4a67
  six                pkgs/main/linux-ppc64le::six-1.13.0-py37_0
  snapml-spark       ibmdl/export/pub/software/server/ibm-ai/conda/noarch::snapml-spark-1.6.0-py_1020.gc01d7a8
  snappy             pkgs/main/linux-ppc64le::snappy-1.1.7-h1532aa0_3
  sortedcontainers   pkgs/main/noarch::sortedcontainers-2.2.2-py_0
  spectrum-mpi       ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::spectrum-mpi-10.03-678.ga72dafb
  sqlite             pkgs/main/linux-ppc64le::sqlite-3.32.3-hbc83047_0
  tabulate           pkgs/main/linux-ppc64le::tabulate-0.8.2-py37_0
  tbb                pkgs/main/linux-ppc64le::tbb-2020.0-hfd86e86_0
  tblib              pkgs/main/noarch::tblib-1.6.0-py_0
  tensorboard        ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::tensorboard-2.1.0-py37_3dc74fe_3959.g2372771
  tensorflow         ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::tensorflow-2.1.1-gpu_py37_934.g2372771
  tensorflow-base    ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::tensorflow-base-2.1.1-gpu_py37_3ffdb91_72692.g44a6283
  tensorflow-benchm~ ibmdl/export/pub/software/server/ibm-ai/conda/noarch::tensorflow-benchmarks-0.1-gpu_py_627.gb971bf9
  tensorflow-estima~ ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::tensorflow-estimator-2.1.0-py37_7ec4e5d_1477.g59c9804
  tensorflow-gpu     ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::tensorflow-gpu-2.1.1-934.g2372771
  tensorflow-probab~ ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::tensorflow-probability-0.9.0-py37_356cfdd_3242.g59c9804
  tensorflow-servin~ ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::tensorflow-serving-api-2.1.0-py37_d83512c_5308.gf3d82d3
  tensorrt           ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::tensorrt-7.0.0.11-py37_697.g9922bde
  termcolor          pkgs/main/linux-ppc64le::termcolor-1.1.0-py37_1
  tk                 pkgs/main/linux-ppc64le::tk-8.6.10-hbc83047_0
  toolz              pkgs/main/noarch::toolz-0.10.0-py_0
  torchtext          ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::torchtext-0.4.0-py37_633.g16a90d7
  torchvision-base   ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::torchvision-base-0.4.2-gpu_py37_661.g37d5d4d
  tornado            pkgs/main/linux-ppc64le::tornado-6.0.4-py37h7b6447c_1
  tqdm               pkgs/main/noarch::tqdm-4.36.1-py_0
  typing             pkgs/main/linux-ppc64le::typing-3.6.4-py37_0
  uff                ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::uff-0.6.5-py37_697.g9922bde
  urllib3            pkgs/main/noarch::urllib3-1.25.9-py_0
  werkzeug           pkgs/main/noarch::werkzeug-0.16.0-py_0
  wheel              pkgs/main/linux-ppc64le::wheel-0.34.2-py37_0
  wrapt              pkgs/main/linux-ppc64le::wrapt-1.11.2-py37h7b6447c_0
  x264               pkgs/main/linux-ppc64le::x264-1!157.20191217-h7b6447c_0
  xz                 pkgs/main/linux-ppc64le::xz-5.2.5-h7b6447c_0
  yaml               pkgs/main/linux-ppc64le::yaml-0.2.5-h7b6447c_0
  zict               pkgs/main/noarch::zict-2.0.0-py_0
  zipp               pkgs/main/noarch::zipp-3.1.0-py_0
  zlib               pkgs/main/linux-ppc64le::zlib-1.2.11-h7b6447c_3
  zstd               pkgs/main/linux-ppc64le::zstd-1.4.5-h0b5b093_0


Proceed ([y]/n)? y

Preparing transaction: done
Verifying transaction: done
Executing transaction: done
#
# To activate this environment, use
#
#     $ conda activate pai17
#
# To deactivate an active environment, use
#
#     $ conda deactivate

$ conda activate pai17
(pai17) $ pip install mpi4py

Collecting mpi4py
  Using cached mpi4py-3.0.3.tar.gz (1.4 MB)
Building wheels for collected packages: mpi4py
  Building wheel for mpi4py (setup.py) ... error
  ERROR: Command errored out with exit status 1:
   command: /scratch/03076/gzynda/conda_local/envs/pai17/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-j_4pv84w/mpi4py/setup.py'"'"'; __file__='"'"'/tmp/pip-install-j_4pv84w/mpi4py/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-tjsbidsb
       cwd: /tmp/pip-install-j_4pv84w/mpi4py/
  Complete output (134 lines):
  running bdist_wheel
  running build
  running build_src
  running build_py
  creating build
  creating build/lib.linux-ppc64le-3.7
  creating build/lib.linux-ppc64le-3.7/mpi4py
  copying src/mpi4py/run.py -> build/lib.linux-ppc64le-3.7/mpi4py
  copying src/mpi4py/__main__.py -> build/lib.linux-ppc64le-3.7/mpi4py
  copying src/mpi4py/bench.py -> build/lib.linux-ppc64le-3.7/mpi4py
  copying src/mpi4py/__init__.py -> build/lib.linux-ppc64le-3.7/mpi4py
  creating build/lib.linux-ppc64le-3.7/mpi4py/futures
  copying src/mpi4py/futures/__main__.py -> build/lib.linux-ppc64le-3.7/mpi4py/futures
  copying src/mpi4py/futures/_base.py -> build/lib.linux-ppc64le-3.7/mpi4py/futures
  copying src/mpi4py/futures/server.py -> build/lib.linux-ppc64le-3.7/mpi4py/futures
  copying src/mpi4py/futures/pool.py -> build/lib.linux-ppc64le-3.7/mpi4py/futures
  copying src/mpi4py/futures/_lib.py -> build/lib.linux-ppc64le-3.7/mpi4py/futures
  copying src/mpi4py/futures/__init__.py -> build/lib.linux-ppc64le-3.7/mpi4py/futures
  copying src/mpi4py/futures/aplus.py -> build/lib.linux-ppc64le-3.7/mpi4py/futures
  copying src/mpi4py/MPI.pxd -> build/lib.linux-ppc64le-3.7/mpi4py
  copying src/mpi4py/__init__.pxd -> build/lib.linux-ppc64le-3.7/mpi4py
  copying src/mpi4py/libmpi.pxd -> build/lib.linux-ppc64le-3.7/mpi4py
  creating build/lib.linux-ppc64le-3.7/mpi4py/include
  creating build/lib.linux-ppc64le-3.7/mpi4py/include/mpi4py
  copying src/mpi4py/include/mpi4py/mpi4py.MPI_api.h -> build/lib.linux-ppc64le-3.7/mpi4py/include/mpi4py
  copying src/mpi4py/include/mpi4py/mpi4py.MPI.h -> build/lib.linux-ppc64le-3.7/mpi4py/include/mpi4py
  copying src/mpi4py/include/mpi4py/mpi4py.h -> build/lib.linux-ppc64le-3.7/mpi4py/include/mpi4py
  copying src/mpi4py/include/mpi4py/mpi4py.i -> build/lib.linux-ppc64le-3.7/mpi4py/include/mpi4py
  copying src/mpi4py/include/mpi4py/mpi.pxi -> build/lib.linux-ppc64le-3.7/mpi4py/include/mpi4py
  running build_clib
  MPI configuration: [mpi] from 'mpi.cfg'
  MPI C compiler:    /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc
  MPI C++ compiler:  /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicxx
  MPI F compiler:    /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpifort
  MPI F90 compiler:  /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpif90
  MPI F77 compiler:  /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpif77
  checking for library 'lmpe' ...
  /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
  /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
  failure.
  removing: _configtest.c _configtest.o
  building 'mpe' dylib library
  creating build/temp.linux-ppc64le-3.7
  creating build/temp.linux-ppc64le-3.7/src
  creating build/temp.linux-ppc64le-3.7/src/lib-pmpi
  /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c src/lib-pmpi/mpe.c -o build/temp.linux-ppc64le-3.7/src/lib-pmpi/mpe.o
  /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
  warning: build_clib: command '/scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc' failed with exit status 255
  
  warning: build_clib: building optional library "mpe" failed
  
  checking for library 'vt-mpi' ...
  /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
  /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
  failure.
  removing: _configtest.c _configtest.o
  checking for library 'vt.mpi' ...
  /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
  /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
  failure.
  removing: _configtest.c _configtest.o
  building 'vt' dylib library
  /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c src/lib-pmpi/vt.c -o build/temp.linux-ppc64le-3.7/src/lib-pmpi/vt.o
  /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
  warning: build_clib: command '/scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc' failed with exit status 255
  
  warning: build_clib: building optional library "vt" failed
  
  checking for library 'vt-mpi' ...
  /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
  /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
  failure.
  removing: _configtest.c _configtest.o
  checking for library 'vt.mpi' ...
  /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
  /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
  failure.
  removing: _configtest.c _configtest.o
  building 'vt-mpi' dylib library
  /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c src/lib-pmpi/vt-mpi.c -o build/temp.linux-ppc64le-3.7/src/lib-pmpi/vt-mpi.o
  /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
  warning: build_clib: command '/scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc' failed with exit status 255
  
  warning: build_clib: building optional library "vt-mpi" failed
  
  checking for library 'vt-hyb' ...
  /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
  /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
  failure.
  removing: _configtest.c _configtest.o
  checking for library 'vt.ompi' ...
  /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
  /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
  failure.
  removing: _configtest.c _configtest.o
  building 'vt-hyb' dylib library
  /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c src/lib-pmpi/vt-hyb.c -o build/temp.linux-ppc64le-3.7/src/lib-pmpi/vt-hyb.o
  /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
  warning: build_clib: command '/scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc' failed with exit status 255
  
  warning: build_clib: building optional library "vt-hyb" failed
  
  running build_ext
  MPI configuration: [mpi] from 'mpi.cfg'
  MPI C compiler:    /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc
  MPI C++ compiler:  /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicxx
  MPI F compiler:    /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpifort
  MPI F90 compiler:  /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpif90
  MPI F77 compiler:  /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpif77
  checking for dlopen() availability ...
  checking for header 'dlfcn.h' ...
  gcc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/scratch/03076/gzynda/conda_local/envs/pai17/include/python3.7m -c _configtest.c -o _configtest.o
  success!
  removing: _configtest.c _configtest.o
  success!
  checking for library 'dl' ...
  gcc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/scratch/03076/gzynda/conda_local/envs/pai17/include/python3.7m -c _configtest.c -o _configtest.o
  gcc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ _configtest.o -Lbuild/temp.linux-ppc64le-3.7 -ldl -o _configtest
  success!
  removing: _configtest.c _configtest.o _configtest
  checking for function 'dlopen' ...
  gcc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/scratch/03076/gzynda/conda_local/envs/pai17/include/python3.7m -c _configtest.c -o _configtest.o
  gcc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ _configtest.o -Lbuild/temp.linux-ppc64le-3.7 -ldl -o _configtest
  success!
  removing: _configtest.c _configtest.o _configtest
  building 'mpi4py.dl' extension
  gcc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -DHAVE_DLFCN_H=1 -DHAVE_DLOPEN=1 -I/scratch/03076/gzynda/conda_local/envs/pai17/include/python3.7m -c src/dynload.c -o build/temp.linux-ppc64le-3.7/src/dynload.o
  gcc -pthread -shared -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -L/scratch/03076/gzynda/conda_local/envs/pai17/lib -Wl,-rpath=/scratch/03076/gzynda/conda_local/envs/pai17/lib -Wl,--no-as-needed -Wl,--sysroot=/ build/temp.linux-ppc64le-3.7/src/dynload.o -Lbuild/temp.linux-ppc64le-3.7 -ldl -o build/lib.linux-ppc64le-3.7/mpi4py/dl.cpython-37m-powerpc64le-linux-gnu.so
  checking for MPI compile and link ...
  /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/scratch/03076/gzynda/conda_local/envs/pai17/include/python3.7m -c _configtest.c -o _configtest.o
  /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
  failure.
  removing: _configtest.c _configtest.o
  error: Cannot compile MPI programs. Check your configuration!!!
  ----------------------------------------
  ERROR: Failed building wheel for mpi4py
  Running setup.py clean for mpi4py
Failed to build mpi4py
Installing collected packages: mpi4py
    Running setup.py install for mpi4py ... error
    ERROR: Command errored out with exit status 1:
     command: /scratch/03076/gzynda/conda_local/envs/pai17/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-j_4pv84w/mpi4py/setup.py'"'"'; __file__='"'"'/tmp/pip-install-j_4pv84w/mpi4py/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-2c9mz01o/install-record.txt --single-version-externally-managed --compile --install-headers /scratch/03076/gzynda/conda_local/envs/pai17/include/python3.7m/mpi4py
         cwd: /tmp/pip-install-j_4pv84w/mpi4py/
    Complete output (134 lines):
    running install
    running build
    running build_src
    running build_py
    creating build
    creating build/lib.linux-ppc64le-3.7
    creating build/lib.linux-ppc64le-3.7/mpi4py
    copying src/mpi4py/run.py -> build/lib.linux-ppc64le-3.7/mpi4py
    copying src/mpi4py/__main__.py -> build/lib.linux-ppc64le-3.7/mpi4py
    copying src/mpi4py/bench.py -> build/lib.linux-ppc64le-3.7/mpi4py
    copying src/mpi4py/__init__.py -> build/lib.linux-ppc64le-3.7/mpi4py
    creating build/lib.linux-ppc64le-3.7/mpi4py/futures
    copying src/mpi4py/futures/__main__.py -> build/lib.linux-ppc64le-3.7/mpi4py/futures
    copying src/mpi4py/futures/_base.py -> build/lib.linux-ppc64le-3.7/mpi4py/futures
    copying src/mpi4py/futures/server.py -> build/lib.linux-ppc64le-3.7/mpi4py/futures
    copying src/mpi4py/futures/pool.py -> build/lib.linux-ppc64le-3.7/mpi4py/futures
    copying src/mpi4py/futures/_lib.py -> build/lib.linux-ppc64le-3.7/mpi4py/futures
    copying src/mpi4py/futures/__init__.py -> build/lib.linux-ppc64le-3.7/mpi4py/futures
    copying src/mpi4py/futures/aplus.py -> build/lib.linux-ppc64le-3.7/mpi4py/futures
    copying src/mpi4py/MPI.pxd -> build/lib.linux-ppc64le-3.7/mpi4py
    copying src/mpi4py/__init__.pxd -> build/lib.linux-ppc64le-3.7/mpi4py
    copying src/mpi4py/libmpi.pxd -> build/lib.linux-ppc64le-3.7/mpi4py
    creating build/lib.linux-ppc64le-3.7/mpi4py/include
    creating build/lib.linux-ppc64le-3.7/mpi4py/include/mpi4py
    copying src/mpi4py/include/mpi4py/mpi4py.MPI_api.h -> build/lib.linux-ppc64le-3.7/mpi4py/include/mpi4py
    copying src/mpi4py/include/mpi4py/mpi4py.MPI.h -> build/lib.linux-ppc64le-3.7/mpi4py/include/mpi4py
    copying src/mpi4py/include/mpi4py/mpi4py.h -> build/lib.linux-ppc64le-3.7/mpi4py/include/mpi4py
    copying src/mpi4py/include/mpi4py/mpi4py.i -> build/lib.linux-ppc64le-3.7/mpi4py/include/mpi4py
    copying src/mpi4py/include/mpi4py/mpi.pxi -> build/lib.linux-ppc64le-3.7/mpi4py/include/mpi4py
    running build_clib
    MPI configuration: [mpi] from 'mpi.cfg'
    MPI C compiler:    /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc
    MPI C++ compiler:  /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicxx
    MPI F compiler:    /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpifort
    MPI F90 compiler:  /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpif90
    MPI F77 compiler:  /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpif77
    checking for library 'lmpe' ...
    /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
    /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
    failure.
    removing: _configtest.c _configtest.o
    building 'mpe' dylib library
    creating build/temp.linux-ppc64le-3.7
    creating build/temp.linux-ppc64le-3.7/src
    creating build/temp.linux-ppc64le-3.7/src/lib-pmpi
    /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c src/lib-pmpi/mpe.c -o build/temp.linux-ppc64le-3.7/src/lib-pmpi/mpe.o
    /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
    warning: build_clib: command '/scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc' failed with exit status 255
    
    warning: build_clib: building optional library "mpe" failed
    
    checking for library 'vt-mpi' ...
    /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
    /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
    failure.
    removing: _configtest.c _configtest.o
    checking for library 'vt.mpi' ...
    /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
    /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
    failure.
    removing: _configtest.c _configtest.o
    building 'vt' dylib library
    /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c src/lib-pmpi/vt.c -o build/temp.linux-ppc64le-3.7/src/lib-pmpi/vt.o
    /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
    warning: build_clib: command '/scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc' failed with exit status 255
    
    warning: build_clib: building optional library "vt" failed
    
    checking for library 'vt-mpi' ...
    /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
    /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
    failure.
    removing: _configtest.c _configtest.o
    checking for library 'vt.mpi' ...
    /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
    /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
    failure.
    removing: _configtest.c _configtest.o
    building 'vt-mpi' dylib library
    /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c src/lib-pmpi/vt-mpi.c -o build/temp.linux-ppc64le-3.7/src/lib-pmpi/vt-mpi.o
    /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
    warning: build_clib: command '/scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc' failed with exit status 255
    
    warning: build_clib: building optional library "vt-mpi" failed
    
    checking for library 'vt-hyb' ...
    /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
    /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
    failure.
    removing: _configtest.c _configtest.o
    checking for library 'vt.ompi' ...
    /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
    /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
    failure.
    removing: _configtest.c _configtest.o
    building 'vt-hyb' dylib library
    /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c src/lib-pmpi/vt-hyb.c -o build/temp.linux-ppc64le-3.7/src/lib-pmpi/vt-hyb.o
    /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
    warning: build_clib: command '/scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc' failed with exit status 255
    
    warning: build_clib: building optional library "vt-hyb" failed
    
    running build_ext
    MPI configuration: [mpi] from 'mpi.cfg'
    MPI C compiler:    /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc
    MPI C++ compiler:  /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicxx
    MPI F compiler:    /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpifort
    MPI F90 compiler:  /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpif90
    MPI F77 compiler:  /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpif77
    checking for dlopen() availability ...
    checking for header 'dlfcn.h' ...
    gcc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/scratch/03076/gzynda/conda_local/envs/pai17/include/python3.7m -c _configtest.c -o _configtest.o
    success!
    removing: _configtest.c _configtest.o
    success!
    checking for library 'dl' ...
    gcc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/scratch/03076/gzynda/conda_local/envs/pai17/include/python3.7m -c _configtest.c -o _configtest.o
    gcc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ _configtest.o -Lbuild/temp.linux-ppc64le-3.7 -ldl -o _configtest
    success!
    removing: _configtest.c _configtest.o _configtest
    checking for function 'dlopen' ...
    gcc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/scratch/03076/gzynda/conda_local/envs/pai17/include/python3.7m -c _configtest.c -o _configtest.o
    gcc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ _configtest.o -Lbuild/temp.linux-ppc64le-3.7 -ldl -o _configtest
    success!
    removing: _configtest.c _configtest.o _configtest
    building 'mpi4py.dl' extension
    gcc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -DHAVE_DLFCN_H=1 -DHAVE_DLOPEN=1 -I/scratch/03076/gzynda/conda_local/envs/pai17/include/python3.7m -c src/dynload.c -o build/temp.linux-ppc64le-3.7/src/dynload.o
    gcc -pthread -shared -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -L/scratch/03076/gzynda/conda_local/envs/pai17/lib -Wl,-rpath=/scratch/03076/gzynda/conda_local/envs/pai17/lib -Wl,--no-as-needed -Wl,--sysroot=/ build/temp.linux-ppc64le-3.7/src/dynload.o -Lbuild/temp.linux-ppc64le-3.7 -ldl -o build/lib.linux-ppc64le-3.7/mpi4py/dl.cpython-37m-powerpc64le-linux-gnu.so
    checking for MPI compile and link ...
    /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/scratch/03076/gzynda/conda_local/envs/pai17/include/python3.7m -c _configtest.c -o _configtest.o
    /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
    failure.
    removing: _configtest.c _configtest.o
    error: Cannot compile MPI programs. Check your configuration!!!
    ----------------------------------------
ERROR: Command errored out with exit status 1: /scratch/03076/gzynda/conda_local/envs/pai17/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-j_4pv84w/mpi4py/setup.py'"'"'; __file__='"'"'/tmp/pip-install-j_4pv84w/mpi4py/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-2c9mz01o/install-record.txt --single-version-externally-managed --compile --install-headers /scratch/03076/gzynda/conda_local/envs/pai17/include/python3.7m/mpi4py Check the logs for full command output.

Compiling it using the system spectrum MPI in a new python3 environment with only setuptools and wheel also fails.

$ conda create -n py3 python=3 setuptools wheel
$ conda activate py3
(py3) $ pip install mpi4py

Collecting mpi4py
  Using cached mpi4py-3.0.3.tar.gz (1.4 MB)
Building wheels for collected packages: mpi4py
  Building wheel for mpi4py (setup.py) ... error
  ERROR: Command errored out with exit status 1:
   command: /scratch/03076/gzynda/conda_local/envs/py3/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-v8o084bu/mpi4py/setup.py'"'"'; __file__='"'"'/tmp/pip-install-v8o084bu/mpi4py/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-xg6jrxrt
       cwd: /tmp/pip-install-v8o084bu/mpi4py/
  Complete output (134 lines):
  running bdist_wheel
  running build
  running build_src
  running build_py
  creating build
  creating build/lib.linux-ppc64le-3.8
  creating build/lib.linux-ppc64le-3.8/mpi4py
  copying src/mpi4py/run.py -> build/lib.linux-ppc64le-3.8/mpi4py
  copying src/mpi4py/__main__.py -> build/lib.linux-ppc64le-3.8/mpi4py
  copying src/mpi4py/bench.py -> build/lib.linux-ppc64le-3.8/mpi4py
  copying src/mpi4py/__init__.py -> build/lib.linux-ppc64le-3.8/mpi4py
  creating build/lib.linux-ppc64le-3.8/mpi4py/futures
  copying src/mpi4py/futures/__main__.py -> build/lib.linux-ppc64le-3.8/mpi4py/futures
  copying src/mpi4py/futures/_base.py -> build/lib.linux-ppc64le-3.8/mpi4py/futures
  copying src/mpi4py/futures/server.py -> build/lib.linux-ppc64le-3.8/mpi4py/futures
  copying src/mpi4py/futures/pool.py -> build/lib.linux-ppc64le-3.8/mpi4py/futures
  copying src/mpi4py/futures/_lib.py -> build/lib.linux-ppc64le-3.8/mpi4py/futures
  copying src/mpi4py/futures/__init__.py -> build/lib.linux-ppc64le-3.8/mpi4py/futures
  copying src/mpi4py/futures/aplus.py -> build/lib.linux-ppc64le-3.8/mpi4py/futures
  copying src/mpi4py/MPI.pxd -> build/lib.linux-ppc64le-3.8/mpi4py
  copying src/mpi4py/__init__.pxd -> build/lib.linux-ppc64le-3.8/mpi4py
  copying src/mpi4py/libmpi.pxd -> build/lib.linux-ppc64le-3.8/mpi4py
  creating build/lib.linux-ppc64le-3.8/mpi4py/include
  creating build/lib.linux-ppc64le-3.8/mpi4py/include/mpi4py
  copying src/mpi4py/include/mpi4py/mpi4py.MPI_api.h -> build/lib.linux-ppc64le-3.8/mpi4py/include/mpi4py
  copying src/mpi4py/include/mpi4py/mpi4py.MPI.h -> build/lib.linux-ppc64le-3.8/mpi4py/include/mpi4py
  copying src/mpi4py/include/mpi4py/mpi4py.h -> build/lib.linux-ppc64le-3.8/mpi4py/include/mpi4py
  copying src/mpi4py/include/mpi4py/mpi4py.i -> build/lib.linux-ppc64le-3.8/mpi4py/include/mpi4py
  copying src/mpi4py/include/mpi4py/mpi.pxi -> build/lib.linux-ppc64le-3.8/mpi4py/include/mpi4py
  running build_clib
  MPI configuration: [mpi] from 'mpi.cfg'
  MPI C compiler:    /opt/ibm/spectrum_mpi/bin/mpicc
  MPI C++ compiler:  /opt/ibm/spectrum_mpi/bin/mpicxx
  MPI F compiler:    /opt/ibm/spectrum_mpi/bin/mpifort
  MPI F90 compiler:  /opt/ibm/spectrum_mpi/bin/mpif90
  MPI F77 compiler:  /opt/ibm/spectrum_mpi/bin/mpif77
  checking for library 'lmpe' ...
  /opt/ibm/spectrum_mpi/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
  /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
  failure.
  removing: _configtest.c _configtest.o
  building 'mpe' dylib library
  creating build/temp.linux-ppc64le-3.8
  creating build/temp.linux-ppc64le-3.8/src
  creating build/temp.linux-ppc64le-3.8/src/lib-pmpi
  /opt/ibm/spectrum_mpi/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c src/lib-pmpi/mpe.c -o build/temp.linux-ppc64le-3.8/src/lib-pmpi/mpe.o
  /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
  warning: build_clib: command '/opt/ibm/spectrum_mpi/bin/mpicc' failed with exit status 255
  
  warning: build_clib: building optional library "mpe" failed
  
  checking for library 'vt-mpi' ...
  /opt/ibm/spectrum_mpi/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
  /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
  failure.
  removing: _configtest.c _configtest.o
  checking for library 'vt.mpi' ...
  /opt/ibm/spectrum_mpi/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
  /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
  failure.
  removing: _configtest.c _configtest.o
  building 'vt' dylib library
  /opt/ibm/spectrum_mpi/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c src/lib-pmpi/vt.c -o build/temp.linux-ppc64le-3.8/src/lib-pmpi/vt.o
  /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
  warning: build_clib: command '/opt/ibm/spectrum_mpi/bin/mpicc' failed with exit status 255
  
  warning: build_clib: building optional library "vt" failed
  
  checking for library 'vt-mpi' ...
  /opt/ibm/spectrum_mpi/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
  /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
  failure.
  removing: _configtest.c _configtest.o
  checking for library 'vt.mpi' ...
  /opt/ibm/spectrum_mpi/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
  /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
  failure.
  removing: _configtest.c _configtest.o
  building 'vt-mpi' dylib library
  /opt/ibm/spectrum_mpi/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c src/lib-pmpi/vt-mpi.c -o build/temp.linux-ppc64le-3.8/src/lib-pmpi/vt-mpi.o
  /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
  warning: build_clib: command '/opt/ibm/spectrum_mpi/bin/mpicc' failed with exit status 255
  
  warning: build_clib: building optional library "vt-mpi" failed
  
  checking for library 'vt-hyb' ...
  /opt/ibm/spectrum_mpi/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
  /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
  failure.
  removing: _configtest.c _configtest.o
  checking for library 'vt.ompi' ...
  /opt/ibm/spectrum_mpi/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
  /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
  failure.
  removing: _configtest.c _configtest.o
  building 'vt-hyb' dylib library
  /opt/ibm/spectrum_mpi/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c src/lib-pmpi/vt-hyb.c -o build/temp.linux-ppc64le-3.8/src/lib-pmpi/vt-hyb.o
  /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
  warning: build_clib: command '/opt/ibm/spectrum_mpi/bin/mpicc' failed with exit status 255
  
  warning: build_clib: building optional library "vt-hyb" failed
  
  running build_ext
  MPI configuration: [mpi] from 'mpi.cfg'
  MPI C compiler:    /opt/ibm/spectrum_mpi/bin/mpicc
  MPI C++ compiler:  /opt/ibm/spectrum_mpi/bin/mpicxx
  MPI F compiler:    /opt/ibm/spectrum_mpi/bin/mpifort
  MPI F90 compiler:  /opt/ibm/spectrum_mpi/bin/mpif90
  MPI F77 compiler:  /opt/ibm/spectrum_mpi/bin/mpif77
  checking for dlopen() availability ...
  checking for header 'dlfcn.h' ...
  gcc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/scratch/03076/gzynda/conda_local/envs/py3/include/python3.8 -c _configtest.c -o _configtest.o
  success!
  removing: _configtest.c _configtest.o
  success!
  checking for library 'dl' ...
  gcc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/scratch/03076/gzynda/conda_local/envs/py3/include/python3.8 -c _configtest.c -o _configtest.o
  gcc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ _configtest.o -Lbuild/temp.linux-ppc64le-3.8 -ldl -o _configtest
  success!
  removing: _configtest.c _configtest.o _configtest
  checking for function 'dlopen' ...
  gcc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/scratch/03076/gzynda/conda_local/envs/py3/include/python3.8 -c _configtest.c -o _configtest.o
  gcc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ _configtest.o -Lbuild/temp.linux-ppc64le-3.8 -ldl -o _configtest
  success!
  removing: _configtest.c _configtest.o _configtest
  building 'mpi4py.dl' extension
  gcc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -DHAVE_DLFCN_H=1 -DHAVE_DLOPEN=1 -I/scratch/03076/gzynda/conda_local/envs/py3/include/python3.8 -c src/dynload.c -o build/temp.linux-ppc64le-3.8/src/dynload.o
  gcc -pthread -shared -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -L/scratch/03076/gzynda/conda_local/envs/py3/lib -Wl,-rpath=/scratch/03076/gzynda/conda_local/envs/py3/lib -Wl,--no-as-needed -Wl,--sysroot=/ build/temp.linux-ppc64le-3.8/src/dynload.o -Lbuild/temp.linux-ppc64le-3.8 -ldl -o build/lib.linux-ppc64le-3.8/mpi4py/dl.cpython-38-powerpc64le-linux-gnu.so
  checking for MPI compile and link ...
  /opt/ibm/spectrum_mpi/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/scratch/03076/gzynda/conda_local/envs/py3/include/python3.8 -c _configtest.c -o _configtest.o
  /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
  failure.
  removing: _configtest.c _configtest.o
  error: Cannot compile MPI programs. Check your configuration!!!
  ----------------------------------------
  ERROR: Failed building wheel for mpi4py
  Running setup.py clean for mpi4py
Failed to build mpi4py
Installing collected packages: mpi4py
    Running setup.py install for mpi4py ... error
    ERROR: Command errored out with exit status 1:
     command: /scratch/03076/gzynda/conda_local/envs/py3/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-v8o084bu/mpi4py/setup.py'"'"'; __file__='"'"'/tmp/pip-install-v8o084bu/mpi4py/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-p8_jcrcb/install-record.txt --single-version-externally-managed --compile --install-headers /scratch/03076/gzynda/conda_local/envs/py3/include/python3.8/mpi4py
         cwd: /tmp/pip-install-v8o084bu/mpi4py/
    Complete output (134 lines):
    running install
    running build
    running build_src
    running build_py
    creating build
    creating build/lib.linux-ppc64le-3.8
    creating build/lib.linux-ppc64le-3.8/mpi4py
    copying src/mpi4py/run.py -> build/lib.linux-ppc64le-3.8/mpi4py
    copying src/mpi4py/__main__.py -> build/lib.linux-ppc64le-3.8/mpi4py
    copying src/mpi4py/bench.py -> build/lib.linux-ppc64le-3.8/mpi4py
    copying src/mpi4py/__init__.py -> build/lib.linux-ppc64le-3.8/mpi4py
    creating build/lib.linux-ppc64le-3.8/mpi4py/futures
    copying src/mpi4py/futures/__main__.py -> build/lib.linux-ppc64le-3.8/mpi4py/futures
    copying src/mpi4py/futures/_base.py -> build/lib.linux-ppc64le-3.8/mpi4py/futures
    copying src/mpi4py/futures/server.py -> build/lib.linux-ppc64le-3.8/mpi4py/futures
    copying src/mpi4py/futures/pool.py -> build/lib.linux-ppc64le-3.8/mpi4py/futures
    copying src/mpi4py/futures/_lib.py -> build/lib.linux-ppc64le-3.8/mpi4py/futures
    copying src/mpi4py/futures/__init__.py -> build/lib.linux-ppc64le-3.8/mpi4py/futures
    copying src/mpi4py/futures/aplus.py -> build/lib.linux-ppc64le-3.8/mpi4py/futures
    copying src/mpi4py/MPI.pxd -> build/lib.linux-ppc64le-3.8/mpi4py
    copying src/mpi4py/__init__.pxd -> build/lib.linux-ppc64le-3.8/mpi4py
    copying src/mpi4py/libmpi.pxd -> build/lib.linux-ppc64le-3.8/mpi4py
    creating build/lib.linux-ppc64le-3.8/mpi4py/include
    creating build/lib.linux-ppc64le-3.8/mpi4py/include/mpi4py
    copying src/mpi4py/include/mpi4py/mpi4py.MPI_api.h -> build/lib.linux-ppc64le-3.8/mpi4py/include/mpi4py
    copying src/mpi4py/include/mpi4py/mpi4py.MPI.h -> build/lib.linux-ppc64le-3.8/mpi4py/include/mpi4py
    copying src/mpi4py/include/mpi4py/mpi4py.h -> build/lib.linux-ppc64le-3.8/mpi4py/include/mpi4py
    copying src/mpi4py/include/mpi4py/mpi4py.i -> build/lib.linux-ppc64le-3.8/mpi4py/include/mpi4py
    copying src/mpi4py/include/mpi4py/mpi.pxi -> build/lib.linux-ppc64le-3.8/mpi4py/include/mpi4py
    running build_clib
    MPI configuration: [mpi] from 'mpi.cfg'
    MPI C compiler:    /opt/ibm/spectrum_mpi/bin/mpicc
    MPI C++ compiler:  /opt/ibm/spectrum_mpi/bin/mpicxx
    MPI F compiler:    /opt/ibm/spectrum_mpi/bin/mpifort
    MPI F90 compiler:  /opt/ibm/spectrum_mpi/bin/mpif90
    MPI F77 compiler:  /opt/ibm/spectrum_mpi/bin/mpif77
    checking for library 'lmpe' ...
    /opt/ibm/spectrum_mpi/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
    /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
    failure.
    removing: _configtest.c _configtest.o
    building 'mpe' dylib library
    creating build/temp.linux-ppc64le-3.8
    creating build/temp.linux-ppc64le-3.8/src
    creating build/temp.linux-ppc64le-3.8/src/lib-pmpi
    /opt/ibm/spectrum_mpi/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c src/lib-pmpi/mpe.c -o build/temp.linux-ppc64le-3.8/src/lib-pmpi/mpe.o
    /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
    warning: build_clib: command '/opt/ibm/spectrum_mpi/bin/mpicc' failed with exit status 255
    
    warning: build_clib: building optional library "mpe" failed
    
    checking for library 'vt-mpi' ...
    /opt/ibm/spectrum_mpi/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
    /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
    failure.
    removing: _configtest.c _configtest.o
    checking for library 'vt.mpi' ...
    /opt/ibm/spectrum_mpi/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
    /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
    failure.
    removing: _configtest.c _configtest.o
    building 'vt' dylib library
    /opt/ibm/spectrum_mpi/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c src/lib-pmpi/vt.c -o build/temp.linux-ppc64le-3.8/src/lib-pmpi/vt.o
    /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
    warning: build_clib: command '/opt/ibm/spectrum_mpi/bin/mpicc' failed with exit status 255
    
    warning: build_clib: building optional library "vt" failed
    
    checking for library 'vt-mpi' ...
    /opt/ibm/spectrum_mpi/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
    /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
    failure.
    removing: _configtest.c _configtest.o
    checking for library 'vt.mpi' ...
    /opt/ibm/spectrum_mpi/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
    /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
    failure.
    removing: _configtest.c _configtest.o
    building 'vt-mpi' dylib library
    /opt/ibm/spectrum_mpi/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c src/lib-pmpi/vt-mpi.c -o build/temp.linux-ppc64le-3.8/src/lib-pmpi/vt-mpi.o
    /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
    warning: build_clib: command '/opt/ibm/spectrum_mpi/bin/mpicc' failed with exit status 255
    
    warning: build_clib: building optional library "vt-mpi" failed
    
    checking for library 'vt-hyb' ...
    /opt/ibm/spectrum_mpi/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
    /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
    failure.
    removing: _configtest.c _configtest.o
    checking for library 'vt.ompi' ...
    /opt/ibm/spectrum_mpi/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
    /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
    failure.
    removing: _configtest.c _configtest.o
    building 'vt-hyb' dylib library
    /opt/ibm/spectrum_mpi/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c src/lib-pmpi/vt-hyb.c -o build/temp.linux-ppc64le-3.8/src/lib-pmpi/vt-hyb.o
    /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
    warning: build_clib: command '/opt/ibm/spectrum_mpi/bin/mpicc' failed with exit status 255
    
    warning: build_clib: building optional library "vt-hyb" failed
    
    running build_ext
    MPI configuration: [mpi] from 'mpi.cfg'
    MPI C compiler:    /opt/ibm/spectrum_mpi/bin/mpicc
    MPI C++ compiler:  /opt/ibm/spectrum_mpi/bin/mpicxx
    MPI F compiler:    /opt/ibm/spectrum_mpi/bin/mpifort
    MPI F90 compiler:  /opt/ibm/spectrum_mpi/bin/mpif90
    MPI F77 compiler:  /opt/ibm/spectrum_mpi/bin/mpif77
    checking for dlopen() availability ...
    checking for header 'dlfcn.h' ...
    gcc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/scratch/03076/gzynda/conda_local/envs/py3/include/python3.8 -c _configtest.c -o _configtest.o
    success!
    removing: _configtest.c _configtest.o
    success!
    checking for library 'dl' ...
    gcc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/scratch/03076/gzynda/conda_local/envs/py3/include/python3.8 -c _configtest.c -o _configtest.o
    gcc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ _configtest.o -Lbuild/temp.linux-ppc64le-3.8 -ldl -o _configtest
    success!
    removing: _configtest.c _configtest.o _configtest
    checking for function 'dlopen' ...
    gcc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/scratch/03076/gzynda/conda_local/envs/py3/include/python3.8 -c _configtest.c -o _configtest.o
    gcc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ _configtest.o -Lbuild/temp.linux-ppc64le-3.8 -ldl -o _configtest
    success!
    removing: _configtest.c _configtest.o _configtest
    building 'mpi4py.dl' extension
    gcc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -DHAVE_DLFCN_H=1 -DHAVE_DLOPEN=1 -I/scratch/03076/gzynda/conda_local/envs/py3/include/python3.8 -c src/dynload.c -o build/temp.linux-ppc64le-3.8/src/dynload.o
    gcc -pthread -shared -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -L/scratch/03076/gzynda/conda_local/envs/py3/lib -Wl,-rpath=/scratch/03076/gzynda/conda_local/envs/py3/lib -Wl,--no-as-needed -Wl,--sysroot=/ build/temp.linux-ppc64le-3.8/src/dynload.o -Lbuild/temp.linux-ppc64le-3.8 -ldl -o build/lib.linux-ppc64le-3.8/mpi4py/dl.cpython-38-powerpc64le-linux-gnu.so
    checking for MPI compile and link ...
    /opt/ibm/spectrum_mpi/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/scratch/03076/gzynda/conda_local/envs/py3/include/python3.8 -c _configtest.c -o _configtest.o
    /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
    failure.
    removing: _configtest.c _configtest.o
    error: Cannot compile MPI programs. Check your configuration!!!
    ----------------------------------------
ERROR: Command errored out with exit status 1: /scratch/03076/gzynda/conda_local/envs/py3/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-v8o084bu/mpi4py/setup.py'"'"'; __file__='"'"'/tmp/pip-install-v8o084bu/mpi4py/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-p8_jcrcb/install-record.txt --single-version-externally-managed --compile --install-headers /scratch/03076/gzynda/conda_local/envs/py3/include/python3.8/mpi4py Check the logs for full command output.

[recipe request] AllenNLP

Name of package: AllenNLP
URL of package source code: https://github.com/allenai/allennlp
License of package: Apache-2
List of package dependencies:

torch>=0.4.1,<1.2

# Parameter parsing (but not on Windows).
jsonnet>=0.10.0 ; sys.platform != 'win32'

# Adds an @overrides decorator for better documentation and error checking when using subclasses.
overrides

# Used by some old code.  We moved away from it because it's too slow, but some old code still
# imports this.
nltk

# Mainly used for the faster tokenizer.
spacy>=2.1.0,<2.2

# Used by span prediction models.
numpy

# Used for reading configuration info out of numpy-style docstrings.
numpydoc>=0.8.0

# Used in coreference resolution evaluation metrics.
scipy
scikit-learn

# Write logs for training visualisation with the Tensorboard application
# Install the Tensorboard application separately (part of tensorflow) to view them.
tensorboardX>=1.2

# Accessing files from S3 directly.
boto3

# REST interface for models
flask>=1.0.2
flask-cors>=3.0.7
gevent>=1.3.6

# Used by semantic parsing code to strip diacritics from unicode strings.
unidecode

# Used by semantic parsing code to parse SQL
parsimonious>=0.8.0

# Used by semantic parsing code to format and postprocess SQL
sqlparse>=0.2.4

# For text normalization
ftfy
word2number>=1.1

# To use the BERT model
pytorch-pretrained-bert>=0.6.0
git+git://github.com/huggingface/pytorch-transformers.git@a7b4cfe9194bf93c7044a42c9f1281260ce6279e

# For caching processed data
jsonpickle

#### ESSENTIAL LIBRARIES USED IN SCRIPTS ####

# Plot graphs for learning rate finder
matplotlib>=2.2.3

# Used for downloading datasets over HTTP
requests>=2.18

# progress bars in data cleaning scripts
tqdm>=4.19

# In SQuAD eval script, we use this to see if we likely have some tokenization problem.
editdistance

# For pretrained model weights
h5py

# For timezone utilities
pytz>=2017.3

# Reads Universal Dependencies files.
conllu==1.3.1

Short description of package and use case(s):
An open-source NLP research library, built on PyTorch

Folks who would also like to see this package in the supplementary channel, please thumbs-up so the developers can know which requests to prioritize.

torchmeta support for powerai ppc64le

Hi,

I wanted to use torchmeta in a ppc64le architecture. I was having some issues. The first few I addressed when installing powerai 1.7.0 thanks to the suggestions in this issues #268.

But now when I tried to install it I had an error with h5py:

(my_new_env) [miranda9@hal-login ~]$ pip install torchmeta==1.3.1
Collecting torchmeta==1.3.1
  Using cached torchmeta-1.3.1-py3-none-any.whl (144 kB)
Requirement already satisfied: requests in ./.conda/envs/my_new_env/lib/python3.7/site-packages (from torchmeta==1.3.1) (2.22.0)
Requirement already satisfied: torchvision<0.6.0,>=0.4.0 in ./.conda/envs/my_new_env/lib/python3.7/site-packages (from torchmeta==1.3.1) (0.4.2)
Requirement already satisfied: torch<1.5.0,>=1.3.0 in ./.conda/envs/my_new_env/lib/python3.7/site-packages (from torchmeta==1.3.1) (1.3.1)
Processing ./.cache/pip/wheels/87/f5/ad/9f04a48453875e8054c19f9fe3f50cbbe0c09b956835555019/Pillow-6.2.2-cp37-cp37m-linux_ppc64le.whl
Requirement already satisfied: numpy>=1.14.0 in ./.conda/envs/my_new_env/lib/python3.7/site-packages (from torchmeta==1.3.1) (1.17.4)
Requirement already satisfied: tqdm>=4.0.0 in ./.conda/envs/my_new_env/lib/python3.7/site-packages (from torchmeta==1.3.1) (4.36.1)
Collecting h5py~=2.9.0
  Using cached h5py-2.9.0.tar.gz (287 kB)
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in ./.conda/envs/my_new_env/lib/python3.7/site-packages (from requests->torchmeta==1.3.1) (3.0.4)
Requirement already satisfied: certifi>=2017.4.17 in ./.conda/envs/my_new_env/lib/python3.7/site-packages (from requests->torchmeta==1.3.1) (2020.6.20)
Requirement already satisfied: urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 in ./.conda/envs/my_new_env/lib/python3.7/site-packages (from requests->torchmeta==1.3.1) (1.25.10)
Requirement already satisfied: idna<2.9,>=2.5 in ./.conda/envs/my_new_env/lib/python3.7/site-packages (from requests->torchmeta==1.3.1) (2.8)
Requirement already satisfied: six in ./.conda/envs/my_new_env/lib/python3.7/site-packages (from torchvision<0.6.0,>=0.4.0->torchmeta==1.3.1) (1.13.0)
Building wheels for collected packages: h5py
  Building wheel for h5py (setup.py) ... error
  ERROR: Command errored out with exit status 1:
   command: /home/miranda9/.conda/envs/my_new_env/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-bpmeop26/h5py/setup.py'"'"'; __file__='"'"'/tmp/pip-install-bpmeop26/h5py/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-ccg1oj0n
       cwd: /tmp/pip-install-bpmeop26/h5py/
  Complete output (1321 lines):
  running bdist_wheel
  running build
  running build_py
  creating build
  creating build/lib.linux-ppc64le-3.7
  creating build/lib.linux-ppc64le-3.7/h5py
  copying h5py/__init__.py -> build/lib.linux-ppc64le-3.7/h5py
  copying h5py/h5py_warnings.py -> build/lib.linux-ppc64le-3.7/h5py
  copying h5py/highlevel.py -> build/lib.linux-ppc64le-3.7/h5py
  copying h5py/ipy_completer.py -> build/lib.linux-ppc64le-3.7/h5py
  copying h5py/version.py -> build/lib.linux-ppc64le-3.7/h5py
  creating build/lib.linux-ppc64le-3.7/h5py/_hl
  copying h5py/_hl/__init__.py -> build/lib.linux-ppc64le-3.7/h5py/_hl
  copying h5py/_hl/attrs.py -> build/lib.linux-ppc64le-3.7/h5py/_hl
  copying h5py/_hl/base.py -> build/lib.linux-ppc64le-3.7/h5py/_hl
  copying h5py/_hl/compat.py -> build/lib.linux-ppc64le-3.7/h5py/_hl
  copying h5py/_hl/dataset.py -> build/lib.linux-ppc64le-3.7/h5py/_hl
  copying h5py/_hl/datatype.py -> build/lib.linux-ppc64le-3.7/h5py/_hl
  copying h5py/_hl/dims.py -> build/lib.linux-ppc64le-3.7/h5py/_hl
  copying h5py/_hl/files.py -> build/lib.linux-ppc64le-3.7/h5py/_hl
  copying h5py/_hl/filters.py -> build/lib.linux-ppc64le-3.7/h5py/_hl
  copying h5py/_hl/group.py -> build/lib.linux-ppc64le-3.7/h5py/_hl
  copying h5py/_hl/selections.py -> build/lib.linux-ppc64le-3.7/h5py/_hl
  copying h5py/_hl/selections2.py -> build/lib.linux-ppc64le-3.7/h5py/_hl
  copying h5py/_hl/vds.py -> build/lib.linux-ppc64le-3.7/h5py/_hl
  creating build/lib.linux-ppc64le-3.7/h5py/tests
  copying h5py/tests/__init__.py -> build/lib.linux-ppc64le-3.7/h5py/tests
  copying h5py/tests/common.py -> build/lib.linux-ppc64le-3.7/h5py/tests
  creating build/lib.linux-ppc64le-3.7/h5py/tests/old
  copying h5py/tests/old/__init__.py -> build/lib.linux-ppc64le-3.7/h5py/tests/old
  copying h5py/tests/old/test_attrs.py -> build/lib.linux-ppc64le-3.7/h5py/tests/old
  copying h5py/tests/old/test_attrs_data.py -> build/lib.linux-ppc64le-3.7/h5py/tests/old
  copying h5py/tests/old/test_base.py -> build/lib.linux-ppc64le-3.7/h5py/tests/old
  copying h5py/tests/old/test_dataset.py -> build/lib.linux-ppc64le-3.7/h5py/tests/old
  copying h5py/tests/old/test_datatype.py -> build/lib.linux-ppc64le-3.7/h5py/tests/old
  copying h5py/tests/old/test_dimension_scales.py -> build/lib.linux-ppc64le-3.7/h5py/tests/old
  copying h5py/tests/old/test_file.py -> build/lib.linux-ppc64le-3.7/h5py/tests/old
  copying h5py/tests/old/test_file_image.py -> build/lib.linux-ppc64le-3.7/h5py/tests/old
  copying h5py/tests/old/test_group.py -> build/lib.linux-ppc64le-3.7/h5py/tests/old
  copying h5py/tests/old/test_h5.py -> build/lib.linux-ppc64le-3.7/h5py/tests/old
  copying h5py/tests/old/test_h5d_direct_chunk_write.py -> build/lib.linux-ppc64le-3.7/h5py/tests/old
  copying h5py/tests/old/test_h5f.py -> build/lib.linux-ppc64le-3.7/h5py/tests/old
  copying h5py/tests/old/test_h5p.py -> build/lib.linux-ppc64le-3.7/h5py/tests/old
  copying h5py/tests/old/test_h5t.py -> build/lib.linux-ppc64le-3.7/h5py/tests/old
  copying h5py/tests/old/test_objects.py -> build/lib.linux-ppc64le-3.7/h5py/tests/old
  copying h5py/tests/old/test_selections.py -> build/lib.linux-ppc64le-3.7/h5py/tests/old
  copying h5py/tests/old/test_slicing.py -> build/lib.linux-ppc64le-3.7/h5py/tests/old
  creating build/lib.linux-ppc64le-3.7/h5py/tests/hl
  copying h5py/tests/hl/__init__.py -> build/lib.linux-ppc64le-3.7/h5py/tests/hl
  copying h5py/tests/hl/test_attribute_create.py -> build/lib.linux-ppc64le-3.7/h5py/tests/hl
  copying h5py/tests/hl/test_dataset_getitem.py -> build/lib.linux-ppc64le-3.7/h5py/tests/hl
  copying h5py/tests/hl/test_dataset_swmr.py -> build/lib.linux-ppc64le-3.7/h5py/tests/hl
  copying h5py/tests/hl/test_datatype.py -> build/lib.linux-ppc64le-3.7/h5py/tests/hl
  copying h5py/tests/hl/test_deprecation.py -> build/lib.linux-ppc64le-3.7/h5py/tests/hl
  copying h5py/tests/hl/test_dims_dimensionproxy.py -> build/lib.linux-ppc64le-3.7/h5py/tests/hl
  copying h5py/tests/hl/test_file.py -> build/lib.linux-ppc64le-3.7/h5py/tests/hl
  copying h5py/tests/hl/test_filters.py -> build/lib.linux-ppc64le-3.7/h5py/tests/hl
  copying h5py/tests/hl/test_threads.py -> build/lib.linux-ppc64le-3.7/h5py/tests/hl
  creating build/lib.linux-ppc64le-3.7/h5py/tests/hl/test_vds
  copying h5py/tests/hl/test_vds/__init__.py -> build/lib.linux-ppc64le-3.7/h5py/tests/hl/test_vds
  copying h5py/tests/hl/test_vds/test_highlevel_vds.py -> build/lib.linux-ppc64le-3.7/h5py/tests/hl/test_vds
  copying h5py/tests/hl/test_vds/test_lowlevel_vds.py -> build/lib.linux-ppc64le-3.7/h5py/tests/hl/test_vds
  copying h5py/tests/hl/test_vds/test_virtual_source.py -> build/lib.linux-ppc64le-3.7/h5py/tests/hl/test_vds
  running build_ext
  Autodetected HDF5 1.10.2
  ********************************************************************************
                         Summary of the h5py configuration
  
      Path to HDF5: None
      HDF5 Version: '1.10.2'
       MPI Enabled: False
  Rebuild Required: True
  
  ********************************************************************************
  Executing api_gen rebuild of defs
  Executing cythonize()
  [ 1/22] Cythonizing /tmp/pip-install-bpmeop26/h5py/h5py/_conv.pyx
  /tmp/pip-install-bpmeop26/h5py/.eggs/Cython-0.29.21-py3.7.egg/Cython/Compiler/Main.py:369: FutureWarning: Cython directive 'language_level' not set, using 2 for now (Py2). This will change in a later release! File: /tmp/pip-install-bpmeop26/h5py/h5py/_conv.pxd
    tree = Parsing.p_module(s, pxd, full_module_name)

...

  /home/miranda9/.conda/envs/my_new_env/lib/python3.7/site-packages/numpy/core/include/numpy/npy_1_7_deprecated_api.h:17:2: warning: #warning "Using deprecated NumPy API, disable it with " "#define NPY_NO_DEPRECATED_API NPY_1_7_API_VERSION" [-Wcpp]
   #warning "Using deprecated NumPy API, disable it with " \
    ^
  In file included from /tmp/pip-install-bpmeop26/h5py/h5py/defs.c:654:0:
  /tmp/pip-install-bpmeop26/h5py/h5py/api_compat.h:27:18: fatal error: hdf5.h: No such file or directory
   #include "hdf5.h"
                    ^
  compilation terminated.
  error: command 'gcc' failed with exit status 1
  ----------------------------------------
  ERROR: Failed building wheel for h5py
  Running setup.py clean for h5py
Failed to build h5py
DEPRECATION: Could not build wheels for h5py which do not use PEP 517. pip will fall back to legacy 'setup.py install' for these. pip 21.0 will remove support for this functionality. A possible replacement is to fix the wheel build issue reported above. You can find discussion regarding this at https://github.com/pypa/pip/issues/8368.
Installing collected packages: Pillow, h5py, torchmeta
  Attempting uninstall: Pillow
    Found existing installation: Pillow 7.1.2
    Uninstalling Pillow-7.1.2:
      Successfully uninstalled Pillow-7.1.2
  Attempting uninstall: h5py
    Found existing installation: h5py 2.8.0
    Uninstalling h5py-2.8.0:
      Successfully uninstalled h5py-2.8.0
    Running setup.py install for h5py ... error
    ERROR: Command errored out with exit status 1:
     command: /home/miranda9/.conda/envs/my_new_env/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-bpmeop26/h5py/setup.py'"'"'; __file__='"'"'/tmp/pip-install-bpmeop26/h5py/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-hlwpfooj/install-record.txt --single-version-externally-managed --compile --install-headers /home/miranda9/.conda/envs/my_new_env/include/python3.7m/h5py


... 

    copying h5py/tests/hl/test_vds/test_lowlevel_vds.py -> build/lib.linux-ppc64le-3.7/h5py/tests/hl/test_vds
    copying h5py/tests/hl/test_vds/test_virtual_source.py -> build/lib.linux-ppc64le-3.7/h5py/tests/hl/test_vds
    running build_ext
    Autodetected HDF5 1.10.2
    ********************************************************************************
                           Summary of the h5py configuration
    
        Path to HDF5: None
        HDF5 Version: '1.10.2'
         MPI Enabled: False
    Rebuild Required: True
    
    ********************************************************************************
    Executing cythonize()
    [ 1/22] Cythonizing /tmp/pip-install-bpmeop26/h5py/h5py/_conv.pyx
    /tmp/pip-install-bpmeop26/h5py/.eggs/Cython-0.29.21-py3.7.egg/Cython/Compiler/Main.py:369: FutureWarning: Cython directive 'language_level' not set, using 2 for now (Py2). This will change in a later release! File: /tmp/pip-install-bpmeop26/h5py/h5py/_conv.pxd


...

    warning: h5py/api_types_hdf5.pxd:730:6: 'H5Z_ERROR_EDC' redeclared
    warning: h5py/api_types_hdf5.pxd:731:6: 'H5Z_DISABLE_EDC' redeclared
    warning: h5py/api_types_hdf5.pxd:732:6: 'H5Z_ENABLE_EDC' redeclared
    warning: h5py/api_types_hdf5.pxd:733:6: 'H5Z_NO_EDC' redeclared
    building 'h5py.defs' extension
    creating build/temp.linux-ppc64le-3.7
    creating build/temp.linux-ppc64le-3.7/tmp
    creating build/temp.linux-ppc64le-3.7/tmp/pip-install-bpmeop26
    creating build/temp.linux-ppc64le-3.7/tmp/pip-install-bpmeop26/h5py
    creating build/temp.linux-ppc64le-3.7/tmp/pip-install-bpmeop26/h5py/h5py
    gcc -pthread -B /home/miranda9/.conda/envs/my_new_env/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -DH5_USE_16_API -I./h5py -I/tmp/pip-install-bpmeop26/h5py/lzf -I/opt/local/include -I/usr/local/include -I/home/miranda9/.conda/envs/my_new_env/lib/python3.7/site-packages/numpy/core/include -I/home/miranda9/.conda/envs/my_new_env/include/python3.7m -c /tmp/pip-install-bpmeop26/h5py/h5py/defs.c -o build/temp.linux-ppc64le-3.7/tmp/pip-install-bpmeop26/h5py/h5py/defs.o
    In file included from /home/miranda9/.conda/envs/my_new_env/lib/python3.7/site-packages/numpy/core/include/numpy/ndarraytypes.h:1830:0,
                     from /home/miranda9/.conda/envs/my_new_env/lib/python3.7/site-packages/numpy/core/include/numpy/ndarrayobject.h:12,
                     from /home/miranda9/.conda/envs/my_new_env/lib/python3.7/site-packages/numpy/core/include/numpy/arrayobject.h:4,
                     from /tmp/pip-install-bpmeop26/h5py/h5py/api_compat.h:26,
                     from /tmp/pip-install-bpmeop26/h5py/h5py/defs.c:654:
    /home/miranda9/.conda/envs/my_new_env/lib/python3.7/site-packages/numpy/core/include/numpy/npy_1_7_deprecated_api.h:17:2: warning: #warning "Using deprecated NumPy API, disable it with " "#define NPY_NO_DEPRECATED_API NPY_1_7_API_VERSION" [-Wcpp]
     #warning "Using deprecated NumPy API, disable it with " \
      ^
    In file included from /tmp/pip-install-bpmeop26/h5py/h5py/defs.c:654:0:
    /tmp/pip-install-bpmeop26/h5py/h5py/api_compat.h:27:18: fatal error: hdf5.h: No such file or directory
     #include "hdf5.h"
                      ^
    compilation terminated.
    error: command 'gcc' failed with exit status 1
    ----------------------------------------
  Rolling back uninstall of h5py
  Moving to /home/miranda9/.conda/envs/my_new_env/lib/python3.7/site-packages/h5py
   from /home/miranda9/.conda/envs/my_new_env/lib/python3.7/site-packages/~5py
  Moving to /home/miranda9/.conda/envs/my_new_env/lib/python3.7/site-packages/h5py-2.8.0-py3.7.egg-info
   from /home/miranda9/.conda/envs/my_new_env/lib/python3.7/site-packages/~5py-2.8.0-py3.7.egg-info
ERROR: Command errored out with exit status 1: /home/miranda9/.conda/envs/my_new_env/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-bpmeop26/h5py/setup.py'"'"'; __file__='"'"'/tmp/pip-install-bpmeop26/h5py/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-hlwpfooj/install-record.txt --single-version-externally-managed --compile --install-headers /home/miranda9/.conda/envs/my_new_env/include/python3.7m/h5py Check the logs for full command output.

unfortunately I wasn't able to install that dependency and I am unsure what I should do. Any help?

FastAI cannot be installed due to unspupported spaCy dependency

pip install fastai was failing to build the spaCy dependency due to issues with blis

I was able to build/install fastai from source after pruning the spaCy dependencies, but this component is essential to NLP and text analytics workflows. It appears that the root issue lies in the compilation of blis

spaCy Project - GitHub
Bliss Project - GitHub

Error snippet below and full trace attached
fastai_install_error.txt

Collecting spacy>=2.0.18 (from fastai)
  Using cached https://files.pythonhosted.org/packages/56/30/977e6dec3a42f3dc035631f0db5fe69a573f29fdbc7977226eab18f2f5f6/spacy-2.1.4.tar.gz
  Installing build dependencies ... error

...

  Collecting blis<0.3.0,>=0.2.1 (from thinc==7.0.0.dev6)
    Using cached https://files.pythonhosted.org/packages/59/9e/84a83616cbe5daa94909da38b780e93bf566dc2113c3dc35d7b4cad52f63/blis-0.2.4.tar.gz
  Collecting six<2.0.0,>=1.10.0 (from thinc==7.0.0.dev6)
    Using cached https://files.pythonhosted.org/packages/73/fb/00a976f728d0d1fecfe898238ce23f502a721c0ac0ecfedb80e0d88c64e9/six-1.12.0-py2.py3-none-any.whl
  Building wheels for collected packages: blis
    Building wheel for blis (setup.py): started
    Building wheel for blis (setup.py): finished with status 'error'
    ERROR: Complete output from command /home/mfedell/.conda/envs/test/bin/python -u -c 'import setuptools, tokenize;__file__='"'"'/tmp/pip-install-qi70ze25/blis/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-_kmdrq5z --python-tag cp36:
    ERROR: BLIS_COMPILER? None
    running bdist_wheel
    running build
    running build_py
    creating build
    creating build/lib.linux-ppc64le-3.6
    creating build/lib.linux-ppc64le-3.6/blis
    copying blis/__init__.py -> build/lib.linux-ppc64le-3.6/blis
    copying blis/about.py -> build/lib.linux-ppc64le-3.6/blis
    copying blis/benchmark.py -> build/lib.linux-ppc64le-3.6/blis
    creating build/lib.linux-ppc64le-3.6/blis/tests
    copying blis/tests/__init__.py -> build/lib.linux-ppc64le-3.6/blis/tests
    copying blis/tests/test_dotv.py -> build/lib.linux-ppc64le-3.6/blis/tests
    copying blis/tests/test_gemm.py -> build/lib.linux-ppc64le-3.6/blis/tests
    copying blis/tests/common.py -> build/lib.linux-ppc64le-3.6/blis/tests
    copying blis/cy.pyx -> build/lib.linux-ppc64le-3.6/blis
    copying blis/py.pyx -> build/lib.linux-ppc64le-3.6/blis
    copying blis/__init__.pxd -> build/lib.linux-ppc64le-3.6/blis
    copying blis/cy.pxd -> build/lib.linux-ppc64le-3.6/blis
    running build_ext
    unix
    py_compiler gcc

...

    gcc -c /tmp/pip-install-qi70ze25/blis/blis/_src/config/generic/bli_cntx_init_generic.c -o /tmp/tmpink3oskt/bli_cntx_init_generic.o -O3 -fPIC -std=c99 -D_POSIX_C_SOURCE=200112L -DBLIS_VERSION_STRING="0.5.0-6" -DBLIS_IS_BUILDING_LIBRARY -Iinclude/linux-x86_64 -I./frame/3/ -I./frame/ind/ukernels/ -I./frame/1m/ -I./frame/1f/ -I./frame/1/ -I./frame/include -I/tmp/pip-install-qi70ze25/blis/blis/_src/include/linux-x86_64
    gcc -c /tmp/pip-install-qi70ze25/blis/blis/_src/config/haswell/bli_cntx_init_haswell.c -o /tmp/tmpink3oskt/bli_cntx_init_haswell.o -O3 -fPIC -std=c99 -D_POSIX_C_SOURCE=200112L -DBLIS_VERSION_STRING="0.5.0-6" -DBLIS_IS_BUILDING_LIBRARY -Iinclude/linux-x86_64 -I./frame/3/ -I./frame/ind/ukernels/ -I./frame/1m/ -I./frame/1f/ -I./frame/1/ -I./frame/include -I/tmp/pip-install-qi70ze25/blis/blis/_src/include/linux-x86_64
    gcc -c /tmp/pip-install-qi70ze25/blis/blis/_src/config/penryn/bli_cntx_init_penryn.c -o /tmp/tmpink3oskt/bli_cntx_init_penryn.o -O2 -fomit-frame-pointer -fPIC -std=c99 -D_POSIX_C_SOURCE=200112L -DBLIS_VERSION_STRING="0.5.0-6" -DBLIS_IS_BUILDING_LIBRARY -Iinclude/linux-x86_64 -I./frame/3/ -I./frame/ind/ukernels/ -I./frame/1m/ -I./frame/1f/ -I./frame/1/ -I./frame/include -I/tmp/pip-install-qi70ze25/blis/blis/_src/include/linux-x86_64
    gcc -c /tmp/pip-install-qi70ze25/blis/blis/_src/config/piledriver/bli_cntx_init_piledriver.c -o /tmp/tmpink3oskt/bli_cntx_init_piledriver.o -O2 -fomit-frame-pointer -fPIC -std=c99 -D_POSIX_C_SOURCE=200112L -DBLIS_VERSION_STRING="0.5.0-6" -DBLIS_IS_BUILDING_LIBRARY -Iinclude/linux-x86_64 -I./frame/3/ -I./frame/ind/ukernels/ -I./frame/1m/ -I./frame/1f/ -I./frame/1/ -I./frame/include -I/tmp/pip-install-qi70ze25/blis/blis/_src/include/linux-x86_64
    gcc -c /tmp/pip-install-qi70ze25/blis/blis/_src/config/sandybridge/bli_cntx_init_sandybridge.c -o /tmp/tmpink3oskt/bli_cntx_init_sandybridge.o -O3 -fPIC -std=c99 -D_POSIX_C_SOURCE=200112L -DBLIS_VERSION_STRING="0.5.0-6" -DBLIS_IS_BUILDING_LIBRARY -Iinclude/linux-x86_64 -I./frame/3/ -I./frame/ind/ukernels/ -I./frame/1m/ -I./frame/1f/ -I./frame/1/ -I./frame/include -I/tmp/pip-install-qi70ze25/blis/blis/_src/include/linux-x86_64
    gcc -c /tmp/pip-install-qi70ze25/blis/blis/_src/config/steamroller/bli_cntx_init_steamroller.c -o /tmp/tmpink3oskt/bli_cntx_init_steamroller.o -O2 -fomit-frame-pointer -fPIC -std=c99 -D_POSIX_C_SOURCE=200112L -DBLIS_VERSION_STRING="0.5.0-6" -DBLIS_IS_BUILDING_LIBRARY -Iinclude/linux-x86_64 -I./frame/3/ -I./frame/ind/ukernels/ -I./frame/1m/ -I./frame/1f/ -I./frame/1/ -I./frame/include -I/tmp/pip-install-qi70ze25/blis/blis/_src/include/linux-x86_64
    gcc -c /tmp/pip-install-qi70ze25/blis/blis/_src/kernels/zen/1/bli_amaxv_zen_int.c -o /tmp/tmpink3oskt/bli_amaxv_zen_int.o -O3 -mavx2 -mfma -mfpmath=sse -march=core-avx2 -fPIC -std=c99 -D_POSIX_C_SOURCE=200112L -DBLIS_VERSION_STRING="0.5.0-6" -DBLIS_IS_BUILDING_LIBRARY -Iinclude/linux-x86_64 -I./frame/3/ -I./frame/ind/ukernels/ -I./frame/1m/ -I./frame/1f/ -I./frame/1/ -I./frame/include -I/tmp/pip-install-qi70ze25/blis/blis/_src/include/linux-x86_64
    gcc: error: unrecognized command line option ‘-mavx2’
    gcc: error: unrecognized command line option ‘-mfma’; did you mean ‘-memb’?
    gcc: error: unrecognized command line option ‘-mfpmath=sse’
    gcc: error: unrecognized command line option ‘-march=core-avx2’
    Traceback (most recent call last):

...

/_src/kernels/zen/1/bli_amaxv_zen_int.c', '-o', '/tmp/tmpink3oskt/bli_amaxv_zen_int.o', '-O3', '-mavx2', '-mfma', '-mfpmath=sse', '-march=core-avx2', '-fPIC', '-std=c99', '-D_POSIX_C_SOURCE=200112L', '-DBLIS_VERSION_STRING="0.5.0-6"', '-DBLIS_IS_BUILDING_LIBRARY', '-Iinclude/linux-x86_64', '-I./frame/3/', '-I./frame/ind/ukernels/', '-I./frame/1m/', '-I./frame/1f/', '-I./frame/1/', '-I./frame/include', '-I/tmp/pip-install-qi70ze25/blis/blis/_src/include/linux-x86_64']' returned non-zero exit status 1.
    ----------------------------------------
    ERROR: Failed building wheel for blis
    Running setup.py clean for blis
  Failed to build blis

support of pytorch 1.6.0 and torchvision 0.7.0

Can we have the latest pytorch versions please?

Pytorch 1.4+ build with CUDA 10.1 on power8/p100 cluster - crashes the node

I'm trying to build pytorch from source in PowerAI 1.6.2 WML environment with custom MPI/NCCL options.

When I switched from CUDA/10.1 module (distro package) to cudatoolkit-dev package from powerai conda, this killed the development node with 4 GPUs 😮 See the attached traceback:

node.killed.pytorch.compile.source.txt

cc @bethune-bryant @smatzek @nvcastet @wdirons @hartb

More details in this issue:

pytorch/pytorch#31438

[recipe request] gpytorch

Name of package: GpyTorch
URL of package source code: https://github.com/cornellius-gp/gpytorch
License of package: Apache-2
List of package dependencies:

torch>=1.1
extras_require={
        "dev": [
            "black",
            "twine",
        ],
        "docs": [
            "ipython",
            "ipykernel",
            "sphinx",
            "sphinx_rtd_theme",
            "nbsphinx",
            "m2r",
        ],
        "examples": [
            "ipython",
            "jupyter",
            "matplotlib",
            "scipy",
            "torchvision",
        ],
        "pyro": [
            "pyro-ppl>=0.3.0",
        ],
        "keops": [
            "pykeops>=1.1.1",
        ],
        "test": [
            "flake8",
            "flake8-print",
        ]

Short description of package and use case(s):
A highly efficient and modular implementation of Gaussian Processes in PyTorch

Folks who would also like to see this package in the supplementary channel, please thumbs-up so the developers can know which requests to prioritize.

[recipe request] OpenAI Gym for Reinforcement Learning

Please add OpenAI Gym: https://gym.openai.com/

Name of package: OpenAI Gym
URL of package source code: https://github.com/openai/gym
License of package: The MIT License
List of package dependencies: Not known
Short description of package and use case(s): Needed to develop reinforcement learning models on IBM Power Hardware (AC922)

Stable Baselines won't run in conda environment

I am trying to use the conda environments with powerai packages and am trying to install stable-baslines (https://github.com/hill-a/stable-baselines). I have run into issues that I think are relating to mpi4py?

Because it seems like there isn't a distribution for mpi4py on a conda channel, we installed it on our power machine. I then added the appropriate .pth file so that the location it is installed is sourced properly. This allows me to do the example import such as: from mpi4py import MPI. However, when doing so, we recognize the following warnings:

>>> from mpi4py import MPI
libibverbs: Warning: couldn't load driver 'hns': libhns-rdmav2.so: cannot open shared object file: No such file or directory
libibverbs: Warning: couldn't load driver 'i40iw': libi40iw-rdmav2.so: cannot open shared object file: No such file or directory
libibverbs: Warning: couldn't load driver 'bnxt_re': libbnxt_re-rdmav2.so: cannot open shared object file: No such file or directory
libibverbs: Warning: couldn't load driver 'vmw_pvrdma': libvmw_pvrdma-rdmav2.so: cannot open shared object file: No such file or directory
libibverbs: Warning: couldn't load driver 'cxgb3': libcxgb3-rdmav2.so: cannot open shared object file: No such file or directory
libibverbs: Warning: couldn't load driver 'cxgb4': libcxgb4-rdmav2.so: cannot open shared object file: No such file or directory
libibverbs: Warning: couldn't load driver 'hfi1verbs': libhfi1verbs-rdmav2.so: cannot open shared object file: No such file or directory
libibverbs: Warning: couldn't load driver 'nes': libnes-rdmav2.so: cannot open shared object file: No such file or directory
libibverbs: Warning: couldn't load driver 'qedr': libqedr-rdmav2.so: cannot open shared object file: No such file or directory
libibverbs: Warning: couldn't load driver 'ocrdma': libocrdma-rdmav2.so: cannot open shared object file: No such file or directory
libibverbs: Warning: couldn't load driver 'mthca': libmthca-rdmav2.so: cannot open shared object file: No such file or directory
libibverbs: Warning: couldn't load driver 'ipathverbs': libipathverbs-rdmav2.so: cannot open shared object file: No such file or directory
libibverbs: Warning: couldn't load driver 'hns': libhns-rdmav2.so: cannot open shared object file: No such file or directory
libibverbs: Warning: couldn't load driver 'i40iw': libi40iw-rdmav2.so: cannot open shared object file: No such file or directory
libibverbs: Warning: couldn't load driver 'bnxt_re': libbnxt_re-rdmav2.so: cannot open shared object file: No such file or directory
libibverbs: Warning: couldn't load driver 'vmw_pvrdma': libvmw_pvrdma-rdmav2.so: cannot open shared object file: No such file or directory
libibverbs: Warning: couldn't load driver 'cxgb3': libcxgb3-rdmav2.so: cannot open shared object file: No such file or directory
libibverbs: Warning: couldn't load driver 'cxgb4': libcxgb4-rdmav2.so: cannot open shared object file: No such file or directory
libibverbs: Warning: couldn't load driver 'hfi1verbs': libhfi1verbs-rdmav2.so: cannot open shared object file: No such file or directory
libibverbs: Warning: couldn't load driver 'nes': libnes-rdmav2.so: cannot open shared object file: No such file or directory
libibverbs: Warning: couldn't load driver 'qedr': libqedr-rdmav2.so: cannot open shared object file: No such file or directory
libibverbs: Warning: couldn't load driver 'ocrdma': libocrdma-rdmav2.so: cannot open shared object file: No such file or directory
libibverbs: Warning: couldn't load driver 'mthca': libmthca-rdmav2.so: cannot open shared object file: No such file or directory
libibverbs: Warning: couldn't load driver 'ipathverbs': libipathverbs-rdmav2.so: cannot open shared object file: No such file or directory
>>>

Going ahead, I was going to see if stable-baslines would still work. There isn't a conda channel for the package so I was going to try to install from source. I cloned the repo and had to comment out opencv-python in the setup.py file because in order to get opencv installed properly I had to do: conda install -c conda-forge opencv. I then install via pip install -e ..

Now if I try to either import stable_baselines or the same command from before: from mpi4py import MPI, instead of just getting the warning messages from above, we end up with the following errors:

In [3]: import stable_baselines                                                                                                                                                                                                
--------------------------------------------------------------------------
It looks like opal_init failed for some reason; your parallel process is
likely to abort.  There are many reasons that a parallel process can
fail during opal_init; some of which are due to configuration or
environment problems.  This failure appears to be an internal failure;
here's some additional information (which may only be relevant to an
Open MPI developer):

  opal_shmem_base_select failed
  --> Returned value -1 instead of OPAL_SUCCESS
--------------------------------------------------------------------------
--------------------------------------------------------------------------
It looks like orte_init failed for some reason; your parallel process is
likely to abort.  There are many reasons that a parallel process can
fail during orte_init; some of which are due to configuration or
environment problems.  This failure appears to be an internal failure;
here's some additional information (which may only be relevant to an
Open MPI developer):

  opal_init failed
  --> Returned value Error (-1) instead of ORTE_SUCCESS
--------------------------------------------------------------------------
--------------------------------------------------------------------------
It looks like MPI_INIT failed for some reason; your parallel process is
likely to abort.  There are many reasons that a parallel process can
fail during MPI_INIT; some of which are due to configuration or environment
problems.  This failure appears to be an internal failure; here's some
additional information (which may only be relevant to an Open MPI
developer):

  ompi_mpi_init: ompi_rte_init failed
  --> Returned "Error" (-1) instead of "Success" (0)
--------------------------------------------------------------------------
*** An error occurred in MPI_Init_thread
*** on a NULL communicator
*** MPI_ERRORS_ARE_FATAL (processes in this communicator will now abort,
***    and potentially your MPI job)
[SNA-MINSKY-N05:95209] Local abort before MPI_INIT completed completed successfully, but am not able to aggregate error messages, and not able to guarantee that all other processes were killed!

Do you guys have any insight as to what could be going on with powerpc and mpi4py?

invalid conversion from ‘int’ to ‘nvinfer1::IBuilderConfig*’ [-fpermissive] samplesCommon::enableDLA(builder, gArgs.useDLACore);

Hi,

When I try execute the code, I am getting this error.

sampleSSDIBM.cpp:331:45: error: invalid conversion from ‘int’ to ‘nvinfer1::IBuilderConfig*’ [-fpermissive]
samplesCommon::enableDLA(builder, gArgs.useDLACore);

What is th epossible solution to this??
when I comment out, I am not gettging any errors. But the model does not detect anything. it is showing FAILED at the end.

Can someone give some solution to this error.

Thank you

[recipe request] mimkl

Name of package: mimkl
URL of package source code: https://github.com/IBM/mimkl
License of package: MIT
List of package dependencies:

C++14 capable C++ compiler
cmake (>3.0.2)
numpy
scipy

Short description of package and use case(s):
A C++ library for Matrix-Induced Multiple Kernel Learning (MIMKL) with python bindings.

Folks who would also like to see this package in the supplementary channel, please thumbs-up so the developers can know which requests to prioritize.

how to install ray from powerai conda channels? GLIBCXX_3.4.21 not found

I noticed that this Ray package was released in conda powerai channel:
https://anaconda.org/powerai/ray

What are the installation steps for this package?
Does it require base powerai 1.6.2 or powerai 1.7.0 or early release?

When I tried to install the following runtime error appears:

conda activate ray
(ray) [j0541825@mesquite-2 ~]$ python
Python 3.6.10 |Anaconda, Inc.| (default, Mar 26 2020, 00:22:27)
[GCC 7.3.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import ray
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/data/gpfs/anaconda3/envs/ray/lib/python3.6/site-packages/ray/__init__.py", line 25, in <module>
    CDLL(so_path, ctypes.RTLD_GLOBAL)
  File "/data/gpfs/anaconda3/envs/ray/lib/python3.6/ctypes/__init__.py", line 348, in __init__
    self._handle = _dlopen(self._name, mode)
OSError: /lib64/libstdc++.so.6: version `GLIBCXX_3.4.21' not found (required by /data/gpfs/anaconda3/envs/ray/lib/python3.6/site-packages/ray/_raylet.so)

Here is the list of installed packages in that environment:

# Name                    Version                   Build  Channel
_libgcc_mutex             0.1                        main
_pytorch_select           2.0             gpu_25737.g2788c56    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
absl-py                   0.8.1                    py36_0
apex                      0.1.0_1.7.1.a0  py36_683.g5ebb56f    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
arrow-cpp                 0.15.1          py36_684.g3ff7364    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
atomicwrites              1.4.0                      py_0
attrs                     20.1.0                   pypi_0    pypi
blas                      1.0                    openblas
boost-cpp                 1.67.0               h14c3975_4
brotli                    1.0.7                he6710b0_0
brotlipy                  0.7.0           py36h7b6447c_1000
bzip2                     1.0.8                h7b6447c_0
c-ares                    1.15.0            h7b6447c_1001
ca-certificates           2020.7.22                     0
cairo                     1.14.12              h8948797_3
certifi                   2020.6.20                py36_0
cffi                      1.12.3           py36h2e261b9_0
chardet                   3.0.4                 py36_1003
click                     7.0                        py_0
cloudpickle               1.6.0                      py_0
colorama                  0.4.3                      py_0
coverage                  4.5.4            py36h7b6447c_0
cryptography              3.1.1            py36h1ba5d50_0
cudatoolkit               10.2.89            698.g82312a1    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
cudnn                     7.6.5_10.2         667.g338a052    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
cxxfilt                   0.2.0           py_646.gbc2955e    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
cycler                    0.10.0                   py36_0
cython                    0.29                     pypi_0    pypi
cytoolz                   0.11.0           py36h7b6447c_0
dask-core                 2.30.0                     py_0
decorator                 4.4.2                      py_0
double-conversion         3.1.5              647.g15aab6a    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
ffmpeg                    4.2.2                h20bf706_0
filelock                  3.0.12                     py_0
fontconfig                2.13.0               h9420a91_0
freeglut                  3.0.0                hf484d3e_5
freetype                  2.10.2               h5ab3b9f_0
funcsigs                  1.0.2                    py36_0
future                    0.17.1                   py36_0
gflags                    2.2.2             1703.g1bcb8ab    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
giflib                    5.1.4                h14c3975_1
glib                      2.63.1               h5a9c865_0
glog                      0.3.5             1692.g110e904    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
gmp                       6.1.2                h7f7056e_2
gnutls                    3.6.5             h71b1129_1002
graphite2                 1.3.14               h23475e2_0
graphsurgeon              0.4.1           py36_721.g6b2a552    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
grpc-cpp                  1.28.1             657.g35c3292    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
grpcio                    1.16.1           py36hf8bcb03_1
harfbuzz                  1.8.8                hffaf4a1_0
hdf5                      1.10.4               hb1b8bf9_0
hypothesis                5.37.1                     py_0
icu                       58.2                 he6710b0_3
idna                      2.8                      py36_0
imageio                   2.9.0                      py_0
importlib-metadata        1.7.0                    py36_0
importlib_metadata        1.7.0                         0
iniconfig                 1.0.1                    pypi_0    pypi
jasper                    2.0.14               h07fcdf6_1
jpeg                      9b                   hcb7ba68_2
jsonschema                3.2.0                    py36_1
kiwisolver                1.2.0            py36hfd86e86_0
lame                      3.100                h7b6447c_0
ld_impl_linux-ppc64le     2.33.1               h0f24833_7
leveldb                   1.20                 hf484d3e_1
libboost                  1.67.0               h46d08c1_4
libedit                   3.1.20191231         h14c3975_1
libevent                  2.1.11             651.gcf7de63    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
libffi                    3.2.1             hf484d3e_1007
libgcc-ng                 8.2.0                h822a55f_1
libgfortran-ng            7.3.0                h822a55f_1
libglu                    9.0.0                hf484d3e_1
libopenblas               0.3.10               h5a2b251_0
libopencv                 3.4.10          py36_812.g27886b9    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
libopus                   1.3.1                h7b6447c_0
libpng                    1.6.37               hbc83047_0
libprotobuf               3.8.0              658.gde7f9ce    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
libstdcxx-ng              8.2.0                h822a55f_1
libtiff                   4.1.0                h2733197_0
libuuid                   1.0.3                h1bed415_2
libvpx                    1.7.0                hf484d3e_0
libwebp                   1.0.1                h8e7db2f_0
libxcb                    1.14                 h7b6447c_0
libxml2                   2.9.10               he19cac6_1
llvmlite                  0.31.0           py36hd408876_0
lmdb                      0.9.24               he6710b0_0
lz4-c                     1.8.1.2              h14c3975_0
markdown                  3.1.1                    py36_0
matplotlib                3.3.1                         0
matplotlib-base           3.3.1            py36h8254106_0
mock                      3.0.5                    py36_0
more-itertools            8.4.0                    pypi_0    pypi
nccl                      2.6.4              664.g54e83f1    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
ncurses                   6.2                  he6710b0_1
nettle                    3.4.1                hbb512f6_0
networkx                  2.3                        py_0
ninja                     1.9.0            py36hfd86e86_0
numactl                   2.0.12             652.gb5e1afd    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
numba                     0.47.0           py36h962f231_0
numpy                     1.17.4           py36hd5be1e1_0
numpy-base                1.17.4           py36h2f8d375_0
olefile                   0.46                       py_0
onnx                      1.6.0           py36_695.g506708a    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
opencv                    3.4.10          py36_812.g27886b9    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
openh264                  2.1.0                hd408876_0
openssl                   1.1.1h               h7b6447c_0
packaging                 20.4                       py_0
pandas                    0.25.3           py36he6710b0_0
parquet-cpp               1.5.1              652.g650bfd0    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
pcre                      8.44                 he6710b0_0
pillow                    7.0.0            py36haac5956_0
pip                       20.2.2                   py36_0
pixman                    0.40.0               h7b6447c_0
pluggy                    0.13.1                   py36_0
powerai-license           1.7.1.a0           808.g7ea5f87    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
powerai-release           1.7.1.a0           651.g1c389a2    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
powerai-tools             1.7.1.a0           647.g843ad38    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
protobuf                  3.8.0            py36he6710b0_0
py                        1.9.0                      py_0
py-opencv                 3.4.10          py36_812.g27886b9    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
pyarrow                   0.15.1          py36_687.gfd1820f    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
pycparser                 2.20                       py_2
pyopenssl                 19.1.0                     py_1
pyparsing                 2.4.7                      py_0
pyrsistent                0.17.3           py36h7b6447c_0
pysocks                   1.7.1                    py36_0
pytest                    6.0.1                    pypi_0    pypi
python                    3.6.10               ha29dc6b_1
python-dateutil           2.8.1                      py_0
python-lmdb               0.98             py36he6710b0_0
pytorch                   1.5.0            25737.g2788c56    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
pytorch-base              1.5.0           gpu_py36_25737.g2788c56    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
pytz                      2020.1                     py_0
pywavelets                1.1.1            py36h7b6447c_2
pyyaml                    5.1.2            py36h7b6447c_0
ray                       0.8.1            py36h1d8a796_1    powerai
re2                       2020.05.01         645.g6afac28    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
readline                  8.0                  h7b6447c_0
redis-py                  3.5.3                      py_0
requests                  2.22.0                   py36_1
scikit-image              0.15.0           py36he6710b0_0
scipy                     1.4.1            py36habc2bb6_0
setuptools                49.6.0                   py36_0
six                       1.15.0                   pypi_0    pypi
snappy                    1.1.7                h1532aa0_3
sortedcontainers          2.2.2                      py_0
spectrum-mpi              10.03              702.ga72dafb    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
sqlite                    3.33.0               hbc83047_0
tabulate                  0.8.2                    py36_0
tensorboard               2.2.2           py_a4bcc6b_4457.g1bb2968    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
tensorboard-plugin-wit    1.6.0           py_638.gc00ec86    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
tensorrt                  7.0.0.11        py36_721.g6b2a552    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
thrift-cpp                0.13.0             667.g56cf104    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
tk                        8.6.10               hbc83047_0
toml                      0.10.1                   pypi_0    pypi
toolz                     0.11.1                     py_0
torchtext                 0.6.0           py36_659.ge17227c    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
torchvision-base          0.6.0           gpu_py36_682.ga63109c    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
tornado                   6.0.4            py36h7b6447c_1
tqdm                      4.36.1                     py_0
typing                    3.6.4                    py36_0
uff                       0.6.5           py36_721.g6b2a552    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
uriparser                 0.9.3              639.g7465fef    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
urllib3                   1.25.10                    py_0
wcwidth                   0.2.5                      py_0
werkzeug                  0.16.0                     py_0
wheel                     0.34.2                   py36_0
x264                      1!157.20191217       h7b6447c_0
xz                        5.2.5                h7b6447c_0
yaml                      0.1.7                h1bed415_2
zipp                      3.1.0                    pypi_0    pypi
zlib                      1.2.11               h7b6447c_3
zstd                      1.3.7                h0b5b093_0

[recipe request] FARM and pre-reqs

Please add FARM: https://github.com/deepset-ai/FARM

There's currently no conda-forge recipe for FARM, it expects to install several pre-reqs using pip. I was able to substitute in conda packages for many of those reqs using the Anaconda, WML CE, and Supplementary channels (didn't have the presence of mind to include conda-forge).

In case it helps anyone else, I was able to get FARM to build against WML CE 1.6.2 PyTorch with:

#!/bin/bash -i

set -e

# Update conda config to include WML CE production and Supplmentary channels
conda config --prepend channels https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda/
conda config --append channels powerai

# Install and activate WML CE 1.6.2 PyTorch environment
export IBM_POWERAI_LICENSE_ACCEPT=yes
conda create -y -n FARM python=3.6 pytorch powerai-release=1.6.2
conda activate FARM

# Install as many FARM requisites as possible from conda
conda install -y alembic boto3 "configparser>=0.3.5" entrypoints flask \
    flask-cors "gitdb2>=2.0.0" "gitpython>=2.1.0" gunicorn jsonschema \
    "keras>=2.2.4" mako pandas "pyrsistent>=0.14.0" "python-editor>=0.3" regex \
    requests scikit-learn scipy sentencepiece setuptools simplejson \
    "smmap2>=2.0.0" sqlalchemy sqlparse tqdm "websocket-client>=0.32.0" wheel

# Install other FARM requisites using pip
pip install transformers==2.1.1
pip install flask-restplus
pip install dotmap==1.3.0
pip install seqeval
pip install mlflow==1.0.0

# Clone and install latest FARM
git clone https://github.com/deepset-ai/FARM.git
cd FARM
pip install -e .

exit 0

powerai - which package messes up mpicxx and how to fix it?

I frequently get this issue either due to spectrum-mpi or gcc conda package "leftovers" in powerai environment. When uninstalling these packages some mpi commands still point to the conda environment. How do I fix this or at least troubleshoot? Why MPI variables are modified?

For example:

module load gcc ompi
conda activate powerai.1.6.1
mpicxx -show
Cannot open configuration file /users/da/powerai/powerai.1.6.1/share/openmpi/mpicxx-wrapper-data.txt
Error parsing data file mpicxx: Not found

[recipe request] interact

Name of package: interact
URL of package source code: https://github.com/drugilsberg/interact
License of package: Apache-2
List of package dependencies:

numpy==1.16.0
scipy==1.2.0
matplotlib==3.0.2
seaborn==0.9.0
pandas==0.23.4
scikit-learn==0.20.2
pygraphviz==1.5
networkx==2.2
git+https://github.com/facebookresearch/fastText

Short description of package and use case(s):
The interact package provide an implementation of INtERAcT (Interaction networks from vector representation of words) together with a selection of different metrics. Additionally, it exposes various utilities parse data from STRING DB, UniProt and files in gmt format.

Folks who would also like to see this package in the supplementary channel, please thumbs-up so the developers can know which requests to prioritize.

[recipe request] mesh-tensorflow

Name of package: mesh-tensorflow
URL of package source code: https://github.com/tensorflow/mesh
License of package: Apache-2
List of package dependencies:

install_requires=[
        'future',
        'six',
    ],
    extras_require={
        'tensorflow': ['tensorflow>=1.9.0'],
        'tensorflow_gpu': ['tensorflow-gpu>=1.9.0'],
        'tests': [
            'absl-py',
            'pytest',
            'tensor2tensor>=1.9.0',  # TODO(trandustin): rm dependence
        ],
    },

Short description of package and use case(s):

Mesh TensorFlow (mtf) is a language for distributed deep learning, capable of specifying a broad class of distributed tensor computations. The purpose of Mesh TensorFlow is to formalize and implement distribution strategies for your computation graph over your hardware/processors. For example: "Split the batch over rows of processors and split the units in the hidden layer across columns of processors." Mesh TensorFlow is implemented as a layer over TensorFlow.

Folks who would also like to see this package in the supplementary channel, please thumbs-up so the developers can know which requests to prioritize.

[recipe request] bazel

Name of package: bazel
URL of package source code: https://github.com/bazelbuild/bazel
License of package: Apache-2
List of package dependencies:

    - java-openjdk-ppc64le {{ openjdk }} # [ppc64le]
    - openjdk {{ openjdk }} # [x86_64]
    - unzip  {{ unzip }} # [linux]
    - zip    # [linux]

Short description of package and use case(s):
A fast, scalable, multi-language and extensible build system

Folks who would also like to see this package in the supplementary channel, please thumbs-up so the developers can know which requests to prioritize.

[recipe request] horovod

Name of package: Horovod
URL of package source code: https://github.com/horovod/horovod
License of package: Apache-2
List of package dependencies:

require_list = ['cloudpickle', 'psutil', 'six']

Short description of package and use case(s):
Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.

Folks who would also like to see this package in the supplementary channel, please thumbs-up so the developers can know which requests to prioritize.

Bazel build error

HI, I am trying to build new version of Bazel (3.1.0, 3.0.0 or 2.2.0) with the java version:

Java(TM) SE Runtime Environment (build 8.0.6.10 - pxl6480sr6fp10-20200408_01(SR6 FP10))
IBM J9 VM (build 2.9, JRE 1.8.0 Linux ppc64le-64-Bit

When running "./compile.sh", all produced the same errors:

 java.lang.IllegalStateException: Can't find tenured space; update this class for a new collector
 ......

Any suggestion?

Thanks,
Shelton

[recipe request] Tensorflow-datasets

Name of package: Tensorflow-datasets
URL of package source code: https://github.com/tensorflow/datasets
License of package: Apache-2
List of package dependencies:
- absl-py
- dill
- future (python2)
- numpy
- promise
- protobuf
- psutil
- requests
- six
- tensorflow-metadata
- termcolor
- tqdm
- wrapt
- tensorflow
Short description of package and use case(s):
A collection of datasets ready to use with TensorFlow

Folks who would also like to see this pacakge in the supplementary channel, please thumbs-up so the developers can know which requests to prioritize.

powerai:1.5.4 Tensorflow

Hi,

I am trying to use ibmcom/powerai:1.5.4-all-ubuntu18.04-py3 since it's listed as having TF 1.12.0, which is required for code I am trying to run.

I've also tried source /opt/DL/tensorflow/bin/install_dependencies then source /opt/DL/tensorflow/bin/tensorflow-activate as recommended from a similar issue, but attempting import tensorflow still fails with ImportError: libcuda.so.1: cannot open shared object file: No such file or directory

The architecture is ppc64le.

[recipe request] AIX360

Name of package: AI Explanability 360 AIX360
URL of package source code: https://github.com/IBM/AIX360
License of package: Apache-2
List of package dependencies:

install_requires=[
                'joblib>=0.11',
                'scikit-learn>=0.21.2',
                'torch',
                'torchvision',
                'cvxpy',
                'cvxopt',
                'Image',
                'keras',
                'matplotlib',
		'numpy',
                'pandas',
                'scipy>=0.17',
                'tensorflow',
                'xport',
		'scikit-image',
		'requests'
	],

Short description of package and use case(s):
Interpretability and explainability of data and machine learning models

Folks who would also like to see this package in the supplementary channel, please thumbs-up so the developers can know which requests to prioritize.

SUMMIT timeout with 954 GPUs

Hi,

I am running a deep learning model on SUMMIT using Horovod and IBM-WML v1.6.1, the script runs without any issue when I use 10 nodes. However, when I large scale it to 954 nodes, it gives timeout error as follows:

      Please see /tmp/DDLRUN/DDLRUN.XwpRxX61zQZ1/ddlrun.log for detailed log.
    
      [WARN DDL-2-28] The SKIPCHECKS flag is set. This removes the ability for
      'ddlrun' to detect remote hardware configurations and can cause errors in
      non-homogenous cluster environments - i.e., machines with varying core or
      GPU counts.
    
      Please see /tmp/DDLRUN/DDLRUN.XwpRxX61zQZ1/ddlrun.log for detailed log.
    
      --------------------------------------------------------------------------
    
      The user-provided time limit for job execution has been reached:
    
      Timeout: 180 seconds
    
      The job will now be aborted. Please check your code and/or
    
      adjust/remove the job execution time limit (as specified by --timeout
    
      command line option or MPIEXEC_TIMEOUT environment variable).

I tried to pass the timeout variable but it doesn't accept it:
ddlrun --verbose -mpiarg "-timeout 600" ......

I also tried to export "MPIEXEC_TIMEOUT", but it has no effect:
export MPIEXEC_TIMEOUT=600

Could you please provide the correct way to increase the timeout value with ibm-wml v.1.6.1 ?

Installing torchvision for ppc64le architecture

I am in a weird scenario were I am forced to use torch 1.3.1 (due to hardware see: https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda/#/). I read from the pytorch docs that it's corresponding version of torchvision is 0.4.1 (https://pypi.org/project/torchvision/):

Installation

We recommend Anaconda as Python package management system. Please refer to pytorch.org for the detail of PyTorch (torch) installation. The following is the corresponding torchvision versions and supported Python versions.
Installation
We recommend Anaconda as Python package management system. Please refer to pytorch.org for the detail of PyTorch (torch) installation. The following is the corresponding torchvision versions and supported Python versions.

torch	torchvision	python
master / nightly	master / nightly	>=3.6
1.5.0	0.6.0	>=3.5
1.4.0	0.5.0	==2.7, >=3.5, <=3.8
1.3.1	0.4.2	==2.7, >=3.5, <=3.7
1.3.0	0.4.1	==2.7, >=3.5, <=3.7
1.2.0	0.4.0	==2.7, >=3.5, <=3.7
1.1.0	0.3.0	==2.7, >=3.5, <=3.7
<=1.0.1	0.2.2	==2.7, >=3.5, <=3.7

but for some reason I have the wrong version of it:

torchvision 0.2.2 pypi_0 pypi

is there a way to install the right version of torchvision?

What I've tried:

First I tried force installing the right version with conda. Conda couldn't find the version of torchvision that I need:

$ conda install torchvision==0.4.2
Collecting package metadata (current_repodata.json): done
Solving environment: failed with initial frozen solve. Retrying with flexible solve.
Collecting package metadata (repodata.json): done
Solving environment: failed with initial frozen solve. Retrying with flexible solve.

PackagesNotFoundError: The following packages are not available from current channels:

  - torchvision==0.4.2

Current channels:

  - https://repo.anaconda.com/pkgs/main/linux-ppc64le
  - https://repo.anaconda.com/pkgs/main/noarch
  - https://repo.anaconda.com/pkgs/r/linux-ppc64le
  - https://repo.anaconda.com/pkgs/r/noarch

To search for alternate channels that may provide the conda package you're
looking for, navigate to

    https://anaconda.org

and use the search bar at the top of the page.

Then I proceeded to try to install it regardless with pip

$ pip install torchvision==0.4.2
Defaulting to user installation because normal site-packages is not writeable
ERROR: Could not find a version that satisfies the requirement torchvision==0.4.2 (from versions: 0.1.6, 0.1.7, 0.1.8, 0.1.9, 0.2.0, 0.2.1, 0.2.2, 0.2.2.post2, 0.2.2.post3)
ERROR: No matching distribution found for torchvision==0.4.2

got an error too.

Is there anything else to try?

I tried but it failed:

conda install torchvision==0.4.2 -c pytorch

Collecting package metadata (current_repodata.json): done
Solving environment: failed with initial frozen solve. Retrying with flexible solve.
Collecting package metadata (repodata.json): done
Solving environment: failed with initial frozen solve. Retrying with flexible solve.

PackagesNotFoundError: The following packages are not available from current channels:

  - torchvision==0.4.2

Current channels:

  - https://conda.anaconda.org/pytorch/linux-ppc64le
  - https://conda.anaconda.org/pytorch/noarch
  - https://repo.anaconda.com/pkgs/main/linux-ppc64le
  - https://repo.anaconda.com/pkgs/main/noarch
  - https://repo.anaconda.com/pkgs/r/linux-ppc64le
  - https://repo.anaconda.com/pkgs/r/noarch

To search for alternate channels that may provide the conda package you're
looking for, navigate to

    https://anaconda.org

and use the search bar at the top of the page.

crossposted SO: https://discuss.pytorch.org/t/force-installing-torchvision/97279
crossposted reddit pytorch: https://www.reddit.com/r/pytorch/comments/iyf2qn/force_installing_torchvision/
crossposted reddit ibm: https://www.reddit.com/r/IBM/comments/iyhzex/force_installing_torchvision_042_when_i_am_forced/
real problem is installing torchmeta: tristandeleu/pytorch-meta#95
https://www.ibm.com/mysupport/s/forumsquestion?id=0D50z00006gaxV9CAI
quora: https://www.quora.com/unanswered/How-does-one-install-specific-Python-packages-in-Conda-from-IBM-architectures
reddit ibm2: https://www.reddit.com/r/newIBM/comments/iyij10/force_installing_torchvision_042_when_i_am_forced/

https://github.com/pytorch/pytorch/issues/45228

Sentencepiece

Hi,

I have been trying to install the sentencepiece package on ppc64 using the powerai channel. But when I install it, it uses pip.

The version of sentencepiece downloaded is 0.1.85 and is compiled against protobuf 3.6.1. This however conflicts with the rest of my installation (using channels powerai and defaults) which uses protobuf 3.7.1.

Error message:

[libprotobuf FATAL google/protobuf/stubs/common.cc:86] This program was compiled 
against version 3.6.1 of the Protocol Buffer runtime library, which is not 
compatible with the installed version (3.7.1).  Contact the program author for an update.  
If you compiled the program yourself, make sure that your headers are from the same 
version of Protocol Buffers as your link-time library.  (Version verification failed in 
"/sentencepiece/src/builtin_pb/sentencepiece_model.pb.cc".)
terminate called after throwing an instance of 'google::protobuf::FatalException'
  what():  This program was compiled against version 3.6.1 of the Protocol Buffer 
runtime library, which is not compatible with the installed version (3.7.1).  
Contact the program author for an update.  If you compiled the program yourself, 
make sure that your headers are from the same version of Protocol Buffers as your 
link-time library.  
(Version verification failed in "/sentencepiece/src/builtin_pb/sentencepiece_model.pb.cc".)

scripts/stack-transformer/preprocess.sh: line 109: 139207 Aborted

How do I navigate this to install sentencepice from powerai?

Torch-scatter for both ppc and x86

Hello,

Please include torch-scatter in the powerai channel. I would appreciate if you could package 1.3.2 first, we are pinned at that dependency for our project.

Name of package: Torch-scatter
URL of package source code: https://github.com/rusty1s/pytorch_scatter/tree/1.3.2
License of package: MIT
Dependencies:
cuda
torch>=1.1

Short description of package and use case(s):
An open-source library of highly optimized sparse update (scatter) operations for the use in PyTorch.

[recipe request] r-base

Name of package: r-base
URL of package source code:  https://cran.r-project.org/src/base/R-3/R-3.4.3.tar.gz
License of package: GPLv3
List of package dependencies:

 build:
    - {{ compiler('c') }}                # [not win]
    - {{ compiler('cxx') }}              # [not win]
    - {{ compiler('fortran') }}          # [not win]
    - make                               # [not win]
    - {{ cdt('xorg-x11-proto-devel') }}  # [linux]
    - {{ cdt('libxrender') }}            # [linux]
    - {{ cdt('libxext') }}               # [linux]
    - {{ cdt('libuuid') }}               # [linux]
    - {{ cdt('libsm-devel') }}           # [linux]
    - {{ cdt('libice-devel') }}          # [linux]
    - {{ cdt('libx11-devel') }}          # [linux]
    - {{ cdt('libxt') }}                 # [linux]
    - {{ cdt('libxt-devel') }}           # [linux]
    - {{ cdt('libxcb') }}                # [linux]
    - {{ cdt('libxau') }}                # [linux]
    - {{ cdt('java-1.7.0-openjdk') }}    # [linux]
    - {{posix}}pkg-config
    - texlive-core                       # [unix]
    - {{posix}}autoconf
    - {{posix}}automake                  # [not win]
  host:
    - readline 7.*                       # [not win]
    - ncurses                            # [not win]
    - libcurl                            # [not win]
    - xz                                 # [not win]
    - libpng                             # [not win]
    - {{native}}bzip2 1.0.*
    - {{native}}cairo                    # [not win]
    - {{native}}jpeg                     # [not win]
    - {{native}}glib                     # [linux]
    - {{native}}bwidget
    - {{native}}tktable
    - {{native}}pango 1.42.*             # [not win]
    - {{native}}icu
    - {{native}}pcre
    - {{native}}tk 8.6.*                 # [not win]
    - {{native}}zlib                     # [not win]
    - {{native}}libtiff                  # [not win]
    - {{native}}openblas-devel >=0.2.20  # [linux]

  run:
    - _r-mutex 1.* anacondar_1
    - {{ compiler('c') }}                # [not win]
    - {{ compiler('cxx') }}              # [not win]
    - {{ compiler('fortran') }}          # [not win]
    - readline 7.*                       # [not win]
    - libcurl                            # [not win]
    - curl                               # [not win]
    - {{native}}bwidget
    - {{native}}tktable
    - {{native}}pango 1.*                # [not win]
    - {{native}}pcre
    - {{native}}tk 8.6.*                 # [not win]

Short description of package and use case(s):

'R is a free software environment for statistical computing and graphics.'

Folks who would also like to see this package in the supplementary channel, please thumbs-up so the developers can know which requests to prioritize.

ibm / powerai Goto Github PK

powerai's Introduction

Powerai

Examples

Vision

conda-recipes

powerai's People

Contributors

Stargazers

Watchers

Forkers

powerai's Issues

Installation

Recommend Projects

Recommend Topics

Recommend Org