conda-forge / curl-feedstock Goto Github PK

A conda-smithy repository for curl.

License: BSD 3-Clause "New" or "Revised" License

Shell 44.87% Batchfile 55.13%

curl-feedstock's Issues

BUG: cloning issues with curl 8.1.0 (current CI default) on linux

I see some cloning issues for the very beginning of a build in conda-forge/pytorch-cpu-feedstock#169:

Cloning into bare repository '/home/conda/feedstock_root/build_artifacts/git_cache/github.com/pytorch/pytorch.git'...
error: RPC failed; HTTP 408 curl 18 HTTP/2 stream 7 was reset
fatal: expected 'packfile'

At first I suspected a github issue, but this persists across restarts, and more importantly, it doesn't show up on OSX, only on linux. Based on the error message and the recently released new curl version, I'm suspecting this feedstock, but perhaps it's something else entirely...

Interestingly, the CI does not yet pull in 8.1.1, but rather:

++ conda list --show-channel-urls
# packages in environment at /opt/conda:
[...]
curl                      8.1.0                h409715c_0    conda-forge

I'm not sure if 8.1.1 would fix things already, but I wanted to open an issue if other people run into this.

CC @conda-forge/core

add SPENGO support

Please build libcurl/curl with SPNEGO support so we can make requests to Kerberos-enabled services.

Options that curl was built with (from curl -V output)
from RHEL 7.6 as an example:

Features: AsynchDNS GSS-Negotiate IDN IPv6 Largefile NTLM NTLM_WB SSL libz unix-sockets

from Anaconda:

Features: AsynchDNS IPv6 Largefile NTLM NTLM_WB SSL libz TLS-SRP UnixSockets HTTPS-proxy

Missing libcurl options build option to add GSS-Negotiate support:

GSSAPI support: no (--with-gssapi) 
SNPEGO support: no (--with-spnego)

Thank you.

Broken label for curl 7.55.1-0 has a trailing space

Issue:

I realize this is not the most pressing conda-forge issue, but it is not possible to download the broken version of curl 7.55.1-0 because it's label is "broken " with a trailing space. Anaconda Cloud recommends the following, which fails:

$ conda install -c "conda-forge/label/broken " curl=7.55.1=0
Solving environment: failed

PackagesNotFoundError: The following packages are not available from current channels:

  - curl==7.55.1=0

Current channels:

  - https://conda.anaconda.org/conda-forge/label/broken/linux-64
  - https://conda.anaconda.org/conda-forge/label/broken/noarch

To search for alternate channels that may provide the conda package you're
looking for, navigate to

    https://anaconda.org

and use the search bar at the top of the page.

whereas this works when the label is "broken", e.g. for libiconv 1.15:

$ conda install -c conda-forge/label/broken libiconv

Environment (conda list):

$ conda list
# packages in environment at /opt/conda:
#
# Name                    Version                   Build  Channel
asn1crypto                0.24.0                   py37_0  
ca-certificates           2016.2.28                     1    conda-forge/label/broken
certifi                   2018.10.15               py37_0  
cffi                      1.11.5           py37he75722e_1  
chardet                   3.0.4                    py37_1  
conda                     4.5.11                   py37_0  
conda-env                 2.6.0                         1  
cryptography              2.3.1            py37hc365091_0  
idna                      2.7                      py37_0  
libedit                   3.1.20170329         h6b74fdf_2  
libffi                    3.2.1                hd88cf55_4  
libgcc-ng                 8.2.0                hdf63c60_1  
libiconv                  1.15                          0    conda-forge/label/broken
libstdcxx-ng              8.2.0                hdf63c60_1  
ncurses                   6.1                  hf484d3e_0  
openssl                   1.0.2p               h14c3975_0  
pip                       10.0.1                   py37_0  
pycosat                   0.6.3            py37h14c3975_0  
pycparser                 2.18                     py37_1  
pyopenssl                 18.0.0                   py37_0  
pysocks                   1.6.8                    py37_0  
python                    3.7.0                hc3d631a_0  
readline                  7.0                  h7b6447c_5  
requests                  2.19.1                   py37_0  
ruamel_yaml               0.15.46          py37h14c3975_0  
setuptools                40.2.0                   py37_0  
six                       1.11.0                   py37_1  
sqlite                    3.24.0               h84994c4_0  
tk                        8.6.8                hbc83047_0  
urllib3                   1.23                     py37_0  
wheel                     0.31.1                   py37_0  
xz                        5.2.4                h14c3975_4  
yaml                      0.1.7                had09818_2  
zlib                      1.2.11               ha838bed_2

Details about conda and system ( conda info ):

$ conda info

     active environment : base
    active env location : /opt/conda
            shell level : 1
       user config file : /root/.condarc
 populated config files : 
          conda version : 4.5.11
    conda-build version : not installed
         python version : 3.7.0.final.0
       base environment : /opt/conda  (writable)
           channel URLs : https://repo.anaconda.com/pkgs/main/linux-64
                          https://repo.anaconda.com/pkgs/main/noarch
                          https://repo.anaconda.com/pkgs/free/linux-64
                          https://repo.anaconda.com/pkgs/free/noarch
                          https://repo.anaconda.com/pkgs/r/linux-64
                          https://repo.anaconda.com/pkgs/r/noarch
                          https://repo.anaconda.com/pkgs/pro/linux-64
                          https://repo.anaconda.com/pkgs/pro/noarch
          package cache : /opt/conda/pkgs
                          /root/.conda/pkgs
       envs directories : /opt/conda/envs
                          /root/.conda/envs
               platform : linux-64
             user-agent : conda/4.5.11 requests/2.19.1 CPython/3.7.0 Linux/4.15.0-39-generic debian/9 glibc/2.24
                UID:GID : 0:0
             netrc file : None
           offline mode : False

--with-darwinssl breaks some older systems

I read the conda-forge documentation and could not find the solution for my problem there.

Issue:

Environment (conda list):

$ conda list
  c-ares             conda-forge/osx-64::c-ares-1.17.1-h0d85af4_1
  ca-certificates    conda-forge/osx-64::ca-certificates-2020.12.5-h033912b_0
  curl               conda-forge/osx-64::curl-7.75.0-h06286d4_0
  krb5               conda-forge/osx-64::krb5-1.17.2-h60d9502_0
  libcurl            conda-forge/osx-64::libcurl-7.75.0-h8ef9fac_0
  libcxx             conda-forge/osx-64::libcxx-11.1.0-habf9029_0
  libedit            conda-forge/osx-64::libedit-3.1.20191231-h0678c8f_2
  libev              conda-forge/osx-64::libev-4.33-haf1e3a3_1
  libnghttp2         conda-forge/osx-64::libnghttp2-1.43.0-h07e645a_0
  libssh2            conda-forge/osx-64::libssh2-1.9.0-h52ee1ee_6
  ncurses            conda-forge/osx-64::ncurses-6.2-h2e338ed_4
  openssl            conda-forge/osx-64::openssl-1.1.1k-h0d85af4_0
  tk                 conda-forge/osx-64::tk-8.6.10-h0419947_1
  zlib               conda-forge/osx-64::zlib-1.2.11-h7795811_1010

Details about conda and system ( conda info ):

$ conda info
     active environment : base
    active env location : /Users/isuruf/miniforge3
            shell level : 1
       user config file : /Users/isuruf/.condarc
 populated config files : /Users/isuruf/miniforge3/.condarc
                          /Users/isuruf/.condarc
          conda version : 4.10.0
    conda-build version : 3.21.4
         python version : 3.8.6.final.0
       virtual packages : __osx=10.9.5=0
                          __unix=0=0
                          __archspec=1=x86_64
       base environment : /Users/isuruf/miniforge3  (writable)
      conda av data dir : /Users/isuruf/miniforge3/etc/conda
  conda av metadata url : https://repo.anaconda.com/pkgs/main
           channel URLs : https://conda.anaconda.org/conda-forge/osx-64
                          https://conda.anaconda.org/conda-forge/noarch
          package cache : /Users/isuruf/miniforge3/pkgs
                          /Users/isuruf/.conda/pkgs
       envs directories : /Users/isuruf/miniforge3/envs
                          /Users/isuruf/.conda/envs
               platform : osx-64
             user-agent : conda/4.10.0 requests/2.25.1 CPython/3.8.6 Darwin/13.4.0 OSX/10.9.5
                UID:GID : 504:20
             netrc file : None
           offline mode : False

Because of this, mamba fails with SSL peer certificate or SSH remote key was not OK and git fails with SSL: certificate verification failed

Release build for libcurl

Release build for libcurl is needed, as the behaviour changes in different build, e.g. https://github.com/curl/curl/blob/b935fd4a07aa9dc0fa352b0a1d4822c4d901577b/lib/vtls/openssl.c#L4767

In this particular line, signal close_notify not being received at the end of handshake is considered as error in debug build only.

update to version 7.52.1

https://curl.haxx.se/changes.html

/libcurl.so.4: undefined symbol: SSL_CTX_set_alpn_protos

On a couple CentOS, Ubuntu and on a few RHEL6/7 Vagrant boxes this works fine. But on an older RH box, it looks like the curl feedstock isn't linked correctly, which breaks some packages that depend on it.

For example:

conda create -n rcurl-test
source activate rcurl-test
conda install -c conda-forge r-rcurl
(rcurl-test) -bash-4.1$ Rscript -e 'library(RCurl')
-bash: syntax error near unexpected token `)'
(rcurl-test) -bash-4.1$ Rscript -e 'library(RCurl)'
Loading required package: methods
Loading required package: bitops
Error: package or namespace load failed for âRCurlâ in dyn.load(file, DLLpath = DLLpath, ...):
 unable to load shared object '/gpfs/users/kbdt501/local/share/bcbio/anaconda/envs/rcurl-test/lib/R/library/RCurl/libs/RCurl.so':
  /gpfs/users/kbdt501/local/share/bcbio/anaconda/envs/rcurl-test/lib/R/library/RCurl/libs/../../../../libcurl.so.4: undefined symbol: SSL_CTX_set_alpn_protos
Execution halted

Linux version 2.6.32-431.el6.x86_64 ([email protected]) (gcc
 version 4.4.7 20120313 (Red Hat 4.4.7-4)  (GCC) ) #1 SMP Sun Nov 10 22:19:54 EST 2013

Installing libcurl from defaults fixes the issue, so if we could build this curl similar to that one it would fix the problem.

update to version 7.53.1

libcurl 7.81 results in segfault in Julia

Continuous integration efforts picked up that julia 1.6.5 and 1.7.1 segfaults when using libcurl 7.81. Downgrading to libcurl 7.80 resolves the issue.

$ conda create -n julia171_20220107 julia=1.7.1
Collecting package metadata (current_repodata.json): done
Solving environment: done

# Package Plan ##

  environment location: /home/mkitti/anaconda3/envs/julia171_20220107

  added / updated specs:
    - julia=1.7.1


The following packages will be downloaded:

    package                    |            build
    ---------------------------|-----------------
    curl-7.81.0                |       h494985f_0          90 KB  conda-forge
    julia-1.7.1                |       h989b2f6_2       105.1 MB  conda-forge
    libcurl-7.81.0             |       h494985f_0         340 KB  conda-forge
    openlibm-0.7.5             |       h7f98852_0         208 KB  conda-forge
    ------------------------------------------------------------
                                           Total:       105.7 MB

The following NEW packages will be INSTALLED:

  _libgcc_mutex      conda-forge/linux-64::_libgcc_mutex-0.1-conda_forge
  _openmp_mutex      conda-forge/linux-64::_openmp_mutex-4.5-1_gnu
  arpack             conda-forge/linux-64::arpack-3.7.0-hdefa2d7_2
  bzip2              conda-forge/linux-64::bzip2-1.0.8-h7f98852_4
  c-ares             conda-forge/linux-64::c-ares-1.18.1-h7f98852_0
  ca-certificates    conda-forge/linux-64::ca-certificates-2021.10.8-ha878542_0
  curl               conda-forge/linux-64::curl-7.81.0-h494985f_0
  expat              conda-forge/linux-64::expat-2.4.2-h9c3ff4c_0
  gettext            conda-forge/linux-64::gettext-0.19.8.1-h73d1719_1008
  git                conda-forge/linux-64::git-2.34.1-pl5321hf874766_0
  gmp                conda-forge/linux-64::gmp-6.2.1-h58526e2_0
  julia              conda-forge/linux-64::julia-1.7.1-h989b2f6_2
  krb5               conda-forge/linux-64::krb5-1.19.2-h48eae69_3
  libblas            conda-forge/linux-64::libblas-3.9.0-12_linux64_openblas
  libcblas           conda-forge/linux-64::libcblas-3.9.0-12_linux64_openblas
  libcurl            conda-forge/linux-64::libcurl-7.81.0-h494985f_0
  libedit            conda-forge/linux-64::libedit-3.1.20191231-he28a2e2_2
  libev              conda-forge/linux-64::libev-4.33-h516909a_1
  libffi             conda-forge/linux-64::libffi-3.4.2-h7f98852_5
  libgcc-ng          conda-forge/linux-64::libgcc-ng-11.2.0-h1d223b6_11
  libgfortran-ng     conda-forge/linux-64::libgfortran-ng-11.2.0-h69a702a_11
  libgfortran5       conda-forge/linux-64::libgfortran5-11.2.0-h5c6108e_11
  libgit2            conda-forge/linux-64::libgit2-1.3.0-haabb1ae_1
  libgomp            conda-forge/linux-64::libgomp-11.2.0-h1d223b6_11
  libiconv           conda-forge/linux-64::libiconv-1.16-h516909a_0
  liblapack          conda-forge/linux-64::liblapack-3.9.0-12_linux64_openblas
  libnghttp2         conda-forge/linux-64::libnghttp2-1.43.0-ha19adfc_1
  libopenblas        conda-forge/linux-64::libopenblas-0.3.18-pthreads_h8fe5266_0
  libopenblas-ilp64  conda-forge/linux-64::libopenblas-ilp64-0.3.18-pthreads_h0aa5bea_0
  libssh2            conda-forge/linux-64::libssh2-1.10.0-ha35d2d1_2
  libstdcxx-ng       conda-forge/linux-64::libstdcxx-ng-11.2.0-he4da1e4_11
  libunwind          conda-forge/linux-64::libunwind-1.5.0-h9c3ff4c_1
  libutf8proc        conda-forge/linux-64::libutf8proc-2.7.0-h7f98852_0
  libzlib            conda-forge/linux-64::libzlib-1.2.11-h36c2ea0_1013
  mbedtls            conda-forge/linux-64::mbedtls-3.1.0-h9c3ff4c_0
  metis              conda-forge/linux-64::metis-5.1.0-h58526e2_1006
  mpfr               conda-forge/linux-64::mpfr-4.1.0-h9202a9a_1
  ncurses            conda-forge/linux-64::ncurses-6.2-h58526e2_4
  openblas-ilp64     conda-forge/linux-64::openblas-ilp64-0.3.18-pthreads_h3d04fff_0
  openlibm           conda-forge/linux-64::openlibm-0.7.5-h7f98852_0
  openssl            conda-forge/linux-64::openssl-3.0.0-h7f98852_2
  p7zip              conda-forge/linux-64::p7zip-16.02-he1b5a44_1000
  pcre2              conda-forge/linux-64::pcre2-10.37-h032f7d1_0
  perl               conda-forge/linux-64::perl-5.32.1-1_h7f98852_perl5
  suitesparse        conda-forge/linux-64::suitesparse-5.10.1-h9e50725_1
  tbb                conda-forge/linux-64::tbb-2021.5.0-h4bd325d_0
  tk                 conda-forge/linux-64::tk-8.6.11-h27826a3_1
  zlib               conda-forge/linux-64::zlib-1.2.11-h36c2ea0_1013


Proceed ([y]/n)? 


Downloading and Extracting Packages
julia-1.7.1          | 105.1 MB  | ######################################################################################################################################################################## | 100% 
openlibm-0.7.5       | 208 KB    | ######################################################################################################################################################################## | 100% 
curl-7.81.0          | 90 KB     | ######################################################################################################################################################################## | 100% 
libcurl-7.81.0       | 340 KB    | ######################################################################################################################################################################## | 100% 
Preparing transaction: done
Verifying transaction: done
Executing transaction: |   No Changes to `~/anaconda3/envs/julia171_20220107/share/julia/environments/julia171_20220107/Project.toml`
  No Changes to `~/anaconda3/envs/julia171_20220107/share/julia/environments/julia171_20220107/Manifest.toml`

done
#
# To activate this environment, use
#
#     $ conda activate julia171_20220107
#
# To deactivate an active environment, use
#
#     $ conda deactivate

$ conda activate julia171_20220107
$ julia
               _
   _       _ _(_)_     |  Documentation: https://docs.julialang.org
  (_)     | (_) (_)    |
   _ _   _| |_  __ _   |  Type "?" for help, "]?" for Pkg help.
  | | | | | | |/ _` |  |
  | | |_| | | | (_| |  |  Version 1.7.1 (2021-12-22)
 _/ |\__'_|_|_|\__'_|  |  https://github.com/conda-forge/julia-feedstock
|__/                   |

(@julia171_20220107) pkg> up
  No Changes to `~/anaconda3/envs/julia171_20220107/share/julia/environments/julia171_20220107/Project.toml`
  No Changes to `~/anaconda3/envs/julia171_20220107/share/julia/environments/julia171_20220107/Manifest.toml`
[ Info: We haven't cleaned this depot up for a bit, running Pkg.gc()...
      Active manifest files: 1 found
      Active artifact files: 0 found
      Active scratchspaces: 0 found
     Deleted no artifacts, repos, packages or scratchspaces

(@julia171_20220107) pkg> add Cxx
Cxx          CxxInterface  CxxWrap
(@julia171_20220107) pkg> add Cxx
Cxx          CxxInterface  CxxWrap
(@julia171_20220107) pkg> activate --temp
  Activating new project at `/tmp/jl_cwQiCr`

(jl_cwQiCr) pkg> add CxxWrap
   Resolving package versions...

signal (11): Segmentation fault
in expression starting at none:0
Curl_connect at /home/mkitti/anaconda3/envs/julia171_20220107/bin/../lib/julia/libcurl.so (unknown line)
multi_runsingle at /home/mkitti/anaconda3/envs/julia171_20220107/bin/../lib/julia/libcurl.so (unknown line)
multi_socket at /home/mkitti/anaconda3/envs/julia171_20220107/bin/../lib/julia/libcurl.so (unknown line)
curl_multi_socket_action at /home/mkitti/anaconda3/envs/julia171_20220107/bin/../lib/julia/libcurl.so (unknown line)
curl_multi_socket_action at /home/conda/feedstock_root/build_artifacts/julia_1641439672340/work/usr/share/julia/stdlib/v1.7/LibCURL/src/lC_curl_h.jl:230 [inlined]
curl_multi_socket_action at /home/conda/feedstock_root/build_artifacts/julia_1641439672340/work/usr/share/julia/stdlib/v1.7/Downloads/src/Curl/utils.jl:91 [inlined]
macro expansion at /home/conda/feedstock_root/build_artifacts/julia_1641439672340/work/usr/share/julia/stdlib/v1.7/Downloads/src/Curl/utils.jl:35 [inlined]
#47 at /home/conda/feedstock_root/build_artifacts/julia_1641439672340/work/usr/share/julia/stdlib/v1.7/Downloads/src/Curl/Multi.jl:147
lock at ./lock.jl:190
timer_callback at /home/conda/feedstock_root/build_artifacts/julia_1641439672340/work/usr/share/julia/stdlib/v1.7/Downloads/src/Curl/Multi.jl:146
jfptr_timer_callback_19000.clone_1 at /home/mkitti/anaconda3/envs/julia171_20220107/lib/julia/sys.so (unknown line)
_jl_invoke at /usr/local/src/conda/julia-1.7.1/src/gf.c:2247 [inlined]
jl_apply_generic at /usr/local/src/conda/julia-1.7.1/src/gf.c:2429
jlcapi_timer_callback_18861.clone_1 at /home/mkitti/anaconda3/envs/julia171_20220107/lib/julia/sys.so (unknown line)
Curl_update_timer.part.0 at /home/mkitti/anaconda3/envs/julia171_20220107/bin/../lib/julia/libcurl.so (unknown line)
curl_multi_add_handle at /home/mkitti/anaconda3/envs/julia171_20220107/bin/../lib/julia/libcurl.so (unknown line)
curl_multi_add_handle at /home/conda/feedstock_root/build_artifacts/julia_1641439672340/work/usr/share/julia/stdlib/v1.7/LibCURL/src/lC_curl_h.jl:194 [inlined]
macro expansion at /home/conda/feedstock_root/build_artifacts/julia_1641439672340/work/usr/share/julia/stdlib/v1.7/Downloads/src/Curl/utils.jl:35 [inlined]
#27 at /home/conda/feedstock_root/build_artifacts/julia_1641439672340/work/usr/share/julia/stdlib/v1.7/Downloads/src/Curl/Multi.jl:51
lock at ./lock.jl:190
add_handle at /home/conda/feedstock_root/build_artifacts/julia_1641439672340/work/usr/share/julia/stdlib/v1.7/Downloads/src/Curl/Multi.jl:44 [inlined]
#9 at /home/conda/feedstock_root/build_artifacts/julia_1641439672340/work/usr/share/julia/stdlib/v1.7/Downloads/src/Downloads.jl:345
with_handle at /home/conda/feedstock_root/build_artifacts/julia_1641439672340/work/usr/share/julia/stdlib/v1.7/Downloads/src/Curl/Curl.jl:64
#8 at /home/conda/feedstock_root/build_artifacts/julia_1641439672340/work/usr/share/julia/stdlib/v1.7/Downloads/src/Downloads.jl:311 [inlined]
arg_write at /home/conda/feedstock_root/build_artifacts/julia_1641439672340/work/usr/share/julia/stdlib/v1.7/ArgTools/src/ArgTools.jl:112
#7 at /home/conda/feedstock_root/build_artifacts/julia_1641439672340/work/usr/share/julia/stdlib/v1.7/Downloads/src/Downloads.jl:310 [inlined]
arg_read at /home/conda/feedstock_root/build_artifacts/julia_1641439672340/work/usr/share/julia/stdlib/v1.7/ArgTools/src/ArgTools.jl:61
jfptr_arg_read_49372.clone_1 at /home/mkitti/anaconda3/envs/julia171_20220107/lib/julia/sys.so (unknown line)
_jl_invoke at /usr/local/src/conda/julia-1.7.1/src/gf.c:2247 [inlined]
jl_apply_generic at /usr/local/src/conda/julia-1.7.1/src/gf.c:2429
#request#5 at /home/conda/feedstock_root/build_artifacts/julia_1641439672340/work/usr/share/julia/stdlib/v1.7/Downloads/src/Downloads.jl:309
request##kw at /home/conda/feedstock_root/build_artifacts/julia_1641439672340/work/usr/share/julia/stdlib/v1.7/Downloads/src/Downloads.jl:293 [inlined]
#3 at /home/conda/feedstock_root/build_artifacts/julia_1641439672340/work/usr/share/julia/stdlib/v1.7/Downloads/src/Downloads.jl:222 [inlined]
#open#355 at ./io.jl:330
jfptr_YY.openYY.355_19311.clone_1 at /home/mkitti/anaconda3/envs/julia171_20220107/lib/julia/sys.so (unknown line)
_jl_invoke at /usr/local/src/conda/julia-1.7.1/src/gf.c:2247 [inlined]
jl_apply_generic at /usr/local/src/conda/julia-1.7.1/src/gf.c:2429
open##kw at ./io.jl:328
arg_write at /home/conda/feedstock_root/build_artifacts/julia_1641439672340/work/usr/share/julia/stdlib/v1.7/ArgTools/src/ArgTools.jl:86
#download#2 at /home/conda/feedstock_root/build_artifacts/julia_1641439672340/work/usr/share/julia/stdlib/v1.7/Downloads/src/Downloads.jl:221 [inlined]
download##kw at /home/conda/feedstock_root/build_artifacts/julia_1641439672340/work/usr/share/julia/stdlib/v1.7/Downloads/src/Downloads.jl:221
jfptr_downloadYY.YY.kw_18730.clone_1 at /home/mkitti/anaconda3/envs/julia171_20220107/lib/julia/sys.so (unknown line)
_jl_invoke at /usr/local/src/conda/julia-1.7.1/src/gf.c:2247 [inlined]
jl_apply_generic at /usr/local/src/conda/julia-1.7.1/src/gf.c:2429
#download#14 at /home/conda/feedstock_root/build_artifacts/julia_1641439672340/work/usr/share/julia/stdlib/v1.7/Pkg/src/PlatformEngines.jl:282
download##kw at /home/conda/feedstock_root/build_artifacts/julia_1641439672340/work/usr/share/julia/stdlib/v1.7/Pkg/src/PlatformEngines.jl:259 [inlined]
#install_archive#32 at /home/conda/feedstock_root/build_artifacts/julia_1641439672340/work/usr/share/julia/stdlib/v1.7/Pkg/src/Operations.jl:484
install_archive##kw at /home/conda/feedstock_root/build_artifacts/julia_1641439672340/work/usr/share/julia/stdlib/v1.7/Pkg/src/Operations.jl:477
jfptr_install_archiveYY.YY.kw_57010.clone_1 at /home/mkitti/anaconda3/envs/julia171_20220107/lib/julia/sys.so (unknown line)
_jl_invoke at /usr/local/src/conda/julia-1.7.1/src/gf.c:2247 [inlined]
jl_apply_generic at /usr/local/src/conda/julia-1.7.1/src/gf.c:2429
macro expansion at /home/conda/feedstock_root/build_artifacts/julia_1641439672340/work/usr/share/julia/stdlib/v1.7/Pkg/src/Operations.jl:698 [inlined]
#45 at ./task.jl:423
jfptr_YY.45_55733.clone_1 at /home/mkitti/anaconda3/envs/julia171_20220107/lib/julia/sys.so (unknown line)
_jl_invoke at /usr/local/src/conda/julia-1.7.1/src/gf.c:2247 [inlined]
jl_apply_generic at /usr/local/src/conda/julia-1.7.1/src/gf.c:2429
jl_apply at /usr/local/src/conda/julia-1.7.1/src/julia.h:1788 [inlined]
start_task at /usr/local/src/conda/julia-1.7.1/src/task.c:877
Allocations: 3924950 (Pool: 3922867; Big: 2083); GC: 5
Segmentation fault (core dumped)
$ conda add libcurl=7.80.0
Collecting package metadata (current_repodata.json): done
Solving environment: failed with initial frozen solve. Retrying with flexible solve.
Solving environment: failed with repodata from current_repodata.json, will retry with next repodata source.
Collecting package metadata (repodata.json): done
Solving environment: done

## Package Plan ##

  environment location: /home/mkitti/anaconda3/envs/julia171_20220107

  added / updated specs:
    - libcurl=7.80.0


The following packages will be DOWNGRADED:

  curl                                    7.81.0-h494985f_0 --> 7.80.0-h494985f_1
  libcurl                                 7.81.0-h494985f_0 --> 7.80.0-h494985f_1


Proceed ([y]/n)? y

Preparing transaction: done
Verifying transaction: done
Executing transaction: done
$ julia
               _
   _       _ _(_)_     |  Documentation: https://docs.julialang.org
  (_)     | (_) (_)    |
   _ _   _| |_  __ _   |  Type "?" for help, "]?" for Pkg help.
  | | | | | | |/ _` |  |
  | | |_| | | | (_| |  |  Version 1.7.1 (2021-12-22)
 _/ |\__'_|_|_|\__'_|  |  https://github.com/conda-forge/julia-feedstock
|__/                   |

(@julia171_20220107) pkg> add CxxWrap
   Resolving package versions...
   Installed libcxxwrap_julia_jll ─ v0.8.8+1
   Installed CxxWrap ────────────── v0.11.2
   Installed Preferences ────────── v1.2.3
  Downloaded artifact: libcxxwrap_julia
    Updating `~/anaconda3/envs/julia171_20220107/share/julia/environments/julia171_20220107/Project.toml`
  [1f15a43c] + CxxWrap v0.11.2
    Updating `~/anaconda3/envs/julia171_20220107/share/julia/environments/julia171_20220107/Manifest.toml`
  [1f15a43c] + CxxWrap v0.11.2
  [692b3bcd] + JLLWrappers v1.3.0
  [1914dd2f] + MacroTools v0.5.9
  [21216c6a] + Preferences v1.2.3
  [3eaa8342] + libcxxwrap_julia_jll v0.8.8+1
  [0dad84c5] + ArgTools
  [56f22d72] + Artifacts
  [2a0f44e3] + Base64
  [ade2ca70] + Dates
  [f43a241f] + Downloads
  [b77e0a4c] + InteractiveUtils
  [b27032c2] + LibCURL
  [76f85450] + LibGit2
  [8f399da3] + Libdl
  [56ddb016] + Logging
  [d6f4376e] + Markdown
  [ca575930] + NetworkOptions
  [44cfe95a] + Pkg
  [de0858da] + Printf
  [3fa0cd96] + REPL
  [9a3f8284] + Random
  [ea8e919c] + SHA
  [9e88b42a] + Serialization
  [6462fe0b] + Sockets
  [fa267f1f] + TOML
  [a4e569a6] + Tar
  [cf7118a7] + UUIDs
  [4ec0a83e] + Unicode
  [deac9b47] + LibCURL_jll
  [29816b5a] + LibSSH2_jll
  [c8ffd9c3] + MbedTLS_jll
  [14a3606d] + MozillaCACerts_jll
  [83775a58] + Zlib_jll
  [8e850ede] + nghttp2_jll
  [3f19e933] + p7zip_jll
Precompiling project...
  8 dependencies successfully precompiled in 12 seconds

(@julia171_20220107) pkg>

Curl 7.79.0 returns Unsupported response code in HTTP response

Trying this with curl 7.79.0 fails:

> curl -k -s -v https://thredds.ucar.edu/thredds/dodsC/grib/NCEP/HRRR/CONUS_2p5km/Best                                                                                                                             ⏎

> User-Agent: curl/7.79.0
> Accept: */*
> 
* TLSv1.3 (IN), TLS handshake, Newsession Ticket (4):
* TLSv1.3 (IN), TLS handshake, Newsession Ticket (4):
* old SSL session ID is stale, removing
* Unsupported response code in HTTP response
* Closing connection 0
* TLSv1.3 (OUT), TLS alert, close notify (256):

but passes with older versions of curl:

> User-Agent: curl/7.78.0
> Accept: */*
> 
* TLSv1.3 (IN), TLS handshake, Newsession Ticket (4):
* TLSv1.3 (IN), TLS handshake, Newsession Ticket (4):
* old SSL session ID is stale, removing
* Mark bundle as not supporting multiuse
< HTTP/1.1 400 400
< Date: Wed, 22 Sep 2021 15:20:14 GMT
< Server: Apache
< X-Frame-Options: SAMEORIGIN
< X-Content-Type-Options: nosniff
< Strict-Transport-Security: max-age=63072000; includeSubdomains;
< Access-Control-Allow-Origin: *
< Content-Description: dods-error
< X-XSS-Protection: 1; mode=block
< Content-Security-Policy: form-action 'self'; frame-ancestors 'self'; script-src 'self' 'unsafe-inline' 'unsafe-eval'
< Connection: close
< Transfer-Encoding: chunked
< Content-Type: text/plain
< 
Error {
    code = 400;
    message = "Unrecognized request";
};
* Closing connection 0
* TLSv1.3 (IN), TLS alert, close notify (256):
* TLSv1.3 (OUT), TLS alert, close notify (256):

The 400 code is expected. Not sure if that is a problem that will be fixed by #96. Investigating...

libcurl can crash when called from non-main thread

libcurl uses SIGALRM by default for realizing timeouts. This causes crashes when certain functions are called from a non-main thread as described here.

This can be solved by configuring with --enable-threaded-resolver or --enable-ares.

ClobberWarning: This transaction has incompatible packages due to a shared path

I got a warning on windows, supposedly curl and libcurl have a conflict:

ClobberWarning: This transaction has incompatible packages due to a shared path.
2020-08-05T12:08:13.0883381Z   packages: conda-forge/win-64::libcurl-7.71.1-h4b64cdc_4, conda-forge/win-64::curl-7.71.1-h4b64cdc_4
2020-08-05T12:08:13.0884015Z   path: 'library/bin/curl.exe'

However the files section of libcurl seems correct and does not list the .exe

High prio curl release on Oct. 11

Judging from the description, this one's a doozy, but at least there's no API/ABI change involved.

Basically just hit the button ASAP once the bot comes around.

CC @conda-forge/curl

Unicode --data not working

Solution to issue cannot be found in the documentation.

I checked the documentation.

Issue

Originally reported by @squromiv in curl/curl#12231:

Unicode --data doesn't work:

curl -v --data спасти http://httpbin.org/post

the server is sent invalid data and replies with fffd (unknown) (��)

\ufffd\ufffd\ufffd\ufffd\ufffd\ufffd

what curl should do is send the unicode --data and then the server will reply with the same characters:

\u0441\u043f\u0430\u0441\u0442\u0438

The reporter is using "C:\ProgramData\Anaconda3\Library\bin\curl.exe" 8.1.1 with "Unicode" in the features list.

I was able to reproduce with the curl.exe from curl-8.1.1-h68f0423_0 (and dependencies libcurl-8.1.1-h68f0423_0, libssh2-1.10.0-h680486a_3, openssl-1.1.1w-hcfcfb64_0, libzlib-1.2.13-hcfcfb64_5).

This is either a bug in curl or in your build process, I don't know which. In bld.bat ENABLE_UNICODE=yes which is the correct way to enable Unicode. I can see there are multiple build methods. It would be helpful to know exactly how the distributed version of curl.exe is built.

Installed packages

n/a not installed

Environment info

n/a not installed

HTTP/2 support

Could this be built against nghttp2? See https://curl.haxx.se/docs/http2.html

This would then enable HTTP2 support in downstream libraries like e.g. gdal.

undefined symbol: libssh2_scp_recv2

Error when trying to load libhdfs3 (conda-forge/hdfs3-feedstock#4 (comment)):

>>> ctypes.cdll.LoadLibrary('libhdfs3.so')
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/home/jlord/.conda/envs/dask/lib/python3.6/ctypes/__init__.py", line 426, in LoadLibrary
    return self._dlltype(name)
  File "/home/jlord/.conda/envs/dask/lib/python3.6/ctypes/__init__.py", line 348, in __init__
    self._handle = _dlopen(self._name, mode)
OSError: /home/jlord/.conda/envs/dask/lib/python3.6/lib-dynload/../.././libcurl.so.4: undefined symbol: libssh2_scp_recv2

Downgrading from 7.54.1 to 7.49.1 resolves the issue for me.

curl 7.71.1 _3 broken on osx

If I install the _3 build:

>conda install --offline curl=7.71.1=hbdca1c0_3
Collecting package metadata (current_repodata.json): done
Solving environment: done

## Package Plan ##

  environment location: /Users/rmay/miniconda3

  added / updated specs:
    - curl==7.71.1=hbdca1c0_3


The following packages will be UPDATED:

  curl                                    7.71.1-hbdca1c0_2 --> 7.71.1-hbdca1c0_3
  libcurl                                 7.71.1-he6690cf_2 --> 7.71.1-he6690cf_3


Proceed ([y]/n)? y

Preparing transaction: done
Verifying transaction: done
Executing transaction: done

I get a completely broken curl on osx:

>curl
dyld: Library not loaded: @rpath/libssh2.1.dylib
  Referenced from: /Users/rmay/miniconda3/lib/libcurl.4.dylib
  Reason: image not found
[1]    20759 abort      curl

tests with ssl cert

Hello

I'm trying to use this recipe and build it locally, as part of an investigation

I'm getting errors, I believe related to the configure options:
https://github.com/conda-forge/curl-feedstock/blob/master/recipe/build.sh#L13

in particular, the tests are looking for a CAfile in a location where it does not exist on my host
I have /etc/ssl/cacert.pem but not an ssl/cacert.pem` within the build or _test areas

I am not sure if I am missing something, but I hoped I could establish that I could build this recipe locally. Clearly this has built and is available, so I should be able to rebuild it

all advice gratefully received

marqh

$ tar xvf curl-7.71.1-h4b64cdc_6.tar.bz2 
info/paths.json
info/hash_input.json
info/index.json
info/about.json
info/files
info/git
info/recipe/parent/build.sh
info/test/run_test.bat
info/recipe/parent/install_static.bat
info/recipe/parent/install_dll.bat
info/recipe/parent/bld.bat
info/licenses/COPYING
info/recipe/conda_build_config.yaml
info/recipe/meta.yaml
info/recipe/parent/meta.yaml

and there is no Library/bin/curl.exe

I did the same for the previous build:
https://anaconda.org/conda-forge/curl/7.71.1/download/win-64/curl-7.71.1-h4b64cdc_5.tar.bz2
and Library/bin/curl.exe is there, as expected.

$ tar xvf curl-7.71.1-h4b64cdc_5.tar.bz2 
info/files
info/hash_input.json
info/paths.json
info/index.json
info/about.json
info/git
info/test/run_test.bat
info/recipe/parent/install_dll.bat
info/recipe/parent/install_static.bat
info/recipe/parent/bld.bat
info/licenses/COPYING
info/recipe/conda_build_config.yaml
info/recipe/meta.yaml
info/recipe/parent/meta.yaml
info/recipe/parent/build.sh
Library/bin/curl.exe

It looks very likely that #81 has inadvertently removed curl.exe from curl, too!

conda-forge / curl-feedstock Goto Github PK

curl-feedstock's Issues

Solution to issue cannot be found in the documentation.

Issue

Installed packages

Environment info

Recommend Projects

Recommend Topics

Recommend Org