[bug] Large conan package gets downloaded to a wrong subfolder in windows about conan HOT 5 CLOSED

Hi @randomcontainers

Thanks for your report.

A couple of quick questions:

• How large is really the package? 10mb is nothing, those are very common packages in Conan, shouldn't be a problem. We have seen in the past some issues under some special infra (google cdn) for packages >1 Gb
• What happens if you try to download that package in a Linux machine, does it works well?
• One possible issue is that such package has some special files in it, like symlinks, not supported in Windows, and then it might indeed fail under windows. Can you try downloading the conan_package.tgz from the server manually and unzipping it with other tools?

from conan.

Hi,
thanks for your quick response!

How large is really the package? 10mb is nothing, those are very common packages in Conan, shouldn't be a problem. We have seen in the past some issues under some special infra (google cdn) for packages >1 Gb

The package is 11mb in size. I called it a large file because of this line: (big_file)

What happens if you try to download that package in a Linux machine, does it works well?

Yes, on a Linux machine it works without an issue. The difference is that on Linux, after using conan download two new directories are created in the .conan/p directory: linux3b28e86b22ffd and linux7f4334d1b9228. In Windows only linux3b28e86b22ffd is created but it still expects linux7f4334d1b9228 which causes the error.
Also the contents of the linux7f4334d1b9228 directory are different, it contains the actual package whereas linux3b28e86b22ffd contains a debian package.

One possible issue is that such package has some special files in it, like symlinks, not supported in Windows, and then it might indeed fail under windows. Can you try downloading the conan_package.tgz from the server manually and unzipping it with other tools?

This might actually be the issue. When I unzip the package in windows, I get indeed errors on which I can skip or cancel the unzipping.
Does conan cancel the unzip operation in this case?

from conan.

Yes, on a Linux machine it works without an issue. The difference is that on Linux, after using conan download two new directories are created in the .conan/p directory: linux3b28e86b22ffd and linux7f4334d1b9228. In Windows only linux3b28e86b22ffd is created but it still expects linux7f4334d1b9228 which causes the error.

Yes, this is expected, there are 2 folders involved:

• One folder containing the "recipe" part (subfolders e=export, containing the recipe, es=export_sources containing exported sources, etc)
• Another folder (one per different package binary with different package_id) containing the actual artifacts, (subfolder b=build if built from source locally, subfolder p=package with the artifacts), like include headers and compiled static or shared libraries. This folder is also obtained by unzipping the conan_package.tgz

If the unzipping of conan_package.tgz fails, Conan will try to remove the second folder, to not leave a trailing package in a bad state. This is the reason why if it fails you will only see the first folder but not the second one.

from conan.

Thank you for the explanation!

from conan.

Thanks to you for the feedback!

I have been thinking about this, just in case it would be possible some workaround, but it doesn't seem possible to do anything from Conan side.

Maybe it might be possible to enable symlinks (developer mode) in Windows?

from conan.