Tests are skipped with pytest-xdist about pytest-dependency HOT 7 CLOSED

I documented the incompatibility with the parallelization in pytest-xdist and closed this issue. However, this is not the full story: pytest-xdist 1.19 added distributing mode loadscope and 1.21 added loadfile. Both distributing modes are compatible with pytest-dependency under certain conditions. But these distributing modes are marked experimental in pytest-xdist. I will wait for them to become stable before documenting this option.

from pytest-dependency.

I never used pytest-xdist by now. I need to investigate. Might take some time.

from pytest-dependency.

I still didn't got a round to investigate this in detail. But after having a short glance on the pytest-xdist documentation, I assume the problem is the following: pytest-xdist features to run the tests in parallel. It seem to do this in parallel processes, each running its own pytest instance. As a result, the dependent test is skipped because its dependency has not been run (in the same parallel instance of pytest). I'm afraid, this is fundamentally incompatible with pytest-dependency, because such a parallelization can only work if the tests are independent from each other. But the very purpose of pytest-dependency is to handle the case that they are not.

If this assumption turn out to be true, the only thing pytest-dependency can do about this problem, is to disable the parallelization in pytest-xdist. I would still need to figure out how to do this.

from pytest-dependency.

I finally got around to take a closer look. My first assumption from the last comment turns out to be right, the problem is the parallelization in pytest-xdist. This can only work if the test are independent from each other.

There is not much that pytest-dependency can do about this. I will refrain from trying to disable the parallelization in pytest-xdist, as I think plugins should not interfere with each other. The only thing I can do is to document this incompatibility.

from pytest-dependency.

@RKrahl Any workaround for above issue?

from pytest-dependency.

I've tried using --dist=loadfile but then xdist complains and says:

ERROR: MISSING test execution (tx) nodes: please specify --tx

And with --dist=no it doesn't work. The dependencies are being skipped.

from pytest-dependency.

@RKrahl Can we perhaps piggyback off of --dist loadgroup? If we make every connected test belong to their own group, that seems to compatibilize the interaction between the two packages, no?

from pytest-dependency.