Some tests fail ocassionally about iotagent-node-lib HOT 3 CLOSED

It fails about 9% of executions, at least on Mongo 2.4.8, 2.4.12 and 2.6.10.

Alternative Output found just in 2.4.12:

NOTE: ACTUAL 2, EXPECTED -1

1. Device provisioning API: List provisioned devices When a request for listing all the devices with a offset of 3 arrives should skip the first 3 devices:

  actual expected

  -12

from iotagent-node-lib.

We are going to execute all the tests 10 times in the versions with detected errors.

Test runs:

• 2.4.14
• 2.6.5
• 2.6.11
• 3.0.6 (latest)

from iotagent-node-lib.

It was not a problem with MongoDB, really. The problem was in how the test created the devices:

                async.times(10, createDeviceRequest, function(error, results) {
                    done();
                });

The test works on the hypothesis that all the devices are created sequentially. But times is not guaranteed to be sequential; it just happens to be in most cases, if the computer is fast enough or has a very low load. The function timeSeries on the other hand, provides the serialized times function expected by the test.

from iotagent-node-lib.