Inconsistent score for the browser device depending on the presence of containers about greenframe-cli HOT 3 OPEN

This seems to be a reproducibility issue. If you run the same test several times, does it output consistent results?

My interpretation is that given the low emissions you're getting, your scenario is very short and therefore very subject to variations in the host. You will get better results with a longer scenario, and a higher number of samples.

See https://docs.greenframe.io/commands#improving-the-analysis-precision for more details.

from greenframe-cli.

Thank you for your response.

If you run the same test several times, does it output consistent results?

Yes it does. I also tried increasing the number of samples but the results are always very similar (less than 10% of variations).

from greenframe-cli.

One explanation I can think of is that your server uses multithreading to optimize the workload when there are many containers. Therefore, the payload of a single container takes less time when run in conjunction with other payloads. This is concerning, as Docker promises process isolation, and we use docker stats to track individual processes.

If that's the case, this means you can't add or subtract energy consumption between greenframe analyses with different containers.

from greenframe-cli.