[BUG] - Getting started notebook fails as `plot_attributions` can't hande 3-dim explanations about xplique HOT 4 CLOSED

I had the same problem

from xplique.

I found a strange phenomenon. For the same model, the same training sample and test sample, other operations are identical. Theoretically, the values obtained by using the XAI method (like Saliency) to evaluate the interpretability of the model should be the same. However, I retrained a new model, and the interpretability values obtained are completely different from those obtained from the previous model. Does anyone know why this happens? The interpretability value is completely unstable, and the results cannot be reproduced. Unless I completely save this model after training it, and then reload this parameter, the results will be the same.

I have tested two types of prediction tasks: regression and classification. Secondly, I tested 1D-CNN, LSTM, 2D-CNN and other models, and found such problems. For example, I used the for loop to train 10 models under the same conditions. Then, The following command are used for 10 models： explainer = XAI(model) explanations = explainer(X_test, y_test) . The final explanations results will show that the interpretation results for each model are different.

from xplique.

Now my understanding is that even though the prediction accuracy of models trained in the same sample and under the same conditions is almost the same, the difference in the weight parameters (such as neural network) of their own models leads to this result. I don't know if my understanding is correct.

from xplique.

Hi @semihcanturk and @9527-ly ! :)
thank you very much for opening this issue. I proposed a PR (#117) and the new version of Xplique should be available in the day (France). Don't hesitate if you have other problems I'm still available (here is my email in case it's urgent: [email protected])

from xplique.