understanding synergy asymmetry about facet HOT 3 CLOSED

Hi Francesco,

thanks for your note! We are working on a paper to explain the math - I will have to ask for your patience and we'll make it available here on GitHub once we are done; we are also working on some simplifications to the calculation approach so hopefully the explainer code in FACET 1.1 will be a bit easier to follow.

Good questions on synergy! As an intuition of asymmetry, consider that a feature A might hold more information that is also represented by B than the other way round. Then A has more to contribute to B, than vice-versa. So an asymmetry in the matrix reflects an asymmetry in how relevant information is distributed across a pair of features.

From a practical perspective, redundancy may well serve as a means of feature reduction, however one main use is to ensure that a feature is independent before using it in a simulation / partial dependence plot. This is to prevent simulations of impossible scenarios: redundancy between two features tells us that the value of one features imposes constraints on the value of another feature.

Synergy can be ignored in that context, but can give you insights into where interactions take place among features if you are looking for new hypotheses to explain a certain effect, for example.

So in that sense, redundancy is a backward-looking view of dependencies (between values of the input features), whereas synergy is a forward-looking view into impact on predictions.

Hope that makes sense!

from facet.

Hi Jan,

Would it be possible to give a high-level idea on how SHAP values are used to calculate synergy and redundancy, or code pointers on where the main logic of it is?

Thanks,
Ali

from facet.

@Francesco-Marini @alielabridi sorry for the delay! We have now published a preprint on Arxiv that explains the formal aspects of the synergy/redundancy/independence approach. Happy to hear your comments!

from facet.