Weighted adjacency graphs about gat HOT 2 CLOSED

Hi Joakim,

Thank you for your issue.
The easiest/most intuitive way to include the weights inside an attentional model is to feed the weights as an additional input to the attention mechanism. One easy way of doing so is adding or multiplying (potentially affine-transformed) weights to the attention coefficients prior to applying softmax.

Hope that helps!

Thanks,
Petar

from gat.

Thank you for the quick response Petar!

It makes sense, so basically just multiply e_ij with a_ij, where a_ij is the weight of the edge from node j to node i (in my case in the range [0, 1]),
I like the idea of simply multiplying the raw edge weight as it represents an a priori scaling of the connection and generalizes to the standard GAT when a_ij = 1, whereas addition does not have an as nice interpretation.

• Joakim

from gat.