5l1v3r1 / compositional-attention-pytorch Goto Github PK
View Code? Open in Web Editor NEWThis project forked from lucidrains/compositional-attention-pytorch
Implementation of "compositional attention" from MILA, a multi-head attention variant that is reframed as a two-step attention process with disentangled search and retrieval head aggregation, in Pytorch
License: MIT License