Git Product home page Git Product logo

hibpool's Introduction

Structure-Aware Hierarchical Graph Pooling using Information Bottleneck

Authors

This is a pytorch implementation of our paper "Structure-Aware Hierarchical Graph Pooling using Information Bottleneck" which has been accepted by IJCNN 2021. Check the video presentation of our paper here.

Abstract

Graph pooling is an essential ingredient of Graph Neural Networks (GNNs) in graph classification and regression tasks. For these tasks, different pooling strategies have been proposed to generate a graph-level representation by downsampling and summarizing nodes' features in a graph. However, most existing pooling methods are unable to capture distinguishable structural information effectively. Besides, they are prone to adversarial attacks. In this work, we propose a novel pooling method named as HIBPool where we leverage the Information Bottleneck IB principle that optimally balances the expressiveness and robustness of a model to learn representations of input data. Furthermore, we introduce a novel structure-aware Discriminative Pooling Readout (DiP-Readout) function to capture the informative local subgraph structures in the graph. Finally, our experimental results show that our model significantly outperforms other state-of-art methods on several graph classification benchmarks and more resilient to feature-perturbation attack than existing pooling methods.

HIBPool

HIBPool

To determine different substructures present in graph data, the input graph is partitioned into communities where intra-community nodes are represented with same color and they are densely connected than inter-community nodes. After aggregating features from neighborhood using Messaging Passing Network (MPN) we apply structure-aware DiP-Readout to obtain distinguishable representations of communities with different substructures while the pooled graph of next layer is created with the edges connecting different communities. Summary representation is obtained by a readout function after the final layer. Optimizing with IB principal ensure minimal redundancy from graph data with sufficient information to predict the class labels.

Baseline Comparison

Baseline Comparison

Table : Comparison with Baselines: ’-’ denotes that results are not publicly available.

Cite

If you find our paper or repo useful then please cite our paper:

@article{roy2021structure,
  title={Structure-Aware Hierarchical Graph Pooling using Information Bottleneck},
  author={Roy, Kashob Kumar and Roy, Amit and Rahman, AKM and Amin, M Ashraful and Ali, Amin Ahsan},
  journal={arXiv preprint arXiv:2104.13012},
  year={2021}
}

hibpool's People

Contributors

kkroy2 avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar

hibpool's Issues

Question about GIB in notebook

Hi,

In the notebook, I am supposed to import GIB to use some functions. So, where could I obtain the GIB.py?
image

Thanks very much!

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.