Issue of pygod-team#83
Describe the bug
The results on inj_cora (AUC: 0.7566±0.0332 (0.7751)) and inj_amazon (AUC: 0.7147±0.0006 (0.7152)) are significantly different from what you show in Table 3 from the BOND paper (https://arxiv.org/pdf/2206.10071.pdf), which are 82.7±5.6 (84.3) on inj_cora and 81.3±1.0 (82.2) for inj_amazon.
Inconsistency Result of BOND paper, Table 3 (on inj_cora and inj_amazon datasets)
To Reproduce
Steps to reproduce the behavior:
May be error found in pygod v1.0.0
Expected behavior
AUC result must be alike Table 3 of the BOND paper (https://arxiv.org/pdf/2206.10071.pdf)
By downgrading to the original version used by the benchmark v0.3.1 via pip install pygod=0.3.1, the expected results can be regenerated.
Screenshots
If applicable, add screenshots to help explain your problem.
Desktop (please complete the following information):
- OS: [e.g. iOS]
- Browser [e.g. chrome, safari]
- Version [e.g. 22]
To Do
According to @kayzliu, the following things need to do.