I have successfully run the training code but unable to eval about embedkgqa HOT 11 CLOSED

Can you share what command you ran, and a screenshot of whatever you saw when you ran the command?

from embedkgqa.

I ran the following code successfully
python3 main.py --mode train --relation_dim 200 --hidden_dim 256 \ --gpu 3 --freeze 0 --batch_size 128 --validate_every 5 --hops 2 --lr 0.0005 --entdrop 0.1 --reldrop 0.2 --scoredrop 0.2 \ --decay 1.0 --model ComplEx --patience 5 --ls 0.0 --kg_type full
But when I wanna get the test score and ran the following code:
python3 main.py --mode eval --relation_dim 200 --hidden_dim 256 \ --gpu 3 --freeze 0 --batch_size 128 --validate_every 5 --hops 2 --lr 0.0005 --entdrop 0.1 --reldrop 0.2 --scoredrop 0.2 \ --decay 1.0 --model ComplEx --patience 5 --ls 0.0 --kg_type full
It didin't work, and the error message was as follows:
Traceback (most recent call last): File "main.py", line 361, in <module> embedding_dim=args.embedding_dim) TypeError: eval() takes no keyword arguments
which I think is because there's no eval function in main.py, is there?

from embedkgqa.

Yes, eval function isn't there, but eval happens when running the train command. What output did you get when you ran the train command?

from embedkgqa.

Model has exceed patience. Saving best model and exiting.
And there isn't any score message

from embedkgqa.

There IS validation accuracy, but no test accuracy

from embedkgqa.

Please see issue #14. Whenever validation accuracy increases it finds and prints the test accuracy. If this still doesn't work, please let me know.

from embedkgqa.

Thank you for your reply, I've understood. When I train on KG-50, it can be shown normally. When I train on KG-Full, the best test score appears at the first epoch, therefore no test score is shown. For convenience, will you give the eval function and online QA code in the future?

from embedkgqa.

Yes, I'll create a new issue about having separate eval function. What do you mean by online QA code?

from embedkgqa.

It means when inputing a question, output an answer, which realizes a question answering process.

from embedkgqa.

Got it. Can you please create a new issue with relevant title for this? I will close this one. It will be easier to resolve that way. Thanks.

from embedkgqa.

All right

from embedkgqa.