camelop / nlp-robustness Goto Github PK

Hi can you mention the version of allennlp and other modules you have used in a requirments.txt. It seems allennlp has changed a lot and the commands mentioned in the readme does not work.
For example while running the command

allennlp train config/test/sst-lstm.json -s model/test-lstm[sst-2] --include-package allennlp_glue_patch

I encountered the following error.

"No module named allennlp.run"

Hello,
thanks for publishing the code used in your interesting paper!
I am wondering if this repo also contains the code for the OOD Detection part, i.e. for recording the confidence scores on the SST-2 dataset and on the 5 validation datasets. I am curious how you calculated the FPR95 and anomaly. Going through all files I cannot find the related code. Do I miss it or is it not added?
Thank you very much for your time, @tpatzelt

While I try to use the bert or roberta config using allennlp I get the following error

"json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)"

I was wondering which version of allennlp do you recommend for the code or is there some specific resolution you know regarding this issue.