atmahou / fewshotjoint Goto Github PK

Hi, i have two questions about this paper.

1. The baseline LD-proto uses logits-dependency tricks to enhance the performance. What is logits-dependency tricks? I only find slot-gate in Goo et al., 2018.
2. I notice there is difference between FewJoint 1.0 and FewJoint 1.1. Does this mean that FewJoint 1.1 is more suitable for the benchmark dataset?

作者您好，我发现您提供的数据集包含了FewJoint1.0和FewJoint1.1两个数据集，想询问一下两者的区别

Hi ,

I was running the snips_JointProto_5.sh but I am getting the error below:

I have noticed that in the class FewShotSupportFeature() in lines 144, and 145 the test_input and test feature_item are used. but I have changed it but it didn't work. I also have compared the preprocessor.py here and the one in https://github.com/laiyongkui1997/FewJoint/blob/master/utils/preprocessor.py (which I ran previously and was working fine), but there were some additional functions for maml which I don't need it right now and also test_input and test feature item. Do you know how can I solve this problem?

the code on the left is yours and the one on the right is for @laiyongkui1997

-there is also another request, I couldn't find the tools for generating the few-shot dataset, there was only one sample in data. As it has a different setup from the tools mentioned in https://github.com/AtmaHou/MetaDialog#few-shot-data-construction-tool , I would be more than happy if you can provide it then I can create it.

thank you in advance for all your help and understanding.

Hi, yutai. I'm very sorry to interrupt again.

I reproduced your code on the SNIPS dataset under 5-shot setting (snips_ConProm+TR_5.sh). But the result looks like ConProm+TR instead of ConProm+FT+TR. The three results are:

1. test:{'slot': 0.6433199999999999, 'slot_p': 62.451, 'slot_r': 66.438, 'intent': 0.986999999026, 'sentence_acc': 0.396}
2. test:{'slot': 0.6876900000000001, 'slot_p': 65.84100000000001, 'slot_r': 72.00200000000001, 'intent': 0.9889999990220002, 'sentence_acc': 0.468}
3. test:{'slot': 0.6587799999999999, 'slot_p': 60.845000000000006, 'slot_r': 71.896, 'intent': 0.9909999990180001, 'sentence_acc': 0.395}
   Does this script file not contain FT step?

Thanks.