preprocess_sharc.py: func filter_answer() and get_bullets() may not work as expected about e3 HOT 7 CLOSED

-    indices = [i for i, c in enumerate(context) if c == '*']
+    indices = [i for i, c in enumerate(context) if c['sub'] == '*']
     pairs = list(zip(indices, indices[1:] + [len(context)]))
     cleaned = []
     for s, e in pairs:
-        while not context[e-1].strip():
+        while not context[e-1]['sub'].strip():
             e -= 1
-        while not context[s].strip() or context[s] == '*':
+        while not context[s]['sub'].strip() or context[s]['sub'] == '*':
             s += 1
         if e - s > 2 and e - 2 < 45:
             cleaned.append((s, e-1))

Best dev
{'dev_bleu_1': 0.5175,
 'dev_bleu_2': 0.4804,
 'dev_bleu_3': 0.4532,
 'dev_bleu_4': 0.4288,
 'dev_combined': 0.31851264,
 'dev_macro_accuracy': 0.7428,
 'dev_micro_accuracy': 0.6881,
 'dev_span_f1': 0.7758598345984843,
 'epoch': 3,
 'train_bleu_1': 0.5795,
 'train_bleu_2': 0.548,
 'train_bleu_3': 0.5282,
 'train_bleu_4': 0.5141,
 'train_combined': 0.44541623999999996,
 'train_loss_clf': 0.40613971317808967,
 'train_loss_retrieve': 0.2112928715934799,
 'train_loss_span_end': 0.011150807250163897,
 'train_loss_span_start': 0.017885973322182485,
 'train_macro_accuracy': 0.8664,
 'train_micro_accuracy': 0.834,
 'train_span_f1': 1.0}

Best dev
{'dev_f1': 0.7611304248405354,
 'epoch': 11,
 'train_f1': 0.8762811226505095,
 'train_loss_after': 0.4524998854104321,
 'train_loss_before': 0.640820378238715}

{'bleu_1': 0.6645,
 'bleu_2': 0.6045,
 'bleu_3': 0.566,
 'bleu_4': 0.5395,
 'combined': 0.3957772,
 'macro_accuracy': 0.7336,
 'micro_accuracy': 0.6802}

{'bleu_1': 0.667,
 'bleu_2': 0.6041,
 'bleu_3': 0.5635,
 'bleu_4': 0.5362,
 'combined': 0.39335632000000004,
 'macro_accuracy': 0.7336,
 'micro_accuracy': 0.6802}