Allow config file overrides in `evaluate` about allennlp HOT 6 CLOSED

@matt-gardner what do you mean exactly by evaluate? allennlp/run evaluate or a particular method? Why do you need the ability to override here?

from allennlp.

Yeah, I meant the command. See #246 for the original motivation for this. Not really sure how necessary this is anymore... (The whole _sanitize_config() method can probably be removed at this point, actually.) I haven't recently run into a situation where I really wished I had this. I know @OyvindTafjord ran into it a lot more frequently, though.

from allennlp.

My WIP change #402 support overriding fields, but does not support removing fields.

from allennlp.

But that parameter was removed a long time ago, so that particular use case is no longer present. You could also override it with None to effectively remove it (which means you should probably do something like our replace_none method in your override code).

from allennlp.

The original motivation for this issue is moot.

from allennlp.

I just talked with Oyvind, and he brought up a few cases where being able to change test-time configuration is helpful, and is currently a huge pain.

• Changing the batch size, because, e.g., the test data has some really long sentences
• Trying hacks with padding, like what Oyvind did to the character CNN in BiDAF

These cases are pretty rare, though. We may want to open this issue again at some point in the future, but for now there's not enough motivation for it.

from allennlp.