question: relevance scores in Qrels about ranx HOT 2 CLOSED

Hi, if you only have a list of relevant document ids but no relevance judgment, you should use 1 as relevance judgment score.

0 relevance judgment scores are removed before computing metric scores to prevent miscomputations.

Among the implemented metrics only NDCG uses the relevance judgment scores. You can see it here.

By definition, all the other metrics consider relevance judgment scores to be binary even if they are not.

from ranx.

Got it, thanks !

from ranx.