Evaluating a point-based method about trackeval HOT 3 CLOSED

Hey! Thanks for the question!

We are actually in the process of supporting official benchmarks that use this kind of evaluation (in progress, can't guarantee when it will be done).

However, I have already had some people ask me about something similar so I have already implemented the Euclidian similarity function, you can find it here:

You're correct that's it's easy to adapt some current dataset to use it (but not currently dataset currently uses it). I will walk you through an example of how to do this now. You only need to change a few lines I think.

E.g. let's change the mot_challenge_2d_box to the way you want it.
First change this line:

Second let's change this line:

Finally you should change the lines:
here:

And I think that should be all.

Let me know if that works for you?

Note that you could get away with not doing the last 3 edits if you just made sure that in your files the other values of the bbox were always 0 (but safer to make these edits, then accidently putting different values won't screw up the evaluation.

Jono

(won't close until you let me know if it works)

from trackeval.

Hi Jonathan,

Thank you so much for the thorough answer, this seems to work well ! I just had to disable preprocessing otherwise I get that error:

"trackeval.utils.TrackEvalException: Attempting to evaluate using invalid gt classes. This warning only triggers if preprocessing is performed, e.g. not for MOT15 or where prepropressing is explicitly disabled. Please either check your gt data, or disable preprocessing. The following invalid classes were found in timestep 0: -1"

I think this makes sense because I have been formatting my gt and trackers files/folders exactly as for MOT15.

Thank again !

Mathis

from trackeval.

Perfect! Glad to help. Closing this now!

from trackeval.