How to output aleatoric and epistemic uncertainties associated to the class about al-mdn HOT 7 CLOSED

What I do understand, please correct me if I'm wrong.

You can take these values from here layers/functions/detection_gmm.py:

For example, in the demo.py file... When you test some image you can use the while loop to obtain the uncertainty for each bbox, something like this:

max_loc_al_uc = torch.max(detections[0][i][j][5:9]) # 4 values (four coordinates values)
max_loc_ep_uc = torch.max(detections[0][i][j][9:13]) # 4 values (four coordinates values)
cl_al_uc = torch.max(detections[0][i][j][13:14]) # 1 value
cl_ep_uc = torch.max(detections[0][i][j][14:15]) # 1 value

from al-mdn.

For the localization, the 4 values are the uncertainty about the center, height, and weight {x, y, w, h}. On pg. 4 of the paper in section 3.3 Scoring Function: "[...] For localization, $u^{ij}$ is the maximum value over the 4 bounding box outputs. [...]"

And in the function you cited, you want to take the labeled_set because they have high score values, labeling them and continue the active learning loop.

from al-mdn.

Thank you @BrenoAV very much for your answer indeed the same thing that I understood but I have a small concern concerning the four values ​​for the random and epistimological localisation why it sends 4 values ​​instead of a single value as the case of the classification. and for the function can we use it if we want to select a set of images to label ?

from al-mdn.

thank you once again @BrenoAV for your help and support now things seem understandable.

from al-mdn.

Hello @BrenoAV
As you can see this line, output contains scores, box coordinates, aleatoric & epistemic uncertainties of each task.
You can print out each uncertainty value using detections variable, like scores and box coordinates.
To output normalized values, you need to know the mean and variance of each uncertainty distribution for the dataset.
For doing this, you can use this function.

from al-mdn.

It makes sense now for me, thank you very much @jwchoi384

from al-mdn.

hello please if you have a concrete example how to recover them for each image?
@jwchoi384 @BrenoAV

from al-mdn.