rat model weights about dannce HOT 12 CLOSED

Hi @enajx . I've put links to these weights in #62 (comment).

from dannce.

from dannce.

I followed the Quickstart Demo and the pred variable in the generated file predict_resuts/save_data_AVG0.mat has dimensions 1000x3x22. Also, when I use the script run_dannce_predict.sh to generate the predictions.mat file from save_data_AVG0.mat, it contains a structure with 22 landmarks, not 20.

from dannce.

from dannce.

I see, that explains it.

We're trying to test it with our own rat data (3 synced cameras videos), which model exactly would be the appropriate for this? The weights names weights.12000-0.00014.hdf5, weights.1200-12.77642.hdf5 are a bit cryptic and I couldn't find anywhere a description of what they correspond to.

Could you also point me to the rat skeleton file? I could also only find the mouse one.

Thank you for the help Timothy, it's really appreciated.

from dannce.

Hi Tim,

Can we use the rat weights to train a network with less than 20 labels?

Thanks

from dannce.

@morbent Yes, you can! The rat pup data in the paper is an example of this.

from dannce.

Thanks Diego,

When we tried to use it to fine-tune a 5 labels animal it gives an error (similar to the one posted in issue 50)

from dannce.

@enajx

Could you also point me to the rat skeleton file? I could also only find the mouse one.

Label3D has a few skeleton files in Label3D/skeletons

We're trying to test it with our own rat data (3 synced cameras videos), which model exactly would be the appropriate for this?

A general rule is that you want the model you're finetuning to have been trained on the same number of cameras and color channels. Even though you can come up with many workarounds to use models with data of different input shapes, we find that keeping the number of cameras and color channels the same gives the best results. The models currently in the repo include 6 cam RGB (AVG and MAX) and 6 cam MONO (AVG). You'll want a 3 camera RGB or 3 camera MONO model trained on rat7m depending on whether your data is RGB or mono. I have some 3 cam RGB models trained on rat7M that we used to finetune the rat pup data. I could send you them if your data is rgb, otherwise you'll need to wait for Tim for the mono versions.

@spoonsso I suspect this and potentially other issues ( #50 #54 ) could be addressed by adding the collection of rat7M-trained dannce and com models to the rat7m figshare, if they are not already there.

from dannce.

@diegoaldarondo

We are working with 3 RGB cameras, so if you could share the 3 cam model trained on rat7m that would be fantastic!

Thank you for pointing at the skeleton files, I'll check them out.

from dannce.

@morbent for the shape errors you are experiencing, please see my recent comment in #50.

from dannce.

@spoonsso @diegoaldarondo

Could you please share the link to the 3 cam RGB model trained on rat7M you mentioned?

from dannce.