Question about obtaining the benchmark result about logdeep HOT 5 CLOSED

And forgot to ask, could you breifly explain what is the num_candidates parameter for in the prediction?

Thank you!!!!

from logdeep.

It depend on your parsing tool, my benchmark result is depend on "the ground truth" number of the template(28) in dataset"
num_candidates means the label in top num_candidates is labeled as normal log.
(you need to read the deeplog paper to get a better understanding of num_candidates...)

1. try to finetune num_candidates to get a better F1 score.
2. try to modify your parsing code to get a result close to the Ground truth(28 templates)

from logdeep.

Thank you so much for the suggestions! That's really helpful!

One follow up question I have is that, this may sounds a naive question, but do we always know the ground truth number of the log? And when we are using the parsing tool, we want to have the result/template as close as possible to the ground truth number we know by modifying the parsing code?

from logdeep.

In industrial applications, the constantly updated log has no definite ground truth templates, you need to continuously optimize the model based on performance indicators :)

from logdeep.

Got it! Thank you! I don't have further question for now! :))

from logdeep.