Multi-Targets for the ANN-Regression Model about orange3 HOT 2 OPEN

As you have probably seen, the Domain and Table classes allow for multiple targets, but most widgets can't handle them. For this reason, even if the user constructs such data, e.g. in Select Columns, Orange shows a warning that this data won't be very useful.

The object that is output by Test and Score, Orange.evaluation.Results has a 1d array for predictions (actually 2d, because these are predictions of all models that are being tested) and a 2d array for probabilities (that is, 3d, for all models). Supporting multiple targets would require adding another dimension, which would break all downstream widgets.

But the question is - what would you do with this? Even Test and Score would probably only show scores (ca, auc, prec, recall, ...) for a single output at a time. If you then want to analyze this in, say, the ROC widget, you would also analyze one output at a time.

The most doable solution, I think, is to modify the Test and Score widget as follows. When training, it would trains multi-output models. But then it would construct multiple instances of Orange.evaluation.Results, one per each output. The widget would have an additional combo (which would be hidden for "normal" data, and shown only for multi-output models) in which the user would select a single output. The widget would show the scores for this output, and the widget would also only output the corresponding Result object.

Alternatively, the widget could show scores for all target variables (e.g. multiple ca's at once), but the user would stil have to choose which results to output, so that the widget would output the same object as it does now.

Would this make sense?

from orange3.

Sorry for my late response. I understand, that not all widgets support multi target, but this does not matter. I modified the code already and introduced a new modelling type "multi_regression" in addition to "classification" and "regression". I use this indicator to introduce a special treatment in to build the proper ANN model, but my biggest problem at the moment is the handling of the results in the test and score widget, because I cannot fix a dimension issue. Maybe I can pass over my code to give me some hints. Also I found a bug in the way results are treated.

I will try to follow your hints in the Test&Score widget.

The main reason to make this extension is caused by the fact, that in industrial applications for process modelling MI-MO is my preferred architecture. I also plan to add a new explain model widget, which is based calculating the derivative of an ANN, which supports MI-SO and MI-MO models.

I am looking forward to your thoughts.

:-)

from orange3.