SP5_SP6-item6 : local training about fedbiomed HOT 4 CLOSED

In GitLab by @mvesin on Jun 23, 2021, 15:53

marked the checklist item implement local training as incomplete

from fedbiomed.

In GitLab by @mvesin on Jun 24, 2021, 09:34

marked the checklist item implement local training as completed

from fedbiomed.

In GitLab by @mvesin on Jun 24, 2021, 13:36

• Why do we need to import torch & F before testing, as they seem to be already imported before when defining the model ?

%%writefile "$model_file"

import torch
import torch.nn as nn
from   fedbiomed.common.torchnn import Torchnn
import torch.nn.functional as F

# you can use any class name eg:
# class NetAlter(Torchnn):
class Net(Torchnn):
    def __init__(self):
...

and then :

# torch & F are not know if we don't import them here
import torch
import torch.nn.functional as F

test_set = datasets.MNIST(root = TMP_DIR + '/local_mnist_testing.tmp', download = True, train = False, transform = transform)
test_loader = torch.utils.data.DataLoader(test_set, batch_size=64, shuffle=True)
...

• TLDR: this is normal

• explanation :

  • %%writefile indicates that the content of the cell will be saved to a file not executed. Thus the import was not executed in the notebook (and those modules/functions never available in context of the notebook).
  • nevertheless, these imports are executed in localJob.__init__() when importing the class Net from the module corresponding to %%writefile. So the corresponding symbols are available within the context of the Net() object, which is used for training. You can check it with this, which gives F is defined at execution :

class Net(Torchnn):
    def __init__(self):
        super(Net, self).__init__()
        try:
            F
            print("F IS DEFINED")
        except NameError:
            print("F IS NOT DEFINED")
        print(dir())
        print(globals().keys())
...

• also note that F does not appear in dir() but appears in globals().keys(), as it is not defined in Net's namespace but in the enclosing module's namespace. Some context about python namespaces here

from fedbiomed.

In GitLab by @mvesin on Jul 5, 2021, 11:44

marked the checklist item compare with fed training (accuracy) as completed

from fedbiomed.